-- Logs begin at Wed 2022-08-24 09:02:40 UTC, end at Wed 2022-08-24 10:09:00 UTC. -- Aug 24 09:30:25.798352 dv-cinder-854271-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 09:30:25.809840 dv-cinder-854271-2-smb devstack@keystone.service[82873]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 09:30:25.811866 dv-cinder-854271-2-smb devstack@keystone.service[82873]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 09:30:25 2022] *** Aug 24 09:30:25.811866 dv-cinder-854271-2-smb devstack@keystone.service[82873]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 09:30:25.811866 dv-cinder-854271-2-smb devstack@keystone.service[82873]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 09:30:25.811866 dv-cinder-854271-2-smb devstack@keystone.service[82873]: nodename: dv-cinder-854271-2-smb Aug 24 09:30:25.811866 dv-cinder-854271-2-smb devstack@keystone.service[82873]: machine: x86_64 Aug 24 09:30:25.811866 dv-cinder-854271-2-smb devstack@keystone.service[82873]: clock source: unix Aug 24 09:30:25.811866 dv-cinder-854271-2-smb devstack@keystone.service[82873]: pcre jit disabled Aug 24 09:30:25.811866 dv-cinder-854271-2-smb devstack@keystone.service[82873]: detected number of CPU cores: 4 Aug 24 09:30:25.811866 dv-cinder-854271-2-smb devstack@keystone.service[82873]: current working directory: / Aug 24 09:30:25.811866 dv-cinder-854271-2-smb devstack@keystone.service[82873]: detected binary path: /usr/bin/uwsgi-core Aug 24 09:30:25.811866 dv-cinder-854271-2-smb devstack@keystone.service[82873]: your processes number limit is 47680 Aug 24 09:30:25.811866 dv-cinder-854271-2-smb devstack@keystone.service[82873]: your memory page size is 4096 bytes Aug 24 09:30:25.811866 dv-cinder-854271-2-smb devstack@keystone.service[82873]: detected max file descriptor number: 2048 Aug 24 09:30:25.812508 dv-cinder-854271-2-smb devstack@keystone.service[82873]: lock engine: pthread robust mutexes Aug 24 09:30:25.812508 dv-cinder-854271-2-smb devstack@keystone.service[82873]: thunder lock: enabled Aug 24 09:30:25.812508 dv-cinder-854271-2-smb devstack@keystone.service[82873]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 09:30:25.812508 dv-cinder-854271-2-smb devstack@keystone.service[82873]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 09:30:25.851636 dv-cinder-854271-2-smb devstack@keystone.service[82873]: Python main interpreter initialized at 0x55ce547f69c0 Aug 24 09:30:25.851636 dv-cinder-854271-2-smb devstack@keystone.service[82873]: python threads support enabled Aug 24 09:30:25.851636 dv-cinder-854271-2-smb devstack@keystone.service[82873]: your server socket listen backlog is limited to 100 connections Aug 24 09:30:25.851636 dv-cinder-854271-2-smb devstack@keystone.service[82873]: your mercy for graceful operations on workers is 90 seconds Aug 24 09:30:25.851970 dv-cinder-854271-2-smb devstack@keystone.service[82873]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 09:30:25.852050 dv-cinder-854271-2-smb devstack@keystone.service[82873]: *** Operational MODE: preforking *** Aug 24 09:30:25.852319 dv-cinder-854271-2-smb devstack@keystone.service[82873]: *** uWSGI is running in multiple interpreter mode *** Aug 24 09:30:25.852319 dv-cinder-854271-2-smb devstack@keystone.service[82873]: spawned uWSGI master process (pid: 82873) Aug 24 09:30:25.852509 dv-cinder-854271-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 09:30:25.854332 dv-cinder-854271-2-smb devstack@keystone.service[82873]: spawned uWSGI worker 1 (pid: 82884, cores: 1) Aug 24 09:30:25.854332 dv-cinder-854271-2-smb devstack@keystone.service[82873]: spawned uWSGI worker 2 (pid: 82885, cores: 1) Aug 24 09:30:25.854332 dv-cinder-854271-2-smb devstack@keystone.service[82873]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 09:30:30.217556 dv-cinder-854271-2-smb devstack@keystone.service[82884]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:30:30.217556 dv-cinder-854271-2-smb devstack@keystone.service[82884]: from cryptography.utils import int_from_bytes Aug 24 09:30:30.218372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:30:30.218372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: from cryptography.utils import int_from_bytes Aug 24 09:30:30.218807 dv-cinder-854271-2-smb devstack@keystone.service[82884]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:30:30.218807 dv-cinder-854271-2-smb devstack@keystone.service[82884]: from cryptography.utils import int_from_bytes Aug 24 09:30:30.218913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:30:30.218913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: from cryptography.utils import int_from_bytes Aug 24 09:30:30.269918 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 09:30:30.270117 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 09:30:30.270117 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 09:30:30.270270 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 09:30:30.270345 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] command line args: [] {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 09:30:30.270413 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] command line args: [] {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 09:30:30.270538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 09:30:30.270666 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 09:30:30.270741 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ================================================================================ {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 09:30:30.270805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ================================================================================ {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 09:30:30.271044 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] admin_token = **** {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.271141 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] admin_token = **** {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.271208 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] config_dir = [] {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.271266 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] config_dir = [] {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.271437 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.271518 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.271518 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] config_source = [] {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.271639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] config_source = [] {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.271702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] debug = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.271760 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] debug = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.271924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.272123 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.272215 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.272273 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.273559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.273686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.273755 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.273828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.273893 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.273950 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.274006 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] list_limit = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.274062 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] list_limit = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.274117 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] log_config_append = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.274180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] log_config_append = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.274243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.274299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.274360 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] log_dir = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.274422 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] log_dir = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.274482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] log_file = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.274548 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] log_file = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.274610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.274667 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.274727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.274788 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.274850 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.274916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.274977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.275041 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.275106 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.275164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.275230 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.275294 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.275356 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.275412 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.275473 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.275537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.275766 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.275872 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.275945 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.276022 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.276097 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.276169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.276402 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.276486 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.276552 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.276610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.276784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.276870 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.277053 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.277138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.277590 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.277681 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.277757 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] publish_errors = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.277822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] publish_errors = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.277973 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.278083 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.278182 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.278364 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.278565 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.278671 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.278742 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.278825 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.279025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.279133 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] standard_threads = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.279202 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.279260 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.279455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] standard_threads = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.279562 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.279644 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.279795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.279886 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] use_journal = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.280054 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] use_json = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.280192 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.280258 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] use_stderr = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.280321 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.280384 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] use_syslog = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.280446 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] use_journal = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.280526 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.280641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] use_json = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.280732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] use_stderr = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.280870 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] use_syslog = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.281097 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:30:30.281407 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.281665 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.281784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.281929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.282174 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.282424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.282520 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.282658 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.282907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.283144 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.283294 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.283404 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.283550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.283657 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.283856 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.284032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.284669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.284975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.285218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.285414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.285543 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.285728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.285966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.286189 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.286286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.286460 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.286706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.286918 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.287015 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.287182 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.287380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.287471 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.287642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.287741 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.287901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.287993 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.288125 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.288234 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.288395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.288616 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.288869 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.289004 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.289120 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.289366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.289634 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.289736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.289895 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.290145 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.290247 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.290382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.290489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.290735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.290972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.291126 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.291219 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.291446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.291698 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.291873 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.291968 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.292173 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.292404 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.292625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.292722 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.292862 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.293093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.293325 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.293488 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.293599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.293803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.294040 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.294208 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.294307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.294504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.294762 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.294934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.295037 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.295178 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.295262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.295430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.295534 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.295685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.295794 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.295912 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.296019 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.296163 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.296371 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.296461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.296639 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.296813 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.296924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.297124 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.297377 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.297646 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.297741 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.297886 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.298127 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.298349 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.298460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.298581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.298815 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.299072 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.299315 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.299424 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.299548 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.299655 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.300478 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.300741 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.300903 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.301041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.301146 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.301309 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.301556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.301674 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.301803 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.301886 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.302068 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.302176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.302314 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.302410 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.302588 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.302688 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.302760 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.302821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.302989 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.303111 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.303221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.303324 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.303438 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.303559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.303742 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.303846 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.303911 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.303969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.304164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.304275 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.304446 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.304532 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.304593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.304649 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.304818 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.304942 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.305062 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.305169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.305315 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.305415 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.305569 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.305756 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.305870 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.305987 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.306100 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.306226 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.306498 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.306604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.306780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.306866 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.307024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.307117 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.307203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.307323 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.307550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.307791 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.307956 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.308052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.308250 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.308502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.308672 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.308767 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.308964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.309209 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.309378 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.309511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.309695 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.309883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.309975 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.310129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.310230 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.310375 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.310456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.310585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.310692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.310848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.310935 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.311054 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.311117 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.311288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.311373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.311527 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.311627 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.311782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.311986 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.312087 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.312235 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.312328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.312474 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.312563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.312713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.312803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.312948 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.313036 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] auth.external = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.313178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.313268 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.313522 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.313611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.313686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.313757 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.313911 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.314004 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] auth.password = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.314152 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.314254 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] auth.token = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.314385 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.314502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.314629 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.314854 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.314976 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.315131 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.315235 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.315364 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.315473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.315641 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.315742 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] auth.external = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.315902 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.316000 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.316118 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.316350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] credential.caching = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.316475 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.316613 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.316702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.316824 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] auth.password = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.316904 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.317051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] auth.token = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.317134 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.317286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.317412 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.317569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.317687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.317804 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.317920 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.318035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.318158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.318287 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.318410 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.318535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.318660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.318777 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.318891 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.319020 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] credential.caching = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.319138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.319249 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.319364 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.319480 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.319597 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.319723 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.319839 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.319960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.320076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.320194 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.320270 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] federation.caching = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.320352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.320425 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.320525 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.320641 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.320852 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.321065 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.321308 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.321576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.321802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.321943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.322075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.322217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.322363 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.322495 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.322625 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.322757 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.322887 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.323025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.323162 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] identity.caching = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.323162 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.323409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.323539 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.323670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.323809 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.323941 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.324072 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.324212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] federation.caching = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.324342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.324473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.324611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.324742 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.324873 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.325003 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.325133 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.325263 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.325401 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.325569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.325704 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.325834 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.325975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.325975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.326282 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.326416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.326548 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.326678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.326822 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.326956 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.327095 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.327228 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.327366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.327504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.327636 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] identity.caching = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.327636 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.327901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.328035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.328176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.328308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.328439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.328569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.328708 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.328841 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.328972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.329103 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.329233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.329363 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.329596 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.329747 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.329880 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.330011 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.330141 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.330272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.330411 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.330543 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.330674 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.330805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.330978 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.331157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.331300 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.331433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.331574 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.331788 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.331929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.331929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.332192 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.332192 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.332445 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.332583 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.332715 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.332845 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.332985 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.333117 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.333248 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.333380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.333542 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.333689 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.333822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.333953 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.334090 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.334222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.334353 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.334494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.334626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.334756 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.334887 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.335018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.335148 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.335287 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.335430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.335430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.335715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.335847 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.335978 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.336117 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.336250 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.336250 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.336497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.336628 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.336759 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.336897 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.337035 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.user = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.337167 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.337309 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.337441 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.337630 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.337775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.337907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.338038 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.338178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.338178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.338426 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.338567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.338699 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.338829 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.338959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.339100 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.339230 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.339369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.339502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.339633 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.339763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.339893 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.340024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.340162 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.340295 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.340295 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.340543 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.340673 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.340810 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.340959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.341133 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.341270 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.341401 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.341555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.user = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.341688 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.341830 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.341963 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.342100 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.342233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.342380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.342516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.342657 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.342789 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.342789 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.343048 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.343180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.343311 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.343450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.343582 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.343713 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.343844 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.343974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.344104 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.344243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.344375 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.344506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.344646 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.344779 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.344909 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.345048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.345180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.345311 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.345442 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.345595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.345733 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.345877 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.346009 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.346141 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.346271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.346402 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.346542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.347205 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.347345 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.347476 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] resource.caching = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.347606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.347736 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.347867 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.348006 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.348145 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.348279 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.348410 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.348539 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.348669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.348808 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.348950 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.349081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.349210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.349340 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.349501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.349501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.349770 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.349900 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.350032 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.350163 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.350293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] role.caching = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.350432 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.350564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] role.driver = sql {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.350694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.350834 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.350965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.351109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.351289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.351421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.351553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.351683 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.351814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.351952 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.352085 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] resource.caching = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.352215 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.352346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.352476 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.352622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.352823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.352957 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.353087 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.353218 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.353348 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.353498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.353648 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.353780 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.353780 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.354025 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.354155 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.354294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.354432 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.354573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.354704 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] role.caching = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.354704 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] role.driver = sql {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.354951 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.355329 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.355474 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.355606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.355737 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.355869 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.356000 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.356137 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.356277 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.356409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.356561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.356561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.356809 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.356941 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.357080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.357211 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.357343 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.357541 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.357682 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.357813 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.357955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.358094 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.358094 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.358356 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.358488 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.358619 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.358619 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.358877 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.359007 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.359139 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.359139 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.359394 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.359527 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.359657 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.359787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.359917 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.360061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] token.caching = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.360202 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.360334 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.360334 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.360588 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.360719 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.360849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.360988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.361120 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.361290 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.361428 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.361585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.361716 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.361860 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.362003 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.362135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.362285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.362997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.363130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.363271 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.363403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.363534 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.363665 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.363665 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.363912 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.364052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.364184 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.364325 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.364462 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.364462 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.364711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.364711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.364968 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.364968 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.365215 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] token.caching = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.365345 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] database.connection = **** {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.365550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.365700 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.365842 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.365974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.366105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.366247 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.366378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.366509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.366648 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.366781 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.366912 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.367043 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.367175 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.367307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.367446 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.367579 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.367710 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.367842 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.367973 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.368123 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.368265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.368398 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.368528 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.368659 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.368790 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.368922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.368922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.369178 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.369309 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.369440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.369592 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.369725 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.369866 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.370010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.370141 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.370272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] database.connection = **** {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.370412 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82884) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 09:30:30.370554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.370554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.370554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.370554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.370554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.370554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.370554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.370554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.370554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.371692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.371692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.371692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.371692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.371692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.371692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.371692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.371692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.371692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:30:30.372779 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82885) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 09:30:30.395445 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.395734 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.395891 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.396211 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.397072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.397072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.404672 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.405109 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.434506 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.434735 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.435608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.435856 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.490267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.490810 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.539222 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.539449 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.540118 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.540358 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.702052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.702357 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.702453 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.702524 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.702606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.702725 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.702853 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.702932 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.703001 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.703137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.703259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.703594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.727308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.727487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.727718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.727853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.727927 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.728068 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.728181 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.728351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.728534 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.728623 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.728759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.728844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.728976 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.729356 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.740983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.741409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.754910 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.755134 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.755251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.755491 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.755656 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.755766 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.755938 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.756110 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.756214 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.756324 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.756429 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.756564 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82885) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.756771 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.757008 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82884) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 09:30:30.773510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.773707 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 09:30:30.773943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.774155 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 09:30:30.774500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.774660 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.774756 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 09:30:30.774957 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.775224 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.775324 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 09:30:30.775727 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.775831 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.775992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.776405 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.776959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.777232 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.785592 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.785898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.786080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.786366 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.786866 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.787156 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.787439 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.787729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.793298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.794795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.796365 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.796650 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.796938 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.797224 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.797528 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.797733 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.797848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.798023 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.798113 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.798326 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.798417 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.798606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.798727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.798892 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.799011 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.799262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.799422 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.799677 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.800499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.800899 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.801185 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.801482 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.823614 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.824720 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.825172 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.825543 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.826432 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.826729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.830473 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.830761 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.831066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.831545 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.831937 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.832165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.838116 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.838433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.838607 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.839053 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.842855 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.843298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.843415 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.843637 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.843931 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.844125 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.844239 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.844488 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.844768 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.844911 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.845033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.845206 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.845299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.845519 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.845816 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.846110 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.863440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.863748 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.865245 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.865631 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.867676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.869516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.870970 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.871271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.872731 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.873058 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.875514 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.877315 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.879540 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.881023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.883039 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.883345 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.883637 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.883931 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.884234 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.884330 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.884527 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.884620 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.884817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.885102 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.885379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.885695 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.900668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.901009 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.901242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.901543 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.901636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.901875 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.902141 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.902412 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.908465 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.909593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.910063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.910349 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.911110 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.911386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.913066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.913371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.913696 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.913994 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.914083 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.914281 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.914374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.914597 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.914893 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.915171 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.926343 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.926636 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.926926 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.927160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.927296 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.927452 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.927548 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.927722 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.927818 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.928003 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.928098 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.928283 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.928560 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.928835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.944060 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.945084 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.947159 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.948285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.950088 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.951361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.951535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.952790 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.953025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.953315 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.953623 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.954290 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.954572 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.954862 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.960314 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.961561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.961822 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.962989 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.964731 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.965030 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.965322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.965638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.966012 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.966311 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.966596 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.966880 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.973851 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.974156 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.974444 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.975029 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.975321 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.975600 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.981661 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82885) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.981949 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.982236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.982520 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.982710 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82884) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 09:30:30.982796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.982992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.983076 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.983274 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.983367 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.983550 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.983634 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.983834 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.983917 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.984106 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.984190 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.984379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.984462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.984652 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.984746 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.984928 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.985031 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.985197 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.985315 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82885) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.985521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.985771 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.986026 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:30.986298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82884) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 09:30:31.021394 dv-cinder-854271-2-smb devstack@keystone.service[82885]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ce547f69c0 pid: 82885 (default app) Aug 24 09:30:31.022067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ce547f69c0 pid: 82884 (default app) Aug 24 09:30:31.024914 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d0ab2-9aba-40e1-ad63-c2106a5abb1b None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:31.025200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d0ab2-9aba-40e1-ad63-c2106a5abb1b None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:31.025516 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d0ab2-9aba-40e1-ad63-c2106a5abb1b None None] PATH_INFO: `/v3` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:31.029676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 791 bytes} [Wed Aug 24 09:30:31 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:30:37.772664 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a9f66-6345-4d61-9f74-6171b6e84aaa None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:37.773299 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a9f66-6345-4d61-9f74-6171b6e84aaa None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:37.773299 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a9f66-6345-4d61-9f74-6171b6e84aaa None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:37.777435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1/2] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:30:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:30:37.783777 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238b5a5-f0bf-455a-9c36-189f877e574b None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:37.784205 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238b5a5-f0bf-455a-9c36-189f877e574b None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:37.784893 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238b5a5-f0bf-455a-9c36-189f877e574b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:37.856735 dv-cinder-854271-2-smb devstack@keystone.service[82885]: INFO dbcounter [None req-f238b5a5-f0bf-455a-9c36-189f877e574b None None] Registered counter for database keystone Aug 24 09:30:37.876384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG oslo_db.sqlalchemy.engines [None req-f238b5a5-f0bf-455a-9c36-189f877e574b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82885) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:30:37.882794 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writer thread running {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:30:38.063739 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG passlib.handlers.bcrypt [None req-f238b5a5-f0bf-455a-9c36-189f877e574b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=82885) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 09:30:38.064061 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG passlib.handlers.bcrypt [None req-f238b5a5-f0bf-455a-9c36-189f877e574b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82885) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 09:30:38.119187 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-f238b5a5-f0bf-455a-9c36-189f877e574b None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:38.120804 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f238b5a5-f0bf-455a-9c36-189f877e574b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:38.258274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 2/3] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 09:30:38.693338 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a9f66-6345-4d61-9f74-6171b6e84aaa None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:38.764298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: INFO dbcounter [None req-f46a9f66-6345-4d61-9f74-6171b6e84aaa None None] Registered counter for database keystone Aug 24 09:30:38.786313 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG oslo_db.sqlalchemy.engines [None req-f46a9f66-6345-4d61-9f74-6171b6e84aaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82884) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:30:38.792483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writer thread running {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:30:38.912071 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a9f66-6345-4d61-9f74-6171b6e84aaa None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:38.916428 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c54ec-a296-4bd7-b982-ec711cd99368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:38.917056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c54ec-a296-4bd7-b982-ec711cd99368 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:38.917341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c54ec-a296-4bd7-b982-ec711cd99368 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:38.917650 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c54ec-a296-4bd7-b982-ec711cd99368 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:38.926560 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c54ec-a296-4bd7-b982-ec711cd99368 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:38.978781 dv-cinder-854271-2-smb devstack@keystone.service[82884]: WARNING keystone.common.rbac_enforcer.enforcer [None req-be4c54ec-a296-4bd7-b982-ec711cd99368 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 09:30:38.979042 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c54ec-a296-4bd7-b982-ec711cd99368 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:38.989979 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1324 bytes} [Wed Aug 24 09:30:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:30:38.996165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238b5a5-f0bf-455a-9c36-189f877e574b None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:39.011687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238b5a5-f0bf-455a-9c36-189f877e574b None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:39.016041 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff239f-394d-4824-be07-30d7c63bdb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:39.017140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff239f-394d-4824-be07-30d7c63bdb20 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:39.017423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff239f-394d-4824-be07-30d7c63bdb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:39.017723 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff239f-394d-4824-be07-30d7c63bdb20 admin admin] PATH_INFO: `/v3/projects/28c010260e5042edbe919c3cfc65493b` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:39.019366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff239f-394d-4824-be07-30d7c63bdb20 admin admin] RBAC: Authorizing `identity:get_project(project_id=28c010260e5042edbe919c3cfc65493b)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:39.073979 dv-cinder-854271-2-smb devstack@keystone.service[82885]: WARNING keystone.common.rbac_enforcer.enforcer [None req-71ff239f-394d-4824-be07-30d7c63bdb20 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 09:30:39.074342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff239f-394d-4824-be07-30d7c63bdb20 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:39.079121 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 3/5] 10.222.0.58 () {56 vars in 1207 bytes} [Wed Aug 24 09:30:38 2022] GET /identity/v3/projects/28c010260e5042edbe919c3cfc65493b => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:30:41.008958 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63f33d-17ea-4e97-8be2-25894459d135 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:41.009539 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63f33d-17ea-4e97-8be2-25894459d135 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:41.009539 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63f33d-17ea-4e97-8be2-25894459d135 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:41.013648 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 3/6] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:30:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:41.019840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169beff0-de9a-487d-b982-5357406387c5 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:41.020274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169beff0-de9a-487d-b982-5357406387c5 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:41.020392 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169beff0-de9a-487d-b982-5357406387c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:41.040211 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-169beff0-de9a-487d-b982-5357406387c5 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:41.041769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-169beff0-de9a-487d-b982-5357406387c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:41.049680 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 09:30:41.323629 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63f33d-17ea-4e97-8be2-25894459d135 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:41.335879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63f33d-17ea-4e97-8be2-25894459d135 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:41.340086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8e90c-1d23-49e1-85be-97b45c86eae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:41.340686 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8e90c-1d23-49e1-85be-97b45c86eae3 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:41.340969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8e90c-1d23-49e1-85be-97b45c86eae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:41.341246 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8e90c-1d23-49e1-85be-97b45c86eae3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:41.349053 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8e90c-1d23-49e1-85be-97b45c86eae3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:41.350854 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8e90c-1d23-49e1-85be-97b45c86eae3 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:41.359882 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 4/8] 10.222.0.58 () {58 vars in 1324 bytes} [Wed Aug 24 09:30:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:30:41.365936 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169beff0-de9a-487d-b982-5357406387c5 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:41.375137 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169beff0-de9a-487d-b982-5357406387c5 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:41.380185 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300cb2d2-896e-4457-af9a-22fc1ccf4a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:41.380810 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cb2d2-896e-4457-af9a-22fc1ccf4a4e admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:41.381095 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cb2d2-896e-4457-af9a-22fc1ccf4a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:41.381374 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300cb2d2-896e-4457-af9a-22fc1ccf4a4e admin admin] PATH_INFO: `/v3/users/4757bd29ffb0448ca0dc35345a8b1469` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:41.382727 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300cb2d2-896e-4457-af9a-22fc1ccf4a4e admin admin] RBAC: Authorizing `identity:get_user(user_id=4757bd29ffb0448ca0dc35345a8b1469)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:41.384531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300cb2d2-896e-4457-af9a-22fc1ccf4a4e admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:41.386088 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 5/9] 10.222.0.58 () {56 vars in 1198 bytes} [Wed Aug 24 09:30:41 2022] GET /identity/v3/users/4757bd29ffb0448ca0dc35345a8b1469 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:30:43.385828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6560863-42f3-420e-bcb3-0f6fa912dff7 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:43.386370 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6560863-42f3-420e-bcb3-0f6fa912dff7 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:43.386370 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6560863-42f3-420e-bcb3-0f6fa912dff7 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:43.387792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 5/10] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:43.393195 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c5367-7573-48cd-b48f-ac7ba0f65cb0 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:43.394171 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c5367-7573-48cd-b48f-ac7ba0f65cb0 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:43.394370 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c5367-7573-48cd-b48f-ac7ba0f65cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:43.412675 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-aa1c5367-7573-48cd-b48f-ac7ba0f65cb0 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:43.413925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-aa1c5367-7573-48cd-b48f-ac7ba0f65cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:43.420256 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef20b1a-2fa0-499f-92e1-54f7630788e6 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:43.420536 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef20b1a-2fa0-499f-92e1-54f7630788e6 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:43.420813 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef20b1a-2fa0-499f-92e1-54f7630788e6 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:43.422166 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 6/11] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:30:43.427446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cf642-f0e1-4db9-bd75-836bd6164fd6 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:43.427796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cf642-f0e1-4db9-bd75-836bd6164fd6 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:43.428078 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cf642-f0e1-4db9-bd75-836bd6164fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:43.470328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG passlib.handlers.bcrypt [None req-a36cf642-f0e1-4db9-bd75-836bd6164fd6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=82884) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 09:30:43.470744 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG passlib.handlers.bcrypt [None req-a36cf642-f0e1-4db9-bd75-836bd6164fd6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82884) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 09:30:43.494259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 6/12] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:30:43.516518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-a36cf642-f0e1-4db9-bd75-836bd6164fd6 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:43.518137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-a36cf642-f0e1-4db9-bd75-836bd6164fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:43.617321 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 7/13] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:30:43.767894 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c5367-7573-48cd-b48f-ac7ba0f65cb0 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:43.792320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:43.874222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c5367-7573-48cd-b48f-ac7ba0f65cb0 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:43.887636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cf642-f0e1-4db9-bd75-836bd6164fd6 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:43.908150 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb7d05-6777-4259-9859-899aac1bef7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:43.908823 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb7d05-6777-4259-9859-899aac1bef7e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:43.909101 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb7d05-6777-4259-9859-899aac1bef7e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:43.909940 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb7d05-6777-4259-9859-899aac1bef7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:43.921008 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb7d05-6777-4259-9859-899aac1bef7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:30:43.930476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-36bb7d05-6777-4259-9859-899aac1bef7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:30:43.930476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:30:43.930476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:30:43.930476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:30:43.930476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:30:43.930476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:30:43.930476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:30:43.930476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:30:43.930476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:30:43.930476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:30:43.930476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:30:43.930476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:30:43.930476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:30:43.930476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:30:43.930476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:30:43.930476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:30:43.931409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:30:43.931409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:30:43.931409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:30:43.931409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:30:43.931409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:30:43.931409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:30:43.931409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:30:43.931409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:30:43.931409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:30:43.931409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:30:43.931409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:30:43.931409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:30:43.931409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:30:43.931409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:30:43.931409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:30:43.931409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:30:43.932217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:30:43.932217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:30:43.932217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:30:43.932217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:30:43.932217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:30:43.932217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:30:43.932217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:30:43.932217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:30:43.932217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:30:43.932217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:30:43.932217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:30:43.932217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:30:43.932217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 7/14] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:30:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:30:43.937295 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb7d05-6777-4259-9859-899aac1bef7e None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:43.991416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cf642-f0e1-4db9-bd75-836bd6164fd6 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:43.994179 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:44.019454 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:44.028930 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e8594-5823-434d-8354-d1a4f1182571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:44.029817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e8594-5823-434d-8354-d1a4f1182571 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:44.030107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e8594-5823-434d-8354-d1a4f1182571 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:44.030384 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e8594-5823-434d-8354-d1a4f1182571 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:44.039361 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb7d05-6777-4259-9859-899aac1bef7e None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:44.073918 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16f628-d405-44f1-8913-7083cb4f418b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:44.074529 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16f628-d405-44f1-8913-7083cb4f418b None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:44.074817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16f628-d405-44f1-8913-7083cb4f418b None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:44.075092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16f628-d405-44f1-8913-7083cb4f418b None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:44.075757 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16f628-d405-44f1-8913-7083cb4f418b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:30:44.076061 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16f628-d405-44f1-8913-7083cb4f418b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:44.077507 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16f628-d405-44f1-8913-7083cb4f418b None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:44.089722 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 8/15] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:30:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:30:44.095179 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16f628-d405-44f1-8913-7083cb4f418b None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:44.104744 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e8594-5823-434d-8354-d1a4f1182571 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:44.106587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e8594-5823-434d-8354-d1a4f1182571 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:44.195018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16f628-d405-44f1-8913-7083cb4f418b None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:44.210067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 8/16] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:30:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 09:30:44.217806 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e8594-5823-434d-8354-d1a4f1182571 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:44.226995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:44.242075 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1b3e4-ec7e-4f71-8ed8-97195265d485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:44.242721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1b3e4-ec7e-4f71-8ed8-97195265d485 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:44.243058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1b3e4-ec7e-4f71-8ed8-97195265d485 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:44.243341 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1b3e4-ec7e-4f71-8ed8-97195265d485 None admin] PATH_INFO: `/v3/users/4757bd29ffb0448ca0dc35345a8b1469` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:44.244498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1b3e4-ec7e-4f71-8ed8-97195265d485 None admin] RBAC: Authorizing `identity:get_user(user_id=4757bd29ffb0448ca0dc35345a8b1469)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:44.245990 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1b3e4-ec7e-4f71-8ed8-97195265d485 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:44.247743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 9/17] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:30:44 2022] GET /identity/v3/users/4757bd29ffb0448ca0dc35345a8b1469 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:30:44.253759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1b3e4-ec7e-4f71-8ed8-97195265d485 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:44.268337 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:44.321549 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e8594-5823-434d-8354-d1a4f1182571 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:44.354164 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63376a6-213e-4b5c-895b-c2f54cfa48ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:44.355012 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63376a6-213e-4b5c-895b-c2f54cfa48ef None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:44.355288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63376a6-213e-4b5c-895b-c2f54cfa48ef None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:44.355387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1b3e4-ec7e-4f71-8ed8-97195265d485 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:44.355557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63376a6-213e-4b5c-895b-c2f54cfa48ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:44.374676 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63376a6-213e-4b5c-895b-c2f54cfa48ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:44.376139 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63376a6-213e-4b5c-895b-c2f54cfa48ef None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:44.389859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22237ceb-3d2d-4121-be45-19e85bffedfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:44.390526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22237ceb-3d2d-4121-be45-19e85bffedfe None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:44.390820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22237ceb-3d2d-4121-be45-19e85bffedfe None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:44.391101 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22237ceb-3d2d-4121-be45-19e85bffedfe None admin] PATH_INFO: `/v3/domains/default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:44.392285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22237ceb-3d2d-4121-be45-19e85bffedfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:44.393843 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22237ceb-3d2d-4121-be45-19e85bffedfe None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:44.394787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-f63376a6-213e-4b5c-895b-c2f54cfa48ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:30:44.394787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:30:44.394787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:30:44.394787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:30:44.394787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:30:44.394787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:30:44.394787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:30:44.394787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:30:44.394787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:30:44.394787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:30:44.394787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:30:44.394787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:30:44.394787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:30:44.394787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:30:44.394787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:30:44.394787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:30:44.395987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:30:44.395987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:30:44.395987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:30:44.395987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:30:44.395987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:30:44.395987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:30:44.395987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:30:44.395987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:30:44.395987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:30:44.395987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:30:44.395987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:30:44.395987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:30:44.395987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:30:44.395987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:30:44.395987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:30:44.395987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:30:44.395987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:30:44.396794 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:30:44.396794 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:30:44.396794 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:30:44.396955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 10/18] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:30:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:30:44.397017 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 9/19] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:30:44.401665 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22237ceb-3d2d-4121-be45-19e85bffedfe None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:44.401775 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63376a6-213e-4b5c-895b-c2f54cfa48ef None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:44.459772 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:44.484578 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:44.503809 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22237ceb-3d2d-4121-be45-19e85bffedfe None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:44.505332 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63376a6-213e-4b5c-895b-c2f54cfa48ef None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:44.538501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376a5a4-1f66-45c0-9b79-fc0957aa7967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:44.539094 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb60509-10c1-4c4d-ac35-1e0603b63fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:44.539206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376a5a4-1f66-45c0-9b79-fc0957aa7967 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:44.539384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376a5a4-1f66-45c0-9b79-fc0957aa7967 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:44.539661 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376a5a4-1f66-45c0-9b79-fc0957aa7967 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:44.539743 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb60509-10c1-4c4d-ac35-1e0603b63fd3 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:44.540248 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb60509-10c1-4c4d-ac35-1e0603b63fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:44.540393 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376a5a4-1f66-45c0-9b79-fc0957aa7967 None admin] RBAC: Adding query filter params (role.id=cd2effe8340d4be08a28d3a40db6979d, scope.domain.id=default, user.id=4757bd29ffb0448ca0dc35345a8b1469) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:30:44.540525 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb60509-10c1-4c4d-ac35-1e0603b63fd3 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:44.540703 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376a5a4-1f66-45c0-9b79-fc0957aa7967 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:44.541165 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb60509-10c1-4c4d-ac35-1e0603b63fd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:30:44.541498 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb60509-10c1-4c4d-ac35-1e0603b63fd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:44.542181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376a5a4-1f66-45c0-9b79-fc0957aa7967 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:44.542869 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb60509-10c1-4c4d-ac35-1e0603b63fd3 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:44.548827 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 11/20] 10.222.0.58 () {56 vars in 1322 bytes} [Wed Aug 24 09:30:44 2022] GET /identity/v3/role_assignments?user.id=4757bd29ffb0448ca0dc35345a8b1469&scope.domain.id=default&role.id=cd2effe8340d4be08a28d3a40db6979d => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:30:44.562625 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 10/21] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:30:46.711146 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cd469-d015-4b45-9304-6b6bb6b0a1f1 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:46.711663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cd469-d015-4b45-9304-6b6bb6b0a1f1 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:46.711764 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cd469-d015-4b45-9304-6b6bb6b0a1f1 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:46.713385 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 12/22] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:46.718934 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83830a1c-3416-4d6c-b8ab-14b16cf08ef4 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:46.719333 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83830a1c-3416-4d6c-b8ab-14b16cf08ef4 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:46.719506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83830a1c-3416-4d6c-b8ab-14b16cf08ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:46.744796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-83830a1c-3416-4d6c-b8ab-14b16cf08ef4 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:46.746117 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-83830a1c-3416-4d6c-b8ab-14b16cf08ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:46.837187 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 11/23] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:30:47.061135 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053efa13-2ee3-4496-ab7c-ac7a7c7d4767 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:47.061483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053efa13-2ee3-4496-ab7c-ac7a7c7d4767 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:47.061695 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053efa13-2ee3-4496-ab7c-ac7a7c7d4767 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:47.062985 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:47.074404 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de630cf0-7ab1-45c1-bde0-c36187e5d67c None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:47.074564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081881de-bfec-44c0-8fde-a07328beabbd None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:47.074756 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081881de-bfec-44c0-8fde-a07328beabbd None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:47.074846 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de630cf0-7ab1-45c1-bde0-c36187e5d67c None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:47.075008 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081881de-bfec-44c0-8fde-a07328beabbd None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:47.075105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de630cf0-7ab1-45c1-bde0-c36187e5d67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:47.076277 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 12/25] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:47.087881 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f13f17-266d-4714-9540-100596a9efc1 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:47.088184 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f13f17-266d-4714-9540-100596a9efc1 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:47.088438 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f13f17-266d-4714-9540-100596a9efc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:47.102762 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-de630cf0-7ab1-45c1-bde0-c36187e5d67c None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:47.103977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-de630cf0-7ab1-45c1-bde0-c36187e5d67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:47.111782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-53f13f17-266d-4714-9540-100596a9efc1 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:47.113557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-53f13f17-266d-4714-9540-100596a9efc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:47.188006 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:47.231046 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 14/26] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:30:47.241819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 13/27] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:30:47.301155 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de630cf0-7ab1-45c1-bde0-c36187e5d67c None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:47.339991 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc2393-e260-4219-a1bc-91aa7cd7771b None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:47.340525 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc2393-e260-4219-a1bc-91aa7cd7771b None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:47.341010 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc2393-e260-4219-a1bc-91aa7cd7771b None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:47.342565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 14/28] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:30:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:30:47.350057 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3d4a4-ffe8-4d47-b352-9a4ddf98ac47 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:47.350572 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3d4a4-ffe8-4d47-b352-9a4ddf98ac47 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:47.351063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3d4a4-ffe8-4d47-b352-9a4ddf98ac47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:47.379165 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-0ae3d4a4-ffe8-4d47-b352-9a4ddf98ac47 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:47.380671 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-0ae3d4a4-ffe8-4d47-b352-9a4ddf98ac47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:47.415912 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:47.463546 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de630cf0-7ab1-45c1-bde0-c36187e5d67c None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:47.521272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce655f31-b76f-4f5f-a2db-d9e690adab46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:47.522015 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce655f31-b76f-4f5f-a2db-d9e690adab46 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:47.522539 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce655f31-b76f-4f5f-a2db-d9e690adab46 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:47.522818 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce655f31-b76f-4f5f-a2db-d9e690adab46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:47.533135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 15/29] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:30:47.539668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce655f31-b76f-4f5f-a2db-d9e690adab46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:47.541200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce655f31-b76f-4f5f-a2db-d9e690adab46 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:47.566945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-ce655f31-b76f-4f5f-a2db-d9e690adab46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:30:47.566945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:30:47.566945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:30:47.566945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:30:47.566945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:30:47.566945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:30:47.566945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:30:47.566945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:30:47.566945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:30:47.566945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:30:47.566945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:30:47.566945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:30:47.566945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:30:47.566945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:30:47.566945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:30:47.566945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:30:47.567808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:30:47.567808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:30:47.567808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:30:47.567808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:30:47.567808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:30:47.567808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:30:47.567808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:30:47.567808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:30:47.567808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:30:47.567808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:30:47.567808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:30:47.567808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:30:47.567808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:30:47.567808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:30:47.567808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:30:47.567808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:30:47.567808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:30:47.568580 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:30:47.568580 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:30:47.568580 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:30:47.572856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 15/30] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:30:47.574211 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3d4a4-ffe8-4d47-b352-9a4ddf98ac47 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:47.617763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce655f31-b76f-4f5f-a2db-d9e690adab46 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:47.723233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3d4a4-ffe8-4d47-b352-9a4ddf98ac47 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:47.732165 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:47.792397 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cff418-51ac-43f1-b657-105c5fd98d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:47.793426 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cff418-51ac-43f1-b657-105c5fd98d5a None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:47.793943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cff418-51ac-43f1-b657-105c5fd98d5a None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:47.795962 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cff418-51ac-43f1-b657-105c5fd98d5a None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:47.796923 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cff418-51ac-43f1-b657-105c5fd98d5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:30:47.797859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cff418-51ac-43f1-b657-105c5fd98d5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:47.801030 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cff418-51ac-43f1-b657-105c5fd98d5a None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:47.826656 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 16/31] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:30:47.830193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cff418-51ac-43f1-b657-105c5fd98d5a None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:47.833613 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce655f31-b76f-4f5f-a2db-d9e690adab46 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:47.910542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:47.928069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07807149-9a64-4d0e-a1b8-2070f4fa0551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:47.928819 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07807149-9a64-4d0e-a1b8-2070f4fa0551 None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:47.929234 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07807149-9a64-4d0e-a1b8-2070f4fa0551 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:47.929563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07807149-9a64-4d0e-a1b8-2070f4fa0551 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:47.930237 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07807149-9a64-4d0e-a1b8-2070f4fa0551 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:47.932758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07807149-9a64-4d0e-a1b8-2070f4fa0551 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:47.972816 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cff418-51ac-43f1-b657-105c5fd98d5a None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:48.010606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e317e8c-9e62-4b2a-b902-60cf7fc91331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:48.011497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e317e8c-9e62-4b2a-b902-60cf7fc91331 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:48.011943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e317e8c-9e62-4b2a-b902-60cf7fc91331 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:48.012365 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e317e8c-9e62-4b2a-b902-60cf7fc91331 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:48.025706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e317e8c-9e62-4b2a-b902-60cf7fc91331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:30:48.032431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-7e317e8c-9e62-4b2a-b902-60cf7fc91331 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:30:48.032431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:30:48.032431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:30:48.032431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:30:48.032431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:30:48.032431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:30:48.032431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:30:48.032431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:30:48.032431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:30:48.032431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:30:48.032431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:30:48.032431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:30:48.032431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:30:48.032431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:30:48.032431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:30:48.032431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:30:48.033610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:30:48.033610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:30:48.033610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:30:48.033610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:30:48.033610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:30:48.033610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:30:48.033610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:30:48.033610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:30:48.033610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:30:48.033610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:30:48.033610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:30:48.033610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:30:48.033610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:30:48.033610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:30:48.033610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:30:48.033610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:30:48.035077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:30:48.035077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:30:48.035077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:30:48.035077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:30:48.035077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:30:48.035077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:30:48.035077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:30:48.035077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:30:48.035077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:30:48.035077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:30:48.035077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:30:48.035077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:30:48.037545 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 17/32] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:30:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:30:48.038734 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e317e8c-9e62-4b2a-b902-60cf7fc91331 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:48.082083 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:48.088277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 16/33] 10.222.0.58 () {60 vars in 1131 bytes} [Wed Aug 24 09:30:47 2022] POST /identity/v3/roles => generated 219 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:30:48.089490 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07807149-9a64-4d0e-a1b8-2070f4fa0551 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:48.177668 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e317e8c-9e62-4b2a-b902-60cf7fc91331 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:48.221000 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056faf82-018c-476a-be20-4df1256efa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:48.222003 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056faf82-018c-476a-be20-4df1256efa99 None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:48.222424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056faf82-018c-476a-be20-4df1256efa99 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:48.222986 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056faf82-018c-476a-be20-4df1256efa99 None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:48.224105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056faf82-018c-476a-be20-4df1256efa99 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:48.225782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056faf82-018c-476a-be20-4df1256efa99 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:48.328723 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07807149-9a64-4d0e-a1b8-2070f4fa0551 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:48.373651 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd64b8a-6c0a-40cd-987d-1da1f7010d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:48.374291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd64b8a-6c0a-40cd-987d-1da1f7010d3f None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:48.374564 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd64b8a-6c0a-40cd-987d-1da1f7010d3f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:48.374840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd64b8a-6c0a-40cd-987d-1da1f7010d3f None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:48.375508 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd64b8a-6c0a-40cd-987d-1da1f7010d3f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:48.377002 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd64b8a-6c0a-40cd-987d-1da1f7010d3f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:48.395468 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 17/34] 10.222.0.58 () {60 vars in 1131 bytes} [Wed Aug 24 09:30:48 2022] POST /identity/v3/roles => generated 225 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:30:48.396163 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd64b8a-6c0a-40cd-987d-1da1f7010d3f None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:48.417023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 18/35] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 09:30:48 2022] POST /identity/v3/projects => generated 301 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:30:48.418642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa044ae2-907a-4303-a5e0-e1607f832ce2 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:48.418932 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa044ae2-907a-4303-a5e0-e1607f832ce2 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:48.419206 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa044ae2-907a-4303-a5e0-e1607f832ce2 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:48.420681 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 19/36] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:48.427031 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34e858-06eb-453a-b4b3-3586dc90b9af None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:48.427324 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34e858-06eb-453a-b4b3-3586dc90b9af None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:48.427635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34e858-06eb-453a-b4b3-3586dc90b9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:48.470729 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-2c34e858-06eb-453a-b4b3-3586dc90b9af None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:48.474096 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-2c34e858-06eb-453a-b4b3-3586dc90b9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:48.481750 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:48.587918 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd64b8a-6c0a-40cd-987d-1da1f7010d3f None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:48.626886 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 20/37] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:30:48.645284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175b0ea-b476-4095-adee-03634a92507e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:48.646308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175b0ea-b476-4095-adee-03634a92507e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:48.646793 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175b0ea-b476-4095-adee-03634a92507e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:48.647270 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175b0ea-b476-4095-adee-03634a92507e None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:48.648161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175b0ea-b476-4095-adee-03634a92507e None admin] RBAC: Adding query filter params (name=admin) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:30:48.648694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175b0ea-b476-4095-adee-03634a92507e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:48.650324 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175b0ea-b476-4095-adee-03634a92507e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:48.659863 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 18/38] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:30:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:30:48.665760 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34e858-06eb-453a-b4b3-3586dc90b9af None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:48.677662 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:48.711911 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980cb25-1f0c-4855-a6ad-488133e71fdf None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:48.711911 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980cb25-1f0c-4855-a6ad-488133e71fdf None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:48.712432 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980cb25-1f0c-4855-a6ad-488133e71fdf None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:48.713395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 19/39] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:30:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:48.721544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d5112-b624-40f7-9fd9-9c334690bbe1 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:48.721816 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d5112-b624-40f7-9fd9-9c334690bbe1 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:48.722206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d5112-b624-40f7-9fd9-9c334690bbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:48.747944 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-137d5112-b624-40f7-9fd9-9c334690bbe1 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:48.749517 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-137d5112-b624-40f7-9fd9-9c334690bbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:48.801216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34e858-06eb-453a-b4b3-3586dc90b9af None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:48.839685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840f14b-a5cc-4842-baed-caa96d9f736c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:48.840354 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840f14b-a5cc-4842-baed-caa96d9f736c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:48.840638 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840f14b-a5cc-4842-baed-caa96d9f736c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:48.840920 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840f14b-a5cc-4842-baed-caa96d9f736c None admin] PATH_INFO: `/v3/users/4757bd29ffb0448ca0dc35345a8b1469` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:48.842417 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840f14b-a5cc-4842-baed-caa96d9f736c None admin] RBAC: Authorizing `identity:get_user(user_id=4757bd29ffb0448ca0dc35345a8b1469)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:48.844058 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840f14b-a5cc-4842-baed-caa96d9f736c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:48.846009 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 21/40] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:30:48 2022] GET /identity/v3/users/4757bd29ffb0448ca0dc35345a8b1469 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:30:48.852109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840f14b-a5cc-4842-baed-caa96d9f736c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:48.935676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 20/41] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:30:48.936513 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d5112-b624-40f7-9fd9-9c334690bbe1 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:48.939223 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:48.963996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840f14b-a5cc-4842-baed-caa96d9f736c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:48.980410 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:49.001357 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118bcc6-eb79-482d-8738-f84f9983d5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:49.002033 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118bcc6-eb79-482d-8738-f84f9983d5d8 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:49.002315 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118bcc6-eb79-482d-8738-f84f9983d5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:49.002591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118bcc6-eb79-482d-8738-f84f9983d5d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:49.003715 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118bcc6-eb79-482d-8738-f84f9983d5d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:49.005154 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118bcc6-eb79-482d-8738-f84f9983d5d8 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:49.011244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 22/42] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:30:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:30:49.012223 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118bcc6-eb79-482d-8738-f84f9983d5d8 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:49.050287 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d5112-b624-40f7-9fd9-9c334690bbe1 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:49.087107 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d1f3b-a121-43f1-81a7-8a88c821ee2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:49.087949 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d1f3b-a121-43f1-81a7-8a88c821ee2a None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:49.088369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d1f3b-a121-43f1-81a7-8a88c821ee2a None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:49.088788 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d1f3b-a121-43f1-81a7-8a88c821ee2a None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:49.089628 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d1f3b-a121-43f1-81a7-8a88c821ee2a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:49.091167 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d1f3b-a121-43f1-81a7-8a88c821ee2a None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:49.107352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 21/43] 10.222.0.58 () {60 vars in 1131 bytes} [Wed Aug 24 09:30:48 2022] POST /identity/v3/roles => generated 223 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:30:49.123694 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118bcc6-eb79-482d-8738-f84f9983d5d8 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:49.164121 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28249e79-700a-4867-a5b0-aabc9d282347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:49.164967 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28249e79-700a-4867-a5b0-aabc9d282347 None admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:49.165350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28249e79-700a-4867-a5b0-aabc9d282347 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:49.165751 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28249e79-700a-4867-a5b0-aabc9d282347 None admin] PATH_INFO: `/v3/domains/default/users/4757bd29ffb0448ca0dc35345a8b1469/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:49.167893 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28249e79-700a-4867-a5b0-aabc9d282347 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4757bd29ffb0448ca0dc35345a8b1469, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:49.169527 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28249e79-700a-4867-a5b0-aabc9d282347 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:49.193506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 23/44] 10.222.0.58 () {58 vars in 1361 bytes} [Wed Aug 24 09:30:49 2022] PUT /identity/v3/domains/default/users/4757bd29ffb0448ca0dc35345a8b1469/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:30:49.210856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d1f3b-a121-43f1-81a7-8a88c821ee2a None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:49.332705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:49.336957 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d1f3b-a121-43f1-81a7-8a88c821ee2a None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:49.375412 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76873185-9580-4697-9d6e-d1b62b7b76d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:49.376060 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76873185-9580-4697-9d6e-d1b62b7b76d8 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:49.376346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76873185-9580-4697-9d6e-d1b62b7b76d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:49.376791 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76873185-9580-4697-9d6e-d1b62b7b76d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:49.378107 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76873185-9580-4697-9d6e-d1b62b7b76d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:49.379948 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76873185-9580-4697-9d6e-d1b62b7b76d8 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:49.381551 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 22/45] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:30:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:30:49.387259 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28249e79-700a-4867-a5b0-aabc9d282347 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:49.391535 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:49.490235 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28249e79-700a-4867-a5b0-aabc9d282347 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:49.526999 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b62cb-3240-48e2-ad96-c74e04af50f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:49.527998 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b62cb-3240-48e2-ad96-c74e04af50f3 None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:49.528501 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b62cb-3240-48e2-ad96-c74e04af50f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:49.528980 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b62cb-3240-48e2-ad96-c74e04af50f3 None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:49.530191 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b62cb-3240-48e2-ad96-c74e04af50f3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:49.532778 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b62cb-3240-48e2-ad96-c74e04af50f3 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:49.575087 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 09:30:49 2022] POST /identity/v3/projects => generated 312 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:30:51.153616 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e81508-7528-4e05-8e57-91a09be969e7 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:51.154143 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e81508-7528-4e05-8e57-91a09be969e7 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:51.154246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e81508-7528-4e05-8e57-91a09be969e7 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:51.155526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 23/47] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:51.160731 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353976d4-0bf3-46d6-96e3-05add26dc802 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:51.161139 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353976d4-0bf3-46d6-96e3-05add26dc802 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:51.161283 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353976d4-0bf3-46d6-96e3-05add26dc802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:51.179638 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-353976d4-0bf3-46d6-96e3-05add26dc802 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:51.180855 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-353976d4-0bf3-46d6-96e3-05add26dc802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:51.233305 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:51.251738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 25/48] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:30:51.488833 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffb6ab-a565-434d-a123-a5371d6f1a33 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:51.489082 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffb6ab-a565-434d-a123-a5371d6f1a33 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:51.489312 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffb6ab-a565-434d-a123-a5371d6f1a33 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:51.490706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 24/49] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:30:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:51.495970 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f6360-d5a5-4fb7-8a34-b54ffc93e384 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:51.496258 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f6360-d5a5-4fb7-8a34-b54ffc93e384 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:51.496533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f6360-d5a5-4fb7-8a34-b54ffc93e384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:51.514205 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-3f5f6360-d5a5-4fb7-8a34-b54ffc93e384 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:51.515384 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-3f5f6360-d5a5-4fb7-8a34-b54ffc93e384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:51.521273 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffb6ab-a565-434d-a123-a5371d6f1a33 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:51.583107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 26/50] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:30:51.622606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffb6ab-a565-434d-a123-a5371d6f1a33 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:51.656198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7231b-d4c7-42c8-9253-e784e5381b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:51.656820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7231b-d4c7-42c8-9253-e784e5381b71 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:51.657098 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7231b-d4c7-42c8-9253-e784e5381b71 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:51.657371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7231b-d4c7-42c8-9253-e784e5381b71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:51.668030 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7231b-d4c7-42c8-9253-e784e5381b71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:30:51.672758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-4ce7231b-d4c7-42c8-9253-e784e5381b71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:30:51.672758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:30:51.672758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:30:51.672758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:30:51.672758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:30:51.672758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:30:51.672758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:30:51.672758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:30:51.672758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:30:51.672758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:30:51.672758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:30:51.672758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:30:51.672758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:30:51.672758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:30:51.672758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:30:51.672758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:30:51.673814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:30:51.673814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:30:51.673814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:30:51.673814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:30:51.673814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:30:51.673814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:30:51.673814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:30:51.673814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:30:51.673814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:30:51.673814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:30:51.673814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:30:51.673814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:30:51.673814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:30:51.673814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:30:51.673814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:30:51.673814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:30:51.675074 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:30:51.675074 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:30:51.675074 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:30:51.675074 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:30:51.675074 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:30:51.675074 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:30:51.675074 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:30:51.675074 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:30:51.675074 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:30:51.675074 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:30:51.675074 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:30:51.675074 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:30:51.675074 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 25/51] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:30:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:30:51.679700 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f6360-d5a5-4fb7-8a34-b54ffc93e384 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:51.782997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f6360-d5a5-4fb7-8a34-b54ffc93e384 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:51.799391 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:51.817304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c112cb8-201f-4bd2-b707-63da2b84a005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:51.817945 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c112cb8-201f-4bd2-b707-63da2b84a005 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:51.818231 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c112cb8-201f-4bd2-b707-63da2b84a005 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:51.818511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c112cb8-201f-4bd2-b707-63da2b84a005 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:51.819177 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c112cb8-201f-4bd2-b707-63da2b84a005 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:30:51.819487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c112cb8-201f-4bd2-b707-63da2b84a005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:51.820877 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c112cb8-201f-4bd2-b707-63da2b84a005 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:51.833797 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 27/52] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:30:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:30:51.839292 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7231b-d4c7-42c8-9253-e784e5381b71 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:51.855298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c112cb8-201f-4bd2-b707-63da2b84a005 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:51.872470 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:51.949111 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7231b-d4c7-42c8-9253-e784e5381b71 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:51.986821 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484db81c-9e7a-468f-b944-ee464f7c3c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:51.987516 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484db81c-9e7a-468f-b944-ee464f7c3c1d None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:51.987803 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484db81c-9e7a-468f-b944-ee464f7c3c1d None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:51.988081 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484db81c-9e7a-468f-b944-ee464f7c3c1d None admin] PATH_INFO: `/v3/users/4757bd29ffb0448ca0dc35345a8b1469` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:51.989261 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484db81c-9e7a-468f-b944-ee464f7c3c1d None admin] RBAC: Authorizing `identity:get_user(user_id=4757bd29ffb0448ca0dc35345a8b1469)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:51.990753 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484db81c-9e7a-468f-b944-ee464f7c3c1d None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:51.992591 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:30:51 2022] GET /identity/v3/users/4757bd29ffb0448ca0dc35345a8b1469 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:30:51.997988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484db81c-9e7a-468f-b944-ee464f7c3c1d None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:52.060747 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c112cb8-201f-4bd2-b707-63da2b84a005 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:52.091823 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:52.095199 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32ed9c-3e6d-4ec6-a9cf-3a56eb45e68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:52.096011 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32ed9c-3e6d-4ec6-a9cf-3a56eb45e68d None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:52.096298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32ed9c-3e6d-4ec6-a9cf-3a56eb45e68d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:52.096575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32ed9c-3e6d-4ec6-a9cf-3a56eb45e68d None admin] PATH_INFO: `/v3/domains/default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:52.097876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32ed9c-3e6d-4ec6-a9cf-3a56eb45e68d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:52.099293 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484db81c-9e7a-468f-b944-ee464f7c3c1d None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:52.099399 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32ed9c-3e6d-4ec6-a9cf-3a56eb45e68d None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:52.100907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 28/54] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:30:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:30:52.106599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32ed9c-3e6d-4ec6-a9cf-3a56eb45e68d None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:52.137644 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc606e55-525e-4589-a45b-003334ad87bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:52.138275 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc606e55-525e-4589-a45b-003334ad87bf None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:52.138554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc606e55-525e-4589-a45b-003334ad87bf None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:52.138830 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc606e55-525e-4589-a45b-003334ad87bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:52.139961 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc606e55-525e-4589-a45b-003334ad87bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:52.141390 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc606e55-525e-4589-a45b-003334ad87bf None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:52.142987 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:30:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:30:52.149203 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc606e55-525e-4589-a45b-003334ad87bf None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:52.155197 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:52.210305 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32ed9c-3e6d-4ec6-a9cf-3a56eb45e68d None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:52.245306 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc545b71-f020-48f4-985c-df7273089a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:52.245958 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc545b71-f020-48f4-985c-df7273089a47 None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:52.246244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc545b71-f020-48f4-985c-df7273089a47 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:52.246526 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc545b71-f020-48f4-985c-df7273089a47 None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:52.247180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc545b71-f020-48f4-985c-df7273089a47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:52.248621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc545b71-f020-48f4-985c-df7273089a47 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:52.253091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc606e55-525e-4589-a45b-003334ad87bf None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:52.276682 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 29/56] 10.222.0.58 () {60 vars in 1140 bytes} [Wed Aug 24 09:30:52 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:30:52.288447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd66ced-531d-4f35-8d64-e375e62d7fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:52.289108 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd66ced-531d-4f35-8d64-e375e62d7fe2 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:52.289396 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd66ced-531d-4f35-8d64-e375e62d7fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:52.289693 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd66ced-531d-4f35-8d64-e375e62d7fe2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:52.290447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd66ced-531d-4f35-8d64-e375e62d7fe2 None admin] RBAC: Adding query filter params (role.id=cd2effe8340d4be08a28d3a40db6979d, scope.domain.id=default, user.id=4757bd29ffb0448ca0dc35345a8b1469) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:30:52.290757 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd66ced-531d-4f35-8d64-e375e62d7fe2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:52.292237 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd66ced-531d-4f35-8d64-e375e62d7fe2 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:52.298932 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 28/57] 10.222.0.58 () {56 vars in 1322 bytes} [Wed Aug 24 09:30:52 2022] GET /identity/v3/role_assignments?user.id=4757bd29ffb0448ca0dc35345a8b1469&scope.domain.id=default&role.id=cd2effe8340d4be08a28d3a40db6979d => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:30:54.241850 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e96bb-6f1c-4d81-9d90-ce156ae6fa97 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:54.242291 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e96bb-6f1c-4d81-9d90-ce156ae6fa97 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:54.242414 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e96bb-6f1c-4d81-9d90-ce156ae6fa97 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:54.243765 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 30/58] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:54.249153 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b3f4a-c921-47d0-b8bb-98738c9a9f84 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:54.249611 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b3f4a-c921-47d0-b8bb-98738c9a9f84 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:54.249735 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b3f4a-c921-47d0-b8bb-98738c9a9f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:54.267309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-716b3f4a-c921-47d0-b8bb-98738c9a9f84 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:54.268485 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-716b3f4a-c921-47d0-b8bb-98738c9a9f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:54.289507 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:54.335839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 29/59] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:30:54.617655 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e96bb-6f1c-4d81-9d90-ce156ae6fa97 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:54.726360 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:54.733276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e96bb-6f1c-4d81-9d90-ce156ae6fa97 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:54.771369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1b984-0ab5-4255-be51-3ee9662b1239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:54.772379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1b984-0ab5-4255-be51-3ee9662b1239 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:54.772875 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1b984-0ab5-4255-be51-3ee9662b1239 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:54.773359 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1b984-0ab5-4255-be51-3ee9662b1239 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:54.775199 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1b984-0ab5-4255-be51-3ee9662b1239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:54.777423 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1b984-0ab5-4255-be51-3ee9662b1239 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:54.780429 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 31/60] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:30:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:30:54.788025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b3f4a-c921-47d0-b8bb-98738c9a9f84 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:54.904220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b3f4a-c921-47d0-b8bb-98738c9a9f84 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:54.939846 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bf982-3f86-4e13-b232-95d64347ed22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:54.940464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bf982-3f86-4e13-b232-95d64347ed22 None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:54.940881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bf982-3f86-4e13-b232-95d64347ed22 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:54.941166 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bf982-3f86-4e13-b232-95d64347ed22 None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:54.941851 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bf982-3f86-4e13-b232-95d64347ed22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:54.943305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bf982-3f86-4e13-b232-95d64347ed22 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:54.974274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 30/61] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 09:30:54 2022] POST /identity/v3/users => generated 275 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:30:57.990681 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3318d9-2fb5-480c-a701-11dc15f5de4e None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:57.991201 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3318d9-2fb5-480c-a701-11dc15f5de4e None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:57.991201 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3318d9-2fb5-480c-a701-11dc15f5de4e None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:57.992846 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 32/62] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:58.006360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59848d31-f8f6-425b-9de2-d5a153168772 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:58.006838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59848d31-f8f6-425b-9de2-d5a153168772 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:58.006912 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59848d31-f8f6-425b-9de2-d5a153168772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:58.030438 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-59848d31-f8f6-425b-9de2-d5a153168772 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:58.031956 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-59848d31-f8f6-425b-9de2-d5a153168772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:58.041007 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:58.106680 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbbae5-7024-473f-8f9d-3177397adfc6 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:58.107335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbbae5-7024-473f-8f9d-3177397adfc6 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:58.107810 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbbae5-7024-473f-8f9d-3177397adfc6 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:58.109698 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 33/63] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:30:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:58.123497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30d89e-f98d-4220-ac02-dd8e660ff7b1 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:58.123654 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 31/64] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:30:58.124172 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30d89e-f98d-4220-ac02-dd8e660ff7b1 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:58.124682 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30d89e-f98d-4220-ac02-dd8e660ff7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:58.155507 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-bf30d89e-f98d-4220-ac02-dd8e660ff7b1 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:58.157045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-bf30d89e-f98d-4220-ac02-dd8e660ff7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:58.256846 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 34/65] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:30:58.420418 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7edd7b-a5c8-461d-8298-1f43fb2f37f2 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:58.421091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7edd7b-a5c8-461d-8298-1f43fb2f37f2 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:58.421619 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7edd7b-a5c8-461d-8298-1f43fb2f37f2 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:58.423180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 32/66] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:30:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:58.428716 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a424ba-d9c0-47c3-ac1b-0e24f09fd324 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:58.429267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a424ba-d9c0-47c3-ac1b-0e24f09fd324 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:58.429790 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a424ba-d9c0-47c3-ac1b-0e24f09fd324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:58.448854 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-19a424ba-d9c0-47c3-ac1b-0e24f09fd324 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:58.450407 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-19a424ba-d9c0-47c3-ac1b-0e24f09fd324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:58.481876 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7edd7b-a5c8-461d-8298-1f43fb2f37f2 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:58.551522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 35/67] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:30:58.592852 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e71fb-d536-4fa6-9b9a-46ee9c7e2367 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:58.593498 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e71fb-d536-4fa6-9b9a-46ee9c7e2367 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:58.593975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e71fb-d536-4fa6-9b9a-46ee9c7e2367 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:58.595528 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 36/68] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:30:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:30:58.601340 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260401b3-a75f-4c90-a219-3f9c6d110718 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:58.601928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260401b3-a75f-4c90-a219-3f9c6d110718 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:58.602461 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260401b3-a75f-4c90-a219-3f9c6d110718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:58.621767 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-260401b3-a75f-4c90-a219-3f9c6d110718 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:58.623303 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-260401b3-a75f-4c90-a219-3f9c6d110718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:58.640701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7edd7b-a5c8-461d-8298-1f43fb2f37f2 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:58.647701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:58.681216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4d8a9-fe18-46d8-bb2d-44aab918a80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:58.682160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4d8a9-fe18-46d8-bb2d-44aab918a80b None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:58.682581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4d8a9-fe18-46d8-bb2d-44aab918a80b None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:58.683191 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4d8a9-fe18-46d8-bb2d-44aab918a80b None admin] PATH_INFO: `/v3/roles/member` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:58.695573 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4d8a9-fe18-46d8-bb2d-44aab918a80b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:30:58.700694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-72c4d8a9-fe18-46d8-bb2d-44aab918a80b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:30:58.700694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:30:58.700694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:30:58.700694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:30:58.700694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:30:58.700694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:30:58.700694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:30:58.700694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:30:58.700694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:30:58.700694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:30:58.700694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:30:58.700694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:30:58.700694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:30:58.700694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:30:58.700694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:30:58.700694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:30:58.701553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:30:58.701553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:30:58.701553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:30:58.701553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:30:58.701553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:30:58.701553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:30:58.701553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:30:58.701553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:30:58.701553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:30:58.701553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:30:58.701553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:30:58.701553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:30:58.701553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:30:58.701553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:30:58.701553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:30:58.701553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:30:58.702380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:30:58.702380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:30:58.702380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:30:58.702380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:30:58.702380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:30:58.702380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:30:58.702380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:30:58.702380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:30:58.702380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:30:58.702380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:30:58.702380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:30:58.702380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:30:58.703096 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 37/69] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:30:58.703096 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260401b3-a75f-4c90-a219-3f9c6d110718 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:58.704393 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 33/70] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:30:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:30:58.713176 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4d8a9-fe18-46d8-bb2d-44aab918a80b None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:58.720077 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:58.854642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4d8a9-fe18-46d8-bb2d-44aab918a80b None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:58.865234 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260401b3-a75f-4c90-a219-3f9c6d110718 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:58.894772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04c009-5d0a-4946-ac99-9e1cd144d5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:58.895653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04c009-5d0a-4946-ac99-9e1cd144d5f3 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:58.896082 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04c009-5d0a-4946-ac99-9e1cd144d5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:58.896503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04c009-5d0a-4946-ac99-9e1cd144d5f3 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:58.897318 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04c009-5d0a-4946-ac99-9e1cd144d5f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:30:58.897800 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04c009-5d0a-4946-ac99-9e1cd144d5f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:58.899342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04c009-5d0a-4946-ac99-9e1cd144d5f3 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:58.908080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 34/71] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:30:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:30:58.909131 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04c009-5d0a-4946-ac99-9e1cd144d5f3 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:58.910801 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6ec90-09c2-441f-99d1-01c7e82740d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:58.911519 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6ec90-09c2-441f-99d1-01c7e82740d0 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:58.911805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6ec90-09c2-441f-99d1-01c7e82740d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:58.912079 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6ec90-09c2-441f-99d1-01c7e82740d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:58.923147 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6ec90-09c2-441f-99d1-01c7e82740d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:30:58.928645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-26f6ec90-09c2-441f-99d1-01c7e82740d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:30:58.928645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:30:58.928645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:30:58.928645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:30:58.928645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:30:58.928645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:30:58.928645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:30:58.928645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:30:58.928645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:30:58.928645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:30:58.928645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:30:58.928645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:30:58.928645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:30:58.928645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:30:58.928645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:30:58.928645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:30:58.929450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:30:58.929450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:30:58.929450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:30:58.929450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:30:58.929450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:30:58.929450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:30:58.929450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:30:58.929450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:30:58.929450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:30:58.929450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:30:58.929450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:30:58.929450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:30:58.929450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:30:58.929450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:30:58.929450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:30:58.929450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:30:58.930213 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:30:58.930213 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:30:58.930213 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:30:58.930213 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:30:58.930213 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:30:58.930213 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:30:58.930213 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:30:58.930213 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:30:58.930213 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:30:58.930213 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:30:58.930213 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:30:58.930213 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:30:58.932503 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 38/72] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:30:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:30:58.934453 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32551a-f4df-486f-b060-1334cba969ba None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:58.934739 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32551a-f4df-486f-b060-1334cba969ba None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:58.935014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32551a-f4df-486f-b060-1334cba969ba None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:58.936240 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 39/73] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:30:58.941109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32551a-f4df-486f-b060-1334cba969ba None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:58.958938 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:58.980800 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:59.023593 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04c009-5d0a-4946-ac99-9e1cd144d5f3 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:59.051787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32551a-f4df-486f-b060-1334cba969ba None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:59.057787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2cc50-460b-4c3c-8be2-1670a18e9123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:59.058500 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2cc50-460b-4c3c-8be2-1670a18e9123 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:59.058785 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2cc50-460b-4c3c-8be2-1670a18e9123 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:59.059064 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2cc50-460b-4c3c-8be2-1670a18e9123 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:59.069737 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2cc50-460b-4c3c-8be2-1670a18e9123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:30:59.075692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-d2b2cc50-460b-4c3c-8be2-1670a18e9123 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:30:59.075692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:30:59.075692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:30:59.075692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:30:59.075692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:30:59.075692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:30:59.075692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:30:59.075692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:30:59.075692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:30:59.075692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:30:59.075692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:30:59.075692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:30:59.075692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:30:59.075692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:30:59.075692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:30:59.075692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:30:59.076576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:30:59.076576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:30:59.076576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:30:59.076576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:30:59.076576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:30:59.076576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:30:59.076576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:30:59.076576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:30:59.076576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:30:59.076576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:30:59.076576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:30:59.076576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:30:59.076576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:30:59.076576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:30:59.076576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:30:59.076576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:30:59.077352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:30:59.077352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:30:59.077352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:30:59.077352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:30:59.077352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:30:59.077352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:30:59.077352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:30:59.077352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:30:59.077352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:30:59.077352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:30:59.077352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:30:59.077352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:30:59.077352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 35/74] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 09:30:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:30:59.078014 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2cc50-460b-4c3c-8be2-1670a18e9123 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:59.090197 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc681d8-6257-4e4b-bc1a-29aa38b76a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:59.090829 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc681d8-6257-4e4b-bc1a-29aa38b76a6a None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:59.091150 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc681d8-6257-4e4b-bc1a-29aa38b76a6a None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:59.091473 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc681d8-6257-4e4b-bc1a-29aa38b76a6a None admin] PATH_INFO: `/v3/users/293b91ba2e5e4247b3d8b1a013fc2242` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:59.107326 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc681d8-6257-4e4b-bc1a-29aa38b76a6a None admin] RBAC: Authorizing `identity:get_user(user_id=293b91ba2e5e4247b3d8b1a013fc2242)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:59.108711 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc681d8-6257-4e4b-bc1a-29aa38b76a6a None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:59.110495 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 40/75] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:30:58 2022] GET /identity/v3/users/293b91ba2e5e4247b3d8b1a013fc2242 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:30:59.111619 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203348e-e490-48d6-a17f-ae14f863c421 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:59.111901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203348e-e490-48d6-a17f-ae14f863c421 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:59.112175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203348e-e490-48d6-a17f-ae14f863c421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:59.130363 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-e203348e-e490-48d6-a17f-ae14f863c421 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:30:59.131547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e203348e-e490-48d6-a17f-ae14f863c421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:30:59.179783 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2cc50-460b-4c3c-8be2-1670a18e9123 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:59.198684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 41/76] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:30:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:30:59.199525 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203348e-e490-48d6-a17f-ae14f863c421 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:59.205177 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:59.217449 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31f26d-056e-4784-adc7-85f793fec7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:59.218093 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31f26d-056e-4784-adc7-85f793fec7d2 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:59.218382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31f26d-056e-4784-adc7-85f793fec7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:59.218654 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31f26d-056e-4784-adc7-85f793fec7d2 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:59.219314 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31f26d-056e-4784-adc7-85f793fec7d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:30:59.219618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31f26d-056e-4784-adc7-85f793fec7d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:59.220079 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:59.220998 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31f26d-056e-4784-adc7-85f793fec7d2 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:59.231442 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 36/77] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:30:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:30:59.232200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31f26d-056e-4784-adc7-85f793fec7d2 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:59.311069 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203348e-e490-48d6-a17f-ae14f863c421 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:59.346023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115ac81-6b9a-4c90-9f25-93497baa4e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:59.346726 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115ac81-6b9a-4c90-9f25-93497baa4e40 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:59.347185 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115ac81-6b9a-4c90-9f25-93497baa4e40 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:59.347318 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31f26d-056e-4784-adc7-85f793fec7d2 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:59.347624 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115ac81-6b9a-4c90-9f25-93497baa4e40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:59.358626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115ac81-6b9a-4c90-9f25-93497baa4e40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:30:59.364016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-8115ac81-6b9a-4c90-9f25-93497baa4e40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:30:59.364016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:30:59.364016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:30:59.364016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:30:59.364016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:30:59.364016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:30:59.364016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:30:59.364016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:30:59.364016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:30:59.364016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:30:59.364016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:30:59.364016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:30:59.364016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:30:59.364016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:30:59.364016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:30:59.364016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:30:59.364843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:30:59.364843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:30:59.364843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:30:59.364843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:30:59.364843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:30:59.364843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:30:59.364843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:30:59.364843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:30:59.364843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:30:59.364843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:30:59.364843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:30:59.364843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:30:59.364843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:30:59.364843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:30:59.364843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:30:59.364843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:30:59.365621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:30:59.365621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:30:59.365621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:30:59.365621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:30:59.365621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:30:59.365621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:30:59.365621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:30:59.365621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:30:59.365621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:30:59.365621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:30:59.365621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:30:59.365621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:30:59.365621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 42/78] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:30:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:30:59.366363 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115ac81-6b9a-4c90-9f25-93497baa4e40 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:59.389985 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741da3b4-5787-4fe9-b032-1e7a0eef4e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:59.391027 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741da3b4-5787-4fe9-b032-1e7a0eef4e86 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:59.391509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741da3b4-5787-4fe9-b032-1e7a0eef4e86 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:59.391985 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741da3b4-5787-4fe9-b032-1e7a0eef4e86 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:59.392874 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741da3b4-5787-4fe9-b032-1e7a0eef4e86 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:30:59.393411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741da3b4-5787-4fe9-b032-1e7a0eef4e86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:59.395372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741da3b4-5787-4fe9-b032-1e7a0eef4e86 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:59.404515 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 37/79] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:30:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:30:59.405550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741da3b4-5787-4fe9-b032-1e7a0eef4e86 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:59.435847 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:59.461627 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:59.479282 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115ac81-6b9a-4c90-9f25-93497baa4e40 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:59.515192 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074d5a6-68fa-42fc-904e-33ecc63f86a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:59.515802 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074d5a6-68fa-42fc-904e-33ecc63f86a9 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:59.516086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074d5a6-68fa-42fc-904e-33ecc63f86a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:59.516364 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074d5a6-68fa-42fc-904e-33ecc63f86a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:59.517681 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741da3b4-5787-4fe9-b032-1e7a0eef4e86 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:59.552028 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c003a-dda2-49b3-b5c0-8a10c75f3a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:59.552655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c003a-dda2-49b3-b5c0-8a10c75f3a96 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:59.552940 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c003a-dda2-49b3-b5c0-8a10c75f3a96 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:59.553220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c003a-dda2-49b3-b5c0-8a10c75f3a96 None admin] PATH_INFO: `/v3/users/4757bd29ffb0448ca0dc35345a8b1469` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:59.554403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c003a-dda2-49b3-b5c0-8a10c75f3a96 None admin] RBAC: Authorizing `identity:get_user(user_id=4757bd29ffb0448ca0dc35345a8b1469)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:59.555841 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c003a-dda2-49b3-b5c0-8a10c75f3a96 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:59.557422 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 38/80] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:30:59 2022] GET /identity/v3/users/4757bd29ffb0448ca0dc35345a8b1469 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:30:59.558217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c003a-dda2-49b3-b5c0-8a10c75f3a96 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:59.589135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074d5a6-68fa-42fc-904e-33ecc63f86a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:59.591412 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074d5a6-68fa-42fc-904e-33ecc63f86a9 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:59.653893 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:59.663221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c003a-dda2-49b3-b5c0-8a10c75f3a96 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:59.679837 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:59.691874 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 43/81] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:30:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:59.697486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074d5a6-68fa-42fc-904e-33ecc63f86a9 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:59.699690 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f21908-5bc2-438c-84f9-bda88ed76309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:59.700302 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f21908-5bc2-438c-84f9-bda88ed76309 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:59.700588 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f21908-5bc2-438c-84f9-bda88ed76309 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:59.700862 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f21908-5bc2-438c-84f9-bda88ed76309 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:59.701557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f21908-5bc2-438c-84f9-bda88ed76309 None admin] RBAC: Adding query filter params (name=member) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:30:59.701863 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f21908-5bc2-438c-84f9-bda88ed76309 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:59.703232 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f21908-5bc2-438c-84f9-bda88ed76309 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:59.712248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 39/82] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:30:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:30:59.713031 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f21908-5bc2-438c-84f9-bda88ed76309 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:59.801937 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074d5a6-68fa-42fc-904e-33ecc63f86a9 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:59.814821 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f21908-5bc2-438c-84f9-bda88ed76309 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:59.835906 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd6eee-bb5c-41f6-9cae-d69b465b0a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:59.836533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd6eee-bb5c-41f6-9cae-d69b465b0a71 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:59.836881 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd6eee-bb5c-41f6-9cae-d69b465b0a71 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:59.837161 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd6eee-bb5c-41f6-9cae-d69b465b0a71 None admin] PATH_INFO: `/v3/users/293b91ba2e5e4247b3d8b1a013fc2242` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:59.838320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd6eee-bb5c-41f6-9cae-d69b465b0a71 None admin] RBAC: Authorizing `identity:get_user(user_id=293b91ba2e5e4247b3d8b1a013fc2242)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:59.839794 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd6eee-bb5c-41f6-9cae-d69b465b0a71 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:59.841373 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 44/83] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:30:59 2022] GET /identity/v3/users/293b91ba2e5e4247b3d8b1a013fc2242 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:30:59.842169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd6eee-bb5c-41f6-9cae-d69b465b0a71 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:59.849330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7399b84-4ad8-477b-b773-eab6a18a0f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:59.850000 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7399b84-4ad8-477b-b773-eab6a18a0f5e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:59.850287 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7399b84-4ad8-477b-b773-eab6a18a0f5e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:59.850570 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7399b84-4ad8-477b-b773-eab6a18a0f5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:59.851724 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7399b84-4ad8-477b-b773-eab6a18a0f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:59.853169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7399b84-4ad8-477b-b773-eab6a18a0f5e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:30:59.854784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 40/84] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:30:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:30:59.855539 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7399b84-4ad8-477b-b773-eab6a18a0f5e None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:30:59.875686 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:59.904655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:59.945408 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd6eee-bb5c-41f6-9cae-d69b465b0a71 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:59.960916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7399b84-4ad8-477b-b773-eab6a18a0f5e None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:30:59.979451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d748e-ea83-4c53-b862-abce791b8c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:59.980065 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d748e-ea83-4c53-b862-abce791b8c09 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:59.980351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d748e-ea83-4c53-b862-abce791b8c09 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:59.980632 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d748e-ea83-4c53-b862-abce791b8c09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:59.995141 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d4024-a07a-4639-bc0a-b6a8631f5994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:30:59.995771 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d4024-a07a-4639-bc0a-b6a8631f5994 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:30:59.996067 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d4024-a07a-4639-bc0a-b6a8631f5994 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:30:59.996349 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d4024-a07a-4639-bc0a-b6a8631f5994 None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:30:59.997536 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d4024-a07a-4639-bc0a-b6a8631f5994 None admin] RBAC: Authorizing `identity:get_project(project_id=92dea89f3bc4436195a8b5f4a64fd785)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:30:59.999029 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d4024-a07a-4639-bc0a-b6a8631f5994 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:00.000685 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 41/85] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:30:59 2022] GET /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:00.001447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d4024-a07a-4639-bc0a-b6a8631f5994 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:00.049425 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d748e-ea83-4c53-b862-abce791b8c09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:00.051039 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d748e-ea83-4c53-b862-abce791b8c09 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:00.079662 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:00.102405 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d4024-a07a-4639-bc0a-b6a8631f5994 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:00.116142 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:00.138876 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b99a1-c293-4bc8-89c1-43179a766c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:00.139507 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b99a1-c293-4bc8-89c1-43179a766c8a None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:00.139794 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b99a1-c293-4bc8-89c1-43179a766c8a None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:00.140077 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b99a1-c293-4bc8-89c1-43179a766c8a None admin] PATH_INFO: `/v3/users/293b91ba2e5e4247b3d8b1a013fc2242` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:00.141230 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b99a1-c293-4bc8-89c1-43179a766c8a None admin] RBAC: Authorizing `identity:get_user(user_id=293b91ba2e5e4247b3d8b1a013fc2242)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:00.142705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b99a1-c293-4bc8-89c1-43179a766c8a None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:00.144825 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 42/86] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:00 2022] GET /identity/v3/users/293b91ba2e5e4247b3d8b1a013fc2242 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:00.145621 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b99a1-c293-4bc8-89c1-43179a766c8a None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:00.151793 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 45/87] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:30:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:00.152642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d748e-ea83-4c53-b862-abce791b8c09 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:00.248194 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b99a1-c293-4bc8-89c1-43179a766c8a None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:00.251200 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d748e-ea83-4c53-b862-abce791b8c09 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:00.281603 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:00.282436 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8d292-6b0a-4190-ae75-4fb4271bf740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:00.283247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8d292-6b0a-4190-ae75-4fb4271bf740 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:00.283565 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8d292-6b0a-4190-ae75-4fb4271bf740 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:00.283848 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8d292-6b0a-4190-ae75-4fb4271bf740 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:00.287554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96cb111-ccde-4f25-b4c5-25cfa6688954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:00.288161 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cb111-ccde-4f25-b4c5-25cfa6688954 None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:00.288438 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cb111-ccde-4f25-b4c5-25cfa6688954 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:00.288708 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cb111-ccde-4f25-b4c5-25cfa6688954 None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:00.289355 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96cb111-ccde-4f25-b4c5-25cfa6688954 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:00.290824 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96cb111-ccde-4f25-b4c5-25cfa6688954 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:00.318030 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 46/88] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 09:31:00 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:31:00.318845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96cb111-ccde-4f25-b4c5-25cfa6688954 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:00.339102 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:00.364756 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8d292-6b0a-4190-ae75-4fb4271bf740 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:00.366422 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8d292-6b0a-4190-ae75-4fb4271bf740 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:00.443410 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96cb111-ccde-4f25-b4c5-25cfa6688954 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:00.482930 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 43/89] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:00.484043 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8d292-6b0a-4190-ae75-4fb4271bf740 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:00.492558 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54afaa5-b7e1-4081-9845-0e0f2eb13c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:00.492741 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54afaa5-b7e1-4081-9845-0e0f2eb13c5b None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:00.492941 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54afaa5-b7e1-4081-9845-0e0f2eb13c5b None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:00.493221 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54afaa5-b7e1-4081-9845-0e0f2eb13c5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:00.494332 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54afaa5-b7e1-4081-9845-0e0f2eb13c5b None admin] RBAC: Adding query filter params (role.id=ec487838eecf4dc4bde1eaa59af3eb26, scope.project.id=92dea89f3bc4436195a8b5f4a64fd785, user.id=293b91ba2e5e4247b3d8b1a013fc2242) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:00.494332 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54afaa5-b7e1-4081-9845-0e0f2eb13c5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:00.495739 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54afaa5-b7e1-4081-9845-0e0f2eb13c5b None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:00.504123 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 47/90] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:31:00 2022] GET /identity/v3/role_assignments?user.id=293b91ba2e5e4247b3d8b1a013fc2242&scope.project.id=92dea89f3bc4436195a8b5f4a64fd785&role.id=ec487838eecf4dc4bde1eaa59af3eb26 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:00.504970 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54afaa5-b7e1-4081-9845-0e0f2eb13c5b None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:00.578611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:00.597917 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:00.623702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8d292-6b0a-4190-ae75-4fb4271bf740 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:00.644695 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54afaa5-b7e1-4081-9845-0e0f2eb13c5b None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:00.680099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e54ad-d855-4ee3-9f59-1d6fd3b23fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:00.681964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e54ad-d855-4ee3-9f59-1d6fd3b23fbd None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:00.682257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e54ad-d855-4ee3-9f59-1d6fd3b23fbd None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:00.682539 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e54ad-d855-4ee3-9f59-1d6fd3b23fbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:00.696599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6dc55-df98-479c-9899-b285fdca3476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:00.697249 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6dc55-df98-479c-9899-b285fdca3476 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:00.697674 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6dc55-df98-479c-9899-b285fdca3476 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:00.697964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6dc55-df98-479c-9899-b285fdca3476 None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:00.699134 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6dc55-df98-479c-9899-b285fdca3476 None admin] RBAC: Authorizing `identity:get_project(project_id=92dea89f3bc4436195a8b5f4a64fd785)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:00.700619 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6dc55-df98-479c-9899-b285fdca3476 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:00.703417 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 48/91] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:00 2022] GET /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:00.704202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6dc55-df98-479c-9899-b285fdca3476 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:00.792685 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e54ad-d855-4ee3-9f59-1d6fd3b23fbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:00.794393 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e54ad-d855-4ee3-9f59-1d6fd3b23fbd None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:00.839533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6dc55-df98-479c-9899-b285fdca3476 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:00.863856 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:00.880857 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42715e-d6a3-4387-b019-509581682ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:00.881523 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42715e-d6a3-4387-b019-509581682ee2 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:00.881815 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42715e-d6a3-4387-b019-509581682ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:00.882101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42715e-d6a3-4387-b019-509581682ee2 None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:00.883250 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42715e-d6a3-4387-b019-509581682ee2 None admin] RBAC: Authorizing `identity:get_project(project_id=92dea89f3bc4436195a8b5f4a64fd785)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:00.884944 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42715e-d6a3-4387-b019-509581682ee2 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:00.886805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 49/92] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:00 2022] GET /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:00.887482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42715e-d6a3-4387-b019-509581682ee2 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:00.902228 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:00.923144 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 44/93] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:00.923998 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e54ad-d855-4ee3-9f59-1d6fd3b23fbd None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:01.002759 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42715e-d6a3-4387-b019-509581682ee2 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:01.041325 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9a763-1a45-455a-9323-185b27bf9150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:01.041969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9a763-1a45-455a-9323-185b27bf9150 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:01.042252 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9a763-1a45-455a-9323-185b27bf9150 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:01.042530 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9a763-1a45-455a-9323-185b27bf9150 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:01.043326 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9a763-1a45-455a-9323-185b27bf9150 None admin] RBAC: Adding query filter params (role.id=cd2effe8340d4be08a28d3a40db6979d, scope.project.id=92dea89f3bc4436195a8b5f4a64fd785, user.id=4757bd29ffb0448ca0dc35345a8b1469) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:01.043578 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9a763-1a45-455a-9323-185b27bf9150 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:01.045150 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9a763-1a45-455a-9323-185b27bf9150 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:01.052266 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 50/94] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:31:00 2022] GET /identity/v3/role_assignments?user.id=4757bd29ffb0448ca0dc35345a8b1469&scope.project.id=92dea89f3bc4436195a8b5f4a64fd785&role.id=cd2effe8340d4be08a28d3a40db6979d => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:01.053083 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9a763-1a45-455a-9323-185b27bf9150 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:01.084913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e54ad-d855-4ee3-9f59-1d6fd3b23fbd None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:01.115744 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:01.162269 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb11d3-9640-4cc7-a9a7-c68ab3a0c6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:01.162958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb11d3-9640-4cc7-a9a7-c68ab3a0c6f9 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:01.163181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb11d3-9640-4cc7-a9a7-c68ab3a0c6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:01.163465 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb11d3-9640-4cc7-a9a7-c68ab3a0c6f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:01.164215 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb11d3-9640-4cc7-a9a7-c68ab3a0c6f9 None admin] RBAC: Adding query filter params (role.id=6c6a208f837c453cb9aceca635451134, scope.project.id=92dea89f3bc4436195a8b5f4a64fd785, user.id=293b91ba2e5e4247b3d8b1a013fc2242) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:01.164533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb11d3-9640-4cc7-a9a7-c68ab3a0c6f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:01.166064 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb11d3-9640-4cc7-a9a7-c68ab3a0c6f9 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:01.181027 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 45/95] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:31:00 2022] GET /identity/v3/role_assignments?user.id=293b91ba2e5e4247b3d8b1a013fc2242&scope.project.id=92dea89f3bc4436195a8b5f4a64fd785&role.id=6c6a208f837c453cb9aceca635451134 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:01.217894 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9a763-1a45-455a-9323-185b27bf9150 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:01.306441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0f817-72bb-4690-9612-0913c5d882ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:01.307030 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0f817-72bb-4690-9612-0913c5d882ae None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:01.307319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0f817-72bb-4690-9612-0913c5d882ae None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:01.307602 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0f817-72bb-4690-9612-0913c5d882ae None admin] PATH_INFO: `/v3/projects/594d9be8305242cfb9399197c7df612d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:01.308877 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0f817-72bb-4690-9612-0913c5d882ae None admin] RBAC: Authorizing `identity:get_project(project_id=594d9be8305242cfb9399197c7df612d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:01.310378 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0f817-72bb-4690-9612-0913c5d882ae None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:01.312217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 51/96] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:01 2022] GET /identity/v3/projects/594d9be8305242cfb9399197c7df612d => generated 312 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:01.317989 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb11d3-9640-4cc7-a9a7-c68ab3a0c6f9 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:01.382731 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:01.449316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb11d3-9640-4cc7-a9a7-c68ab3a0c6f9 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:01.487476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d80cce-0a2e-4ede-bec8-1f23b7ec8048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:01.488353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d80cce-0a2e-4ede-bec8-1f23b7ec8048 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:01.488639 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d80cce-0a2e-4ede-bec8-1f23b7ec8048 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:01.488918 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d80cce-0a2e-4ede-bec8-1f23b7ec8048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:01.489694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d80cce-0a2e-4ede-bec8-1f23b7ec8048 None admin] RBAC: Adding query filter params (role.id=ec487838eecf4dc4bde1eaa59af3eb26, scope.project.id=594d9be8305242cfb9399197c7df612d, user.id=293b91ba2e5e4247b3d8b1a013fc2242) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:01.490013 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d80cce-0a2e-4ede-bec8-1f23b7ec8048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:01.491461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d80cce-0a2e-4ede-bec8-1f23b7ec8048 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:01.497522 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 46/97] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:31:01 2022] GET /identity/v3/role_assignments?user.id=293b91ba2e5e4247b3d8b1a013fc2242&scope.project.id=594d9be8305242cfb9399197c7df612d&role.id=ec487838eecf4dc4bde1eaa59af3eb26 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:03.006799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ab050-ce7f-4e39-a21f-01b1864d06cd None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:03.007880 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ab050-ce7f-4e39-a21f-01b1864d06cd None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:03.008371 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ab050-ce7f-4e39-a21f-01b1864d06cd None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:03.009996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 52/98] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:03.015966 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bf2f7-8dab-4a4a-aea0-9bc4a4ccb76e None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:03.016812 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bf2f7-8dab-4a4a-aea0-9bc4a4ccb76e None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:03.017293 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bf2f7-8dab-4a4a-aea0-9bc4a4ccb76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:03.050511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-8b2bf2f7-8dab-4a4a-aea0-9bc4a4ccb76e None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:03.052093 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-8b2bf2f7-8dab-4a4a-aea0-9bc4a4ccb76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:03.140970 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 47/99] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:03.207427 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62329ce-2f85-4812-960b-61375211a5d7 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:03.208214 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62329ce-2f85-4812-960b-61375211a5d7 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:03.208732 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62329ce-2f85-4812-960b-61375211a5d7 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:03.210325 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 53/100] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:03.215870 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad507f0b-d186-4da2-9970-76fe2737e4b4 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:03.216466 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad507f0b-d186-4da2-9970-76fe2737e4b4 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:03.216949 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad507f0b-d186-4da2-9970-76fe2737e4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:03.242536 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-ad507f0b-d186-4da2-9970-76fe2737e4b4 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:03.243775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-ad507f0b-d186-4da2-9970-76fe2737e4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:03.290348 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:03.333024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 48/101] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:03.505808 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a97587-b175-4b9c-9bcf-ad1af4b61653 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:03.506133 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a97587-b175-4b9c-9bcf-ad1af4b61653 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:03.506380 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a97587-b175-4b9c-9bcf-ad1af4b61653 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:03.507991 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 54/102] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:03.513309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb0c3a-c930-4bba-b73a-ac6914c1ab4c None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:03.513621 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb0c3a-c930-4bba-b73a-ac6914c1ab4c None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:03.514126 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb0c3a-c930-4bba-b73a-ac6914c1ab4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:03.540084 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-8dfb0c3a-c930-4bba-b73a-ac6914c1ab4c None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:03.541727 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-8dfb0c3a-c930-4bba-b73a-ac6914c1ab4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:03.591102 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a97587-b175-4b9c-9bcf-ad1af4b61653 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:03.617044 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 49/103] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:03.738904 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a97587-b175-4b9c-9bcf-ad1af4b61653 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:03.759989 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:03.774492 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59faf0-f882-4811-9350-61b55383f0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:03.775186 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59faf0-f882-4811-9350-61b55383f0bc None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:03.775475 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59faf0-f882-4811-9350-61b55383f0bc None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:03.775755 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59faf0-f882-4811-9350-61b55383f0bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:03.776874 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59faf0-f882-4811-9350-61b55383f0bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:03.778343 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b59faf0-f882-4811-9350-61b55383f0bc None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:03.779919 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 55/104] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:31:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:03.785692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb0c3a-c930-4bba-b73a-ac6914c1ab4c None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:03.852309 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59faf0-f882-4811-9350-61b55383f0bc None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:03.901419 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb0c3a-c930-4bba-b73a-ac6914c1ab4c None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:03.903301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:03.944601 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac385636-1c27-468f-a6b8-cee043a46b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:03.945476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac385636-1c27-468f-a6b8-cee043a46b1e None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:03.945903 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac385636-1c27-468f-a6b8-cee043a46b1e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:03.947017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac385636-1c27-468f-a6b8-cee043a46b1e None admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:03.947849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac385636-1c27-468f-a6b8-cee043a46b1e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:03.950844 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac385636-1c27-468f-a6b8-cee043a46b1e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:04.015206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 50/105] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 09:31:03 2022] POST /identity/v3/projects => generated 302 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:31:04.051425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5e4a8-7653-482c-a590-ef48e318f177 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:04.052380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5e4a8-7653-482c-a590-ef48e318f177 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:04.052801 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5e4a8-7653-482c-a590-ef48e318f177 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:04.054366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 51/106] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:04.060384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704d37c-794e-48e8-af30-a1b2cc464543 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:04.060934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704d37c-794e-48e8-af30-a1b2cc464543 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:04.061386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704d37c-794e-48e8-af30-a1b2cc464543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:04.062001 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59faf0-f882-4811-9350-61b55383f0bc None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:04.105769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-b704d37c-794e-48e8-af30-a1b2cc464543 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:04.107206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-b704d37c-794e-48e8-af30-a1b2cc464543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:04.147212 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20ac8f-2ac7-4236-9c88-0b859ec4d1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:04.148168 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20ac8f-2ac7-4236-9c88-0b859ec4d1d2 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:04.148654 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20ac8f-2ac7-4236-9c88-0b859ec4d1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:04.149107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20ac8f-2ac7-4236-9c88-0b859ec4d1d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:04.174010 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20ac8f-2ac7-4236-9c88-0b859ec4d1d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:04.179564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-6a20ac8f-2ac7-4236-9c88-0b859ec4d1d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:04.179564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:04.179564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:04.179564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:04.179564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:04.179564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:04.179564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:04.179564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:04.179564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:04.179564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:04.179564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:04.179564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:04.179564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:04.179564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:04.179564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:04.179564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:04.180409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:04.180409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:04.180409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:04.180409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:04.180409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:04.180409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:04.180409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:04.180409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:04.180409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:04.180409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:04.180409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:04.180409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:04.180409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:04.180409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:04.180409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:04.180409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:04.181137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:04.181137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:04.181137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:04.181137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:04.181137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:04.181137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:04.181137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:04.181137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:04.181137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:04.181137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:04.181137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:04.181137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:04.181137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 56/107] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:31:04.187778 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20ac8f-2ac7-4236-9c88-0b859ec4d1d2 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:04.237341 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 52/108] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:31:04.239709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704d37c-794e-48e8-af30-a1b2cc464543 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:04.267063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:04.331179 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20ac8f-2ac7-4236-9c88-0b859ec4d1d2 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:04.350414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:04.374854 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704d37c-794e-48e8-af30-a1b2cc464543 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:04.376427 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd299a9-9714-4875-9ac2-6b0da44b775b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:04.377450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd299a9-9714-4875-9ac2-6b0da44b775b None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:04.377982 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd299a9-9714-4875-9ac2-6b0da44b775b None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:04.378751 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd299a9-9714-4875-9ac2-6b0da44b775b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:04.391291 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd299a9-9714-4875-9ac2-6b0da44b775b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:04.397733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-6fd299a9-9714-4875-9ac2-6b0da44b775b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:31:04.397733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:04.397733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:04.397733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:04.397733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:04.397733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:04.397733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:04.397733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:04.397733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:04.397733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:04.397733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:04.397733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:04.397733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:04.397733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:04.397733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:04.397733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:04.398577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:04.398577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:04.398577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:04.398577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:04.398577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:04.398577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:04.398577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:04.398577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:04.398577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:04.398577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:04.398577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:04.398577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:04.398577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:04.398577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:04.398577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:04.398577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:04.399319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:04.399319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:04.399319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:04.399319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:04.399319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:04.399319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:04.399319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:04.399319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:04.399319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:04.399319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:04.399319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:31:04.399319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:04.401733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 57/109] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:31:04.416184 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd299a9-9714-4875-9ac2-6b0da44b775b None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:04.418058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4291f-1a7e-480e-9f47-b04499af6d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:04.418859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4291f-1a7e-480e-9f47-b04499af6d81 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:04.419285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4291f-1a7e-480e-9f47-b04499af6d81 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:04.419770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4291f-1a7e-480e-9f47-b04499af6d81 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:04.420798 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4291f-1a7e-480e-9f47-b04499af6d81 None admin] RBAC: Adding query filter params (name=member) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:04.421237 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4291f-1a7e-480e-9f47-b04499af6d81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:04.422791 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4291f-1a7e-480e-9f47-b04499af6d81 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:04.434007 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 53/110] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:04.440113 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4291f-1a7e-480e-9f47-b04499af6d81 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:04.572043 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4291f-1a7e-480e-9f47-b04499af6d81 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:04.578260 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd299a9-9714-4875-9ac2-6b0da44b775b None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:04.588532 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:04.615340 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d77545-3073-492e-a56e-29090df12de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:04.616217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d77545-3073-492e-a56e-29090df12de5 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:04.616669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d77545-3073-492e-a56e-29090df12de5 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:04.617091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d77545-3073-492e-a56e-29090df12de5 None admin] PATH_INFO: `/v3/users/293b91ba2e5e4247b3d8b1a013fc2242` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:04.618448 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d77545-3073-492e-a56e-29090df12de5 None admin] RBAC: Authorizing `identity:get_user(user_id=293b91ba2e5e4247b3d8b1a013fc2242)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:04.620071 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d77545-3073-492e-a56e-29090df12de5 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:04.620376 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b526e-9d5c-4e84-a324-ab60ecec4258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:04.621180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b526e-9d5c-4e84-a324-ab60ecec4258 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:04.621629 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b526e-9d5c-4e84-a324-ab60ecec4258 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:04.622046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b526e-9d5c-4e84-a324-ab60ecec4258 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:04.622373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 54/111] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:04 2022] GET /identity/v3/users/293b91ba2e5e4247b3d8b1a013fc2242 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:04.623074 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b526e-9d5c-4e84-a324-ab60ecec4258 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:04.623653 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b526e-9d5c-4e84-a324-ab60ecec4258 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:04.623761 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e49c0a-bb43-4f74-9433-d9d5e27f496e None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:04.624155 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e49c0a-bb43-4f74-9433-d9d5e27f496e None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:04.624530 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e49c0a-bb43-4f74-9433-d9d5e27f496e None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:04.625628 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b526e-9d5c-4e84-a324-ab60ecec4258 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:04.625984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 55/112] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:04.630734 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d82b02-eef9-4566-bac2-07002e86d643 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:04.630734 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d82b02-eef9-4566-bac2-07002e86d643 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:04.630734 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d82b02-eef9-4566-bac2-07002e86d643 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:04.630734 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 56/113] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:04.630734 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d82b02-eef9-4566-bac2-07002e86d643 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:04.643321 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 58/114] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:04.645970 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82339450-4d5d-4dc7-b537-5c3373bf1959 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:04.646259 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82339450-4d5d-4dc7-b537-5c3373bf1959 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:04.646546 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82339450-4d5d-4dc7-b537-5c3373bf1959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:04.654661 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:04.666738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-82339450-4d5d-4dc7-b537-5c3373bf1959 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:04.667938 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-82339450-4d5d-4dc7-b537-5c3373bf1959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:04.740954 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 59/115] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:04.742524 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd521bdc-10fd-48da-9bdc-5d8bce506318 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:04.742815 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd521bdc-10fd-48da-9bdc-5d8bce506318 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:04.743093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd521bdc-10fd-48da-9bdc-5d8bce506318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:04.758395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d82b02-eef9-4566-bac2-07002e86d643 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:04.761687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-fd521bdc-10fd-48da-9bdc-5d8bce506318 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:04.762885 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-fd521bdc-10fd-48da-9bdc-5d8bce506318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:04.796389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5bbb8-4079-48a2-bb27-18770fa28c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:04.797376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5bbb8-4079-48a2-bb27-18770fa28c12 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:04.798011 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5bbb8-4079-48a2-bb27-18770fa28c12 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:04.798493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5bbb8-4079-48a2-bb27-18770fa28c12 None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:04.800665 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5bbb8-4079-48a2-bb27-18770fa28c12 None admin] RBAC: Authorizing `identity:get_project(project_id=92dea89f3bc4436195a8b5f4a64fd785)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:04.802528 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5bbb8-4079-48a2-bb27-18770fa28c12 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:04.809578 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 57/116] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:04 2022] GET /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:04.810722 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5bbb8-4079-48a2-bb27-18770fa28c12 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:04.834607 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 60/117] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:04.842843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd521bdc-10fd-48da-9bdc-5d8bce506318 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:04.893397 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:04.968406 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:05.007761 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5bbb8-4079-48a2-bb27-18770fa28c12 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:05.010096 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd521bdc-10fd-48da-9bdc-5d8bce506318 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:05.053764 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958ab2b-14f2-4463-a5aa-18abd0f2a3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:05.054408 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958ab2b-14f2-4463-a5aa-18abd0f2a3b0 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:05.054692 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958ab2b-14f2-4463-a5aa-18abd0f2a3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:05.054972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958ab2b-14f2-4463-a5aa-18abd0f2a3b0 None admin] PATH_INFO: `/v3/users/593f6ce1e9444c04a9a7be8feffd25f8` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:05.070228 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958ab2b-14f2-4463-a5aa-18abd0f2a3b0 None admin] RBAC: Authorizing `identity:get_user(user_id=593f6ce1e9444c04a9a7be8feffd25f8)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:05.070859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ebc4f-ca6f-463d-942f-a0e269d381b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:05.071758 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958ab2b-14f2-4463-a5aa-18abd0f2a3b0 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:05.072100 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ebc4f-ca6f-463d-942f-a0e269d381b8 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:05.072529 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ebc4f-ca6f-463d-942f-a0e269d381b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:05.072951 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ebc4f-ca6f-463d-942f-a0e269d381b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:05.073492 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 61/118] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:04 2022] GET /identity/v3/users/593f6ce1e9444c04a9a7be8feffd25f8 => generated 289 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:05.074309 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958ab2b-14f2-4463-a5aa-18abd0f2a3b0 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:05.093085 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ebc4f-ca6f-463d-942f-a0e269d381b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:05.101128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-3e7ebc4f-ca6f-463d-942f-a0e269d381b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:31:05.101128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:05.101128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:05.101128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:05.101128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:05.101128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:05.101128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:05.101128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:05.101128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:05.101128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:05.101128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:05.101128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:05.101128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:05.101128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:05.101128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:05.101128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:05.102316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:05.102316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:05.102316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:05.102316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:05.102316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:05.102316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:05.102316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:05.102316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:05.102316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:05.102316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:05.102316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:05.102316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:05.102316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:05.102316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:05.102316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:05.102316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:05.103091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:05.103091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:05.103091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:05.103091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:05.103091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:05.103091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:05.103091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:05.103091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:05.103091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:05.103091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:05.103091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:31:05.103091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:05.105684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 58/119] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:31:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:05.107168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ebc4f-ca6f-463d-942f-a0e269d381b8 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:05.186644 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:05.200612 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958ab2b-14f2-4463-a5aa-18abd0f2a3b0 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:05.220157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ebc4f-ca6f-463d-942f-a0e269d381b8 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:05.236438 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102396f5-766f-4856-9336-d87ff07ad048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:05.237095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102396f5-766f-4856-9336-d87ff07ad048 None admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:05.237380 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102396f5-766f-4856-9336-d87ff07ad048 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:05.238599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102396f5-766f-4856-9336-d87ff07ad048 None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785/users/293b91ba2e5e4247b3d8b1a013fc2242/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:05.240623 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102396f5-766f-4856-9336-d87ff07ad048 None admin] RBAC: Authorizing `identity:create_grant(project_id=92dea89f3bc4436195a8b5f4a64fd785, user_id=293b91ba2e5e4247b3d8b1a013fc2242, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:05.242203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102396f5-766f-4856-9336-d87ff07ad048 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:05.257243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 62/120] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:31:05 2022] PUT /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785/users/293b91ba2e5e4247b3d8b1a013fc2242/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:31:05.264891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962452e-a682-4db1-ac71-f169fd8daef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:05.265732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962452e-a682-4db1-ac71-f169fd8daef1 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:05.266130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962452e-a682-4db1-ac71-f169fd8daef1 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:05.266517 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962452e-a682-4db1-ac71-f169fd8daef1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:05.270371 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102396f5-766f-4856-9336-d87ff07ad048 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:05.276980 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:05.280934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962452e-a682-4db1-ac71-f169fd8daef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:05.287360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-f962452e-a682-4db1-ac71-f169fd8daef1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:05.287360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:05.287360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:05.287360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:05.287360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:05.287360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:05.287360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:05.287360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:05.287360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:05.287360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:05.287360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:05.287360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:05.287360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:05.287360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:05.287360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:05.287360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:05.288288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:05.288288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:05.288288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:05.288288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:05.288288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:05.288288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:05.288288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:05.288288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:05.288288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:05.288288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:05.288288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:05.288288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:05.288288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:05.288288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:05.288288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:05.288288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:05.289032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:05.289032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:05.289032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:05.289032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:05.289032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:05.289032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:05.289032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:05.289032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:05.289032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:05.289032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:05.289032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:05.289032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:05.293746 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 59/121] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:05.294782 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962452e-a682-4db1-ac71-f169fd8daef1 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:05.442910 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102396f5-766f-4856-9336-d87ff07ad048 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:05.456057 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962452e-a682-4db1-ac71-f169fd8daef1 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:05.480060 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3948c65-4fbb-4c6b-b37f-610b3978ad57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:05.480685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3948c65-4fbb-4c6b-b37f-610b3978ad57 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:05.480969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3948c65-4fbb-4c6b-b37f-610b3978ad57 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:05.481245 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3948c65-4fbb-4c6b-b37f-610b3978ad57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:05.497372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2fd04-ac3b-4642-9f50-d9552880dfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:05.498091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2fd04-ac3b-4642-9f50-d9552880dfbf None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:05.498380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2fd04-ac3b-4642-9f50-d9552880dfbf None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:05.498656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2fd04-ac3b-4642-9f50-d9552880dfbf None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:05.499334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2fd04-ac3b-4642-9f50-d9552880dfbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:05.499640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2fd04-ac3b-4642-9f50-d9552880dfbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:05.500567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:05.501039 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2fd04-ac3b-4642-9f50-d9552880dfbf None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:05.511187 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 60/122] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:05.512040 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2fd04-ac3b-4642-9f50-d9552880dfbf None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:05.558150 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3948c65-4fbb-4c6b-b37f-610b3978ad57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:05.560014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3948c65-4fbb-4c6b-b37f-610b3978ad57 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:05.605939 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:05.633806 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2fd04-ac3b-4642-9f50-d9552880dfbf None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:05.666312 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 63/123] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:05.667553 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3948c65-4fbb-4c6b-b37f-610b3978ad57 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:05.672726 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d22dc-3933-403d-a687-fd2c53d93170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:05.673369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d22dc-3933-403d-a687-fd2c53d93170 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:05.673692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d22dc-3933-403d-a687-fd2c53d93170 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:05.673972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d22dc-3933-403d-a687-fd2c53d93170 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:05.686537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d22dc-3933-403d-a687-fd2c53d93170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:05.692372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-304d22dc-3933-403d-a687-fd2c53d93170 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:05.692372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:05.692372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:05.692372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:05.692372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:05.692372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:05.692372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:05.692372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:05.692372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:05.692372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:05.692372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:05.692372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:05.692372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:05.692372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:05.692372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:05.692372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:05.693264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:05.693264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:05.693264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:05.693264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:05.693264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:05.693264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:05.693264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:05.693264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:05.693264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:05.693264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:05.693264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:05.693264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:05.693264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:05.693264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:05.693264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:05.693264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:05.694059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:05.694059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:05.694059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:05.694059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:05.694059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:05.694059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:05.694059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:05.694059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:05.694059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:05.694059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:05.694059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:05.694059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:05.694059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 61/124] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 09:31:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:05.699022 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d22dc-3933-403d-a687-fd2c53d93170 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:05.724594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:05.783148 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3948c65-4fbb-4c6b-b37f-610b3978ad57 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:05.819501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d22dc-3933-403d-a687-fd2c53d93170 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:05.833035 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76660c79-680a-4643-9a5a-0d3ace5f856e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:05.834229 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76660c79-680a-4643-9a5a-0d3ace5f856e None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:05.835159 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76660c79-680a-4643-9a5a-0d3ace5f856e None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:05.835657 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76660c79-680a-4643-9a5a-0d3ace5f856e None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:05.836740 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76660c79-680a-4643-9a5a-0d3ace5f856e None admin] RBAC: Adding query filter params (name=member) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:05.837459 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76660c79-680a-4643-9a5a-0d3ace5f856e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:05.839518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76660c79-680a-4643-9a5a-0d3ace5f856e None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:05.848453 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:05.854876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 64/125] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:05.855858 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76660c79-680a-4643-9a5a-0d3ace5f856e None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:05.865287 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da60f29-8844-4063-a4ff-6355c62181ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:05.866257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da60f29-8844-4063-a4ff-6355c62181ac None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:05.867255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da60f29-8844-4063-a4ff-6355c62181ac None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:05.867706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da60f29-8844-4063-a4ff-6355c62181ac None admin] PATH_INFO: `/v3/users/4757bd29ffb0448ca0dc35345a8b1469` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:05.869586 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da60f29-8844-4063-a4ff-6355c62181ac None admin] RBAC: Authorizing `identity:get_user(user_id=4757bd29ffb0448ca0dc35345a8b1469)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:05.871707 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da60f29-8844-4063-a4ff-6355c62181ac None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:05.874008 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 62/126] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:05 2022] GET /identity/v3/users/4757bd29ffb0448ca0dc35345a8b1469 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:05.875393 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da60f29-8844-4063-a4ff-6355c62181ac None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:05.971225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76660c79-680a-4643-9a5a-0d3ace5f856e None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:05.986231 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:06.011716 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da60f29-8844-4063-a4ff-6355c62181ac None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:06.019767 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ea24d-98c9-43fd-86a0-11fd8c4c5941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:06.021167 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ea24d-98c9-43fd-86a0-11fd8c4c5941 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:06.021657 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ea24d-98c9-43fd-86a0-11fd8c4c5941 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:06.022130 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ea24d-98c9-43fd-86a0-11fd8c4c5941 None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:06.023913 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ea24d-98c9-43fd-86a0-11fd8c4c5941 None admin] RBAC: Authorizing `identity:get_project(project_id=92dea89f3bc4436195a8b5f4a64fd785)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:06.026225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ea24d-98c9-43fd-86a0-11fd8c4c5941 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:06.028991 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 65/127] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:05 2022] GET /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:06.029967 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ea24d-98c9-43fd-86a0-11fd8c4c5941 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:06.056189 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329690c-e4c1-416e-bf2b-8d419bb55924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:06.056907 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329690c-e4c1-416e-bf2b-8d419bb55924 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:06.057259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329690c-e4c1-416e-bf2b-8d419bb55924 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:06.057647 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329690c-e4c1-416e-bf2b-8d419bb55924 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:06.058399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329690c-e4c1-416e-bf2b-8d419bb55924 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:06.058777 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329690c-e4c1-416e-bf2b-8d419bb55924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:06.060236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329690c-e4c1-416e-bf2b-8d419bb55924 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:06.073709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 63/128] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:31:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:06.074662 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329690c-e4c1-416e-bf2b-8d419bb55924 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:06.134542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:06.168564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ea24d-98c9-43fd-86a0-11fd8c4c5941 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:06.187087 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329690c-e4c1-416e-bf2b-8d419bb55924 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:06.214261 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84109c-df9d-4442-8289-8409f318979c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:06.215249 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84109c-df9d-4442-8289-8409f318979c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:06.215651 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84109c-df9d-4442-8289-8409f318979c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:06.215997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84109c-df9d-4442-8289-8409f318979c None admin] PATH_INFO: `/v3/users/293b91ba2e5e4247b3d8b1a013fc2242` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:06.217254 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84109c-df9d-4442-8289-8409f318979c None admin] RBAC: Authorizing `identity:get_user(user_id=293b91ba2e5e4247b3d8b1a013fc2242)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:06.218824 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84109c-df9d-4442-8289-8409f318979c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:06.220446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 66/129] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:06 2022] GET /identity/v3/users/293b91ba2e5e4247b3d8b1a013fc2242 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:06.229308 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84109c-df9d-4442-8289-8409f318979c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:06.235765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8fe48-a758-4145-8d5c-66978ee496bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:06.236609 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8fe48-a758-4145-8d5c-66978ee496bc None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:06.237062 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8fe48-a758-4145-8d5c-66978ee496bc None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:06.238051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8fe48-a758-4145-8d5c-66978ee496bc None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:06.239396 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8fe48-a758-4145-8d5c-66978ee496bc None admin] RBAC: Authorizing `identity:get_project(project_id=92dea89f3bc4436195a8b5f4a64fd785)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:06.241026 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8fe48-a758-4145-8d5c-66978ee496bc None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:06.242843 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 64/130] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:06 2022] GET /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:06.243761 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8fe48-a758-4145-8d5c-66978ee496bc None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:06.302216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:06.355897 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8fe48-a758-4145-8d5c-66978ee496bc None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:06.378941 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:06.380005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84109c-df9d-4442-8289-8409f318979c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:06.395392 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b7251-ef1a-4d61-9087-3527507fba1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:06.396126 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b7251-ef1a-4d61-9087-3527507fba1c None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:06.396537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b7251-ef1a-4d61-9087-3527507fba1c None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:06.396887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b7251-ef1a-4d61-9087-3527507fba1c None admin] PATH_INFO: `/v3/users/293b91ba2e5e4247b3d8b1a013fc2242` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:06.398913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b7251-ef1a-4d61-9087-3527507fba1c None admin] RBAC: Authorizing `identity:get_user(user_id=293b91ba2e5e4247b3d8b1a013fc2242)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:06.401289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b7251-ef1a-4d61-9087-3527507fba1c None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:06.403749 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 65/131] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:06 2022] GET /identity/v3/users/293b91ba2e5e4247b3d8b1a013fc2242 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:06.404746 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b7251-ef1a-4d61-9087-3527507fba1c None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:06.428912 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eab817-5f0c-4b52-bca9-8ad16f3ed1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:06.429573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eab817-5f0c-4b52-bca9-8ad16f3ed1b3 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:06.429903 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eab817-5f0c-4b52-bca9-8ad16f3ed1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:06.430297 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eab817-5f0c-4b52-bca9-8ad16f3ed1b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:06.431299 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eab817-5f0c-4b52-bca9-8ad16f3ed1b3 None admin] RBAC: Adding query filter params (role.id=791a6ff17232433d820343dc3ceee47a, scope.project.id=92dea89f3bc4436195a8b5f4a64fd785, user.id=593f6ce1e9444c04a9a7be8feffd25f8) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:06.431621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eab817-5f0c-4b52-bca9-8ad16f3ed1b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:06.433085 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eab817-5f0c-4b52-bca9-8ad16f3ed1b3 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:06.438792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 67/132] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:31:06 2022] GET /identity/v3/role_assignments?user.id=593f6ce1e9444c04a9a7be8feffd25f8&scope.project.id=92dea89f3bc4436195a8b5f4a64fd785&role.id=791a6ff17232433d820343dc3ceee47a => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:06.439588 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eab817-5f0c-4b52-bca9-8ad16f3ed1b3 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:06.557074 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eab817-5f0c-4b52-bca9-8ad16f3ed1b3 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:06.569834 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:06.571156 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b7251-ef1a-4d61-9087-3527507fba1c None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:06.600288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d7405-e8dd-4623-a9e3-6f53c24e4561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:06.601290 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d7405-e8dd-4623-a9e3-6f53c24e4561 None admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:06.601791 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d7405-e8dd-4623-a9e3-6f53c24e4561 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:06.602282 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d7405-e8dd-4623-a9e3-6f53c24e4561 None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785/users/4757bd29ffb0448ca0dc35345a8b1469/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:06.604638 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d7405-e8dd-4623-a9e3-6f53c24e4561 None admin] RBAC: Authorizing `identity:create_grant(project_id=92dea89f3bc4436195a8b5f4a64fd785, user_id=4757bd29ffb0448ca0dc35345a8b1469, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:06.606769 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d7405-e8dd-4623-a9e3-6f53c24e4561 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:06.617163 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d9c74-8ea8-4bb7-ba9f-cdfff451fc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:06.618213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d9c74-8ea8-4bb7-ba9f-cdfff451fc82 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:06.618499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d9c74-8ea8-4bb7-ba9f-cdfff451fc82 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:06.618913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d9c74-8ea8-4bb7-ba9f-cdfff451fc82 None admin] PATH_INFO: `/v3/projects/594d9be8305242cfb9399197c7df612d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:06.620562 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d9c74-8ea8-4bb7-ba9f-cdfff451fc82 None admin] RBAC: Authorizing `identity:get_project(project_id=594d9be8305242cfb9399197c7df612d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:06.622451 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d9c74-8ea8-4bb7-ba9f-cdfff451fc82 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:06.629353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 66/133] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:06 2022] GET /identity/v3/projects/594d9be8305242cfb9399197c7df612d => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:06.629353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d9c74-8ea8-4bb7-ba9f-cdfff451fc82 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:06.630283 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 68/134] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:31:06 2022] PUT /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785/users/4757bd29ffb0448ca0dc35345a8b1469/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:31:06.632887 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6e544-e2ff-4257-bc1e-2bf1981f8b64 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:06.633361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6e544-e2ff-4257-bc1e-2bf1981f8b64 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:06.633838 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6e544-e2ff-4257-bc1e-2bf1981f8b64 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:06.635408 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 69/135] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:06.636448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6e544-e2ff-4257-bc1e-2bf1981f8b64 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:06.699143 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:06.752645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d9c74-8ea8-4bb7-ba9f-cdfff451fc82 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:06.760847 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6e544-e2ff-4257-bc1e-2bf1981f8b64 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:06.795098 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e11b7-9fac-4807-8b16-e2a487174d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:06.796143 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e11b7-9fac-4807-8b16-e2a487174d16 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:06.796620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e11b7-9fac-4807-8b16-e2a487174d16 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:06.797185 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e11b7-9fac-4807-8b16-e2a487174d16 None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:06.798634 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e11b7-9fac-4807-8b16-e2a487174d16 None admin] RBAC: Authorizing `identity:get_project(project_id=92dea89f3bc4436195a8b5f4a64fd785)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:06.801277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e11b7-9fac-4807-8b16-e2a487174d16 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:06.801711 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414979c-8ee1-4214-a1f8-8079890fe7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:06.802394 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414979c-8ee1-4214-a1f8-8079890fe7cd None admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:06.802682 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414979c-8ee1-4214-a1f8-8079890fe7cd None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:06.802964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414979c-8ee1-4214-a1f8-8079890fe7cd None admin] PATH_INFO: `/v3/projects/594d9be8305242cfb9399197c7df612d/users/293b91ba2e5e4247b3d8b1a013fc2242/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:06.804210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 67/136] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:06 2022] GET /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:06.805482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414979c-8ee1-4214-a1f8-8079890fe7cd None admin] RBAC: Authorizing `identity:create_grant(project_id=594d9be8305242cfb9399197c7df612d, user_id=293b91ba2e5e4247b3d8b1a013fc2242, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:06.805953 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec03290-21e1-4c7f-9d13-cf7bde7e1921 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:06.806459 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec03290-21e1-4c7f-9d13-cf7bde7e1921 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:06.806920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec03290-21e1-4c7f-9d13-cf7bde7e1921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:06.807036 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414979c-8ee1-4214-a1f8-8079890fe7cd None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:06.828401 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-fec03290-21e1-4c7f-9d13-cf7bde7e1921 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:06.830005 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-fec03290-21e1-4c7f-9d13-cf7bde7e1921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:06.837510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 70/137] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:31:06 2022] PUT /identity/v3/projects/594d9be8305242cfb9399197c7df612d/users/293b91ba2e5e4247b3d8b1a013fc2242/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:31:06.837510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414979c-8ee1-4214-a1f8-8079890fe7cd None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:06.904010 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:06.965458 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 68/138] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:07.003249 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414979c-8ee1-4214-a1f8-8079890fe7cd None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:07.042069 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444b7dd-2007-4316-8014-abdb473babfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:07.042750 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444b7dd-2007-4316-8014-abdb473babfc None admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:07.043030 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444b7dd-2007-4316-8014-abdb473babfc None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:07.043304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444b7dd-2007-4316-8014-abdb473babfc None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785/users/293b91ba2e5e4247b3d8b1a013fc2242/roles/6c6a208f837c453cb9aceca635451134` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:07.045571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444b7dd-2007-4316-8014-abdb473babfc None admin] RBAC: Authorizing `identity:create_grant(project_id=92dea89f3bc4436195a8b5f4a64fd785, user_id=293b91ba2e5e4247b3d8b1a013fc2242, role_id=6c6a208f837c453cb9aceca635451134)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:07.047092 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444b7dd-2007-4316-8014-abdb473babfc None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:07.064973 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 71/139] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:31:06 2022] PUT /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785/users/293b91ba2e5e4247b3d8b1a013fc2242/roles/6c6a208f837c453cb9aceca635451134 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:31:07.317638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec03290-21e1-4c7f-9d13-cf7bde7e1921 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:07.381791 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:07.440306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec03290-21e1-4c7f-9d13-cf7bde7e1921 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:07.478930 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb43df-66ae-4584-a7de-cd8ce6e7c21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:07.479961 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb43df-66ae-4584-a7de-cd8ce6e7c21c None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:07.480435 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb43df-66ae-4584-a7de-cd8ce6e7c21c None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:07.480897 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb43df-66ae-4584-a7de-cd8ce6e7c21c None admin] PATH_INFO: `/v3/domains/default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:07.482510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb43df-66ae-4584-a7de-cd8ce6e7c21c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:07.484192 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb43df-66ae-4584-a7de-cd8ce6e7c21c None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:07.485999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 69/140] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:31:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:07.492559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444b7dd-2007-4316-8014-abdb473babfc None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:07.623138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0127c-1135-4952-9b77-2b137a38096e None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:07.623756 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0127c-1135-4952-9b77-2b137a38096e None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:07.624257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0127c-1135-4952-9b77-2b137a38096e None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:07.626415 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 70/141] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:07.639125 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4329d-8a9b-4ad1-baa2-91aeeebc1bde None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:07.640143 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4329d-8a9b-4ad1-baa2-91aeeebc1bde None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:07.640613 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4329d-8a9b-4ad1-baa2-91aeeebc1bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:07.643032 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:07.662039 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444b7dd-2007-4316-8014-abdb473babfc None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:07.674708 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-6de4329d-8a9b-4ad1-baa2-91aeeebc1bde None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:07.676946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-6de4329d-8a9b-4ad1-baa2-91aeeebc1bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:07.750245 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77e704-feac-431c-974a-698b614a146b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:07.750828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77e704-feac-431c-974a-698b614a146b None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:07.751173 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77e704-feac-431c-974a-698b614a146b None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:07.751534 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77e704-feac-431c-974a-698b614a146b None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:07.752118 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77e704-feac-431c-974a-698b614a146b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:07.761952 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77e704-feac-431c-974a-698b614a146b None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:07.764904 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 71/142] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:07.804138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 72/143] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 09:31:07 2022] POST /identity/v3/users => generated 283 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:31:08.154279 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4329d-8a9b-4ad1-baa2-91aeeebc1bde None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:08.228190 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:08.299203 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4329d-8a9b-4ad1-baa2-91aeeebc1bde None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:08.345443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8106eac-b367-40bf-aa6e-2c28d3822e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:08.346127 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8106eac-b367-40bf-aa6e-2c28d3822e85 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:08.346367 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8106eac-b367-40bf-aa6e-2c28d3822e85 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:08.346641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8106eac-b367-40bf-aa6e-2c28d3822e85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:08.362526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8106eac-b367-40bf-aa6e-2c28d3822e85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:08.367299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-a8106eac-b367-40bf-aa6e-2c28d3822e85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:08.367299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:08.367299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:08.367299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:08.367299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:08.367299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:08.367299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:08.367299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:08.367299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:08.367299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:08.367299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:08.367299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:08.367299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:08.367299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:08.367299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:08.367299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:08.368196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:08.368196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:08.368196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:08.368196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:08.368196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:08.368196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:08.368196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:08.368196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:08.368196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:08.368196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:08.368196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:08.368196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:08.368196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:08.368196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:08.368196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:08.368196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:08.368965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:08.368965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:08.368965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:08.368965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:08.368965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:08.368965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:08.368965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:08.368965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:08.368965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:08.368965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:08.368965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:08.368965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:08.368965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 72/144] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:08.374249 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77e704-feac-431c-974a-698b614a146b None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:08.519993 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77e704-feac-431c-974a-698b614a146b None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:08.561407 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43686eb-5a2e-4342-9fd8-1dd8a93d1fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:08.562058 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43686eb-5a2e-4342-9fd8-1dd8a93d1fbf None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:08.562340 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43686eb-5a2e-4342-9fd8-1dd8a93d1fbf None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:08.562622 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43686eb-5a2e-4342-9fd8-1dd8a93d1fbf None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:08.563301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43686eb-5a2e-4342-9fd8-1dd8a93d1fbf None admin] RBAC: Adding query filter params (name=member) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:08.563604 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43686eb-5a2e-4342-9fd8-1dd8a93d1fbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:08.565050 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43686eb-5a2e-4342-9fd8-1dd8a93d1fbf None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:08.576646 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 73/145] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:08.582609 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8106eac-b367-40bf-aa6e-2c28d3822e85 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:08.705906 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8106eac-b367-40bf-aa6e-2c28d3822e85 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:08.724363 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:08.748290 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2539c4-2fa4-4400-8142-91c80069999e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:08.748925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2539c4-2fa4-4400-8142-91c80069999e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:08.749253 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2539c4-2fa4-4400-8142-91c80069999e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:08.749571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2539c4-2fa4-4400-8142-91c80069999e None admin] PATH_INFO: `/v3/users/293b91ba2e5e4247b3d8b1a013fc2242` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:08.750831 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2539c4-2fa4-4400-8142-91c80069999e None admin] RBAC: Authorizing `identity:get_user(user_id=293b91ba2e5e4247b3d8b1a013fc2242)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:08.752270 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2539c4-2fa4-4400-8142-91c80069999e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:08.754775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 73/146] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:08 2022] GET /identity/v3/users/293b91ba2e5e4247b3d8b1a013fc2242 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:08.762622 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43686eb-5a2e-4342-9fd8-1dd8a93d1fbf None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:08.780240 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:08.904307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43686eb-5a2e-4342-9fd8-1dd8a93d1fbf None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:08.948783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd77148-bbd6-401c-b378-1a3c33c4f14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:08.949409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd77148-bbd6-401c-b378-1a3c33c4f14e None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:08.949716 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd77148-bbd6-401c-b378-1a3c33c4f14e None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:08.949995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd77148-bbd6-401c-b378-1a3c33c4f14e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:09.028866 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd77148-bbd6-401c-b378-1a3c33c4f14e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:09.030430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd77148-bbd6-401c-b378-1a3c33c4f14e None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:09.040861 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:09.151457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 74/147] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:09.157055 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2539c4-2fa4-4400-8142-91c80069999e None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:09.290449 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2539c4-2fa4-4400-8142-91c80069999e None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:09.327882 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742ba18-6dda-4acb-ba26-a1c4a9e94fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:09.328515 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742ba18-6dda-4acb-ba26-a1c4a9e94fbc None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:09.328787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742ba18-6dda-4acb-ba26-a1c4a9e94fbc None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:09.329077 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742ba18-6dda-4acb-ba26-a1c4a9e94fbc None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:09.330209 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9742ba18-6dda-4acb-ba26-a1c4a9e94fbc None admin] RBAC: Authorizing `identity:get_project(project_id=92dea89f3bc4436195a8b5f4a64fd785)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:09.331692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9742ba18-6dda-4acb-ba26-a1c4a9e94fbc None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:09.333330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 74/148] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:09 2022] GET /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:09.339317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd77148-bbd6-401c-b378-1a3c33c4f14e None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:09.476665 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd77148-bbd6-401c-b378-1a3c33c4f14e None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:09.486875 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:09.518150 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12061c8-4434-4815-b9bf-b035555bec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:09.518864 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12061c8-4434-4815-b9bf-b035555bec97 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:09.519273 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12061c8-4434-4815-b9bf-b035555bec97 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:09.519600 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12061c8-4434-4815-b9bf-b035555bec97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:09.520334 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12061c8-4434-4815-b9bf-b035555bec97 None admin] RBAC: Adding query filter params (role.id=ec487838eecf4dc4bde1eaa59af3eb26, scope.project.id=92dea89f3bc4436195a8b5f4a64fd785, user.id=293b91ba2e5e4247b3d8b1a013fc2242) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:09.520925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12061c8-4434-4815-b9bf-b035555bec97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:09.522312 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12061c8-4434-4815-b9bf-b035555bec97 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:09.529580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 75/149] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:31:09 2022] GET /identity/v3/role_assignments?user.id=293b91ba2e5e4247b3d8b1a013fc2242&scope.project.id=92dea89f3bc4436195a8b5f4a64fd785&role.id=ec487838eecf4dc4bde1eaa59af3eb26 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:09.826830 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de280d84-dee2-41bf-a1a5-429519ded587 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:09.827843 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de280d84-dee2-41bf-a1a5-429519ded587 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:09.828328 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de280d84-dee2-41bf-a1a5-429519ded587 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:09.829935 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 75/150] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:09.835949 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b9250-c41f-43d4-8305-e3e3c4389866 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:09.836241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b9250-c41f-43d4-8305-e3e3c4389866 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:09.836520 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b9250-c41f-43d4-8305-e3e3c4389866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:09.848129 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c486343-7c57-4677-858f-9b86371ae717 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:09.848729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c486343-7c57-4677-858f-9b86371ae717 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:09.849196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c486343-7c57-4677-858f-9b86371ae717 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:09.850758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 76/151] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:31:09.859079 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-a73b9250-c41f-43d4-8305-e3e3c4389866 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:09.860286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-a73b9250-c41f-43d4-8305-e3e3c4389866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:09.866731 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705be11-ad8f-4666-9f7d-88f985f0d3a9 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:09.867284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705be11-ad8f-4666-9f7d-88f985f0d3a9 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:09.867761 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705be11-ad8f-4666-9f7d-88f985f0d3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:09.902513 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-1705be11-ad8f-4666-9f7d-88f985f0d3a9 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:09.904137 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-1705be11-ad8f-4666-9f7d-88f985f0d3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:09.942316 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 76/152] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:09.943561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72345394-0790-4c3d-b4cf-5064fd947d19 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:09.943830 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72345394-0790-4c3d-b4cf-5064fd947d19 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:09.944107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72345394-0790-4c3d-b4cf-5064fd947d19 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:09.945347 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 77/153] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:09.955223 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6177fb3-f7a4-4c88-ad1f-9c344c807630 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:09.955573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6177fb3-f7a4-4c88-ad1f-9c344c807630 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:09.955787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6177fb3-f7a4-4c88-ad1f-9c344c807630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:09.993887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:09.994648 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-c6177fb3-f7a4-4c88-ad1f-9c344c807630 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:09.996660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-c6177fb3-f7a4-4c88-ad1f-9c344c807630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:10.028971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 77/154] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:31:10.103520 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 78/155] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:10.390509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf8f1a-fbbb-4146-ac8f-ab184d311b1b None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:10.391160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf8f1a-fbbb-4146-ac8f-ab184d311b1b None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:10.391654 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf8f1a-fbbb-4146-ac8f-ab184d311b1b None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:10.393219 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 78/156] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:10.399362 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312e872-8b0e-4984-ba93-8d00b03646a2 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:10.399903 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312e872-8b0e-4984-ba93-8d00b03646a2 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:10.400386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312e872-8b0e-4984-ba93-8d00b03646a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:10.419892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-0312e872-8b0e-4984-ba93-8d00b03646a2 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:10.421426 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-0312e872-8b0e-4984-ba93-8d00b03646a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:10.438494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf8f1a-fbbb-4146-ac8f-ab184d311b1b None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:10.461149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:10.539182 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 79/157] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:10.592833 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312e872-8b0e-4984-ba93-8d00b03646a2 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:10.650225 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf8f1a-fbbb-4146-ac8f-ab184d311b1b None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:10.712012 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f19f7-72da-4a89-92ee-fff1de639a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:10.712652 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f19f7-72da-4a89-92ee-fff1de639a8a None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:10.713739 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f19f7-72da-4a89-92ee-fff1de639a8a None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:10.714033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f19f7-72da-4a89-92ee-fff1de639a8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:10.736415 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f19f7-72da-4a89-92ee-fff1de639a8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:10.741922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-e78f19f7-72da-4a89-92ee-fff1de639a8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:31:10.741922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:10.741922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:10.741922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:10.741922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:10.741922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:10.741922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:10.741922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:10.741922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:10.741922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:10.741922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:10.741922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:10.741922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:10.741922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:10.741922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:10.741922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:10.742765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:10.742765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:10.742765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:10.742765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:10.742765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:10.742765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:10.742765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:10.742765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:10.742765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:10.742765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:10.742765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:10.742765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:10.742765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:10.742765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:10.742765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:10.742765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:10.743496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:10.743496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:10.743496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:10.743496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:10.743496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:10.743496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:10.743496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:10.743496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:10.743496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:10.743496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:10.743496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:31:10.743496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:10.743496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 79/158] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:31:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:10.749239 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f19f7-72da-4a89-92ee-fff1de639a8a None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:10.783711 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312e872-8b0e-4984-ba93-8d00b03646a2 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:10.805502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:10.885643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8017f0-2153-47ff-bc96-4f40543a8b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:10.886312 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8017f0-2153-47ff-bc96-4f40543a8b8d None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:10.886596 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8017f0-2153-47ff-bc96-4f40543a8b8d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:10.886879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8017f0-2153-47ff-bc96-4f40543a8b8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:10.890509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f19f7-72da-4a89-92ee-fff1de639a8a None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:10.914493 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8017f0-2153-47ff-bc96-4f40543a8b8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:10.919446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-0c8017f0-2153-47ff-bc96-4f40543a8b8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:10.919446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:10.919446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:10.919446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:10.919446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:10.919446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:10.919446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:10.919446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:10.919446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:10.919446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:10.919446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:10.919446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:10.919446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:10.919446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:10.919446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:10.919446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:10.920470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:10.920470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:10.920470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:10.920470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:10.920470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:10.920470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:10.920470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:10.920470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:10.920470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:10.920470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:10.920470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:10.920470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:10.920470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:10.920470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:10.920470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:10.920470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:10.921308 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:10.921308 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:10.921308 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:10.921308 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:10.921308 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:10.921308 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:10.921308 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:10.921308 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:10.921308 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:10.921308 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:10.921308 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:10.921308 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:10.925792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 80/159] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 09:31:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:31:10.927075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8017f0-2153-47ff-bc96-4f40543a8b8d None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:10.942356 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7170d84-a279-4b68-8672-bfbf22be0bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:10.943060 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7170d84-a279-4b68-8672-bfbf22be0bd3 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:10.943387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7170d84-a279-4b68-8672-bfbf22be0bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:10.943664 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7170d84-a279-4b68-8672-bfbf22be0bd3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:10.961426 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7170d84-a279-4b68-8672-bfbf22be0bd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:10.964253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:10.966198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-e7170d84-a279-4b68-8672-bfbf22be0bd3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:31:10.966198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:10.966198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:10.966198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:10.966198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:10.966198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:10.966198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:10.966198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:10.966198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:10.966198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:10.966198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:10.966198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:10.966198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:10.966198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:10.966198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:10.966198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:10.967025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:10.967025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:10.967025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:10.967025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:10.967025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:10.967025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:10.967025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:10.967025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:10.967025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:10.967025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:10.967025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:10.967025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:10.967025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:10.967025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:10.967025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:10.967025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:10.967839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:10.967839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:10.967839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:10.967839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:10.967839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:10.967839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:10.967839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:10.967839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:10.967839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:10.967839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:10.967839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:31:10.967839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:10.967839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 80/160] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:10.968474 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7170d84-a279-4b68-8672-bfbf22be0bd3 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:11.047549 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8017f0-2153-47ff-bc96-4f40543a8b8d None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:11.084826 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0d330-38ad-4c10-81a6-ebceead3578c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:11.085431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0d330-38ad-4c10-81a6-ebceead3578c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:11.085740 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0d330-38ad-4c10-81a6-ebceead3578c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:11.086013 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0d330-38ad-4c10-81a6-ebceead3578c None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:11.086678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0d330-38ad-4c10-81a6-ebceead3578c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:11.089494 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0d330-38ad-4c10-81a6-ebceead3578c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:11.089494 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0d330-38ad-4c10-81a6-ebceead3578c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:11.098205 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 81/161] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:11.099068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0d330-38ad-4c10-81a6-ebceead3578c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:11.191424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:11.199143 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:11.207585 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7170d84-a279-4b68-8672-bfbf22be0bd3 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:11.212283 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0d330-38ad-4c10-81a6-ebceead3578c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:11.251377 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea5818-1543-40fa-9f8f-1f014d1084da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:11.251990 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea5818-1543-40fa-9f8f-1f014d1084da None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:11.252268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea5818-1543-40fa-9f8f-1f014d1084da None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:11.252543 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea5818-1543-40fa-9f8f-1f014d1084da None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:11.258636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea5818-1543-40fa-9f8f-1f014d1084da None admin] RBAC: Adding query filter params (name=reader) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:11.258969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea5818-1543-40fa-9f8f-1f014d1084da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:11.260365 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea5818-1543-40fa-9f8f-1f014d1084da None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:11.274917 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 82/162] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:11.275768 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea5818-1543-40fa-9f8f-1f014d1084da None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:11.280575 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d248a-9693-411f-9f36-6e95df8d6454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:11.281192 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d248a-9693-411f-9f36-6e95df8d6454 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:11.281491 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d248a-9693-411f-9f36-6e95df8d6454 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:11.281765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d248a-9693-411f-9f36-6e95df8d6454 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:11.282450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d248a-9693-411f-9f36-6e95df8d6454 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:11.282747 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d248a-9693-411f-9f36-6e95df8d6454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:11.284132 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d248a-9693-411f-9f36-6e95df8d6454 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:11.304087 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 81/163] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:31:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:11.304780 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d248a-9693-411f-9f36-6e95df8d6454 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:11.484240 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea5818-1543-40fa-9f8f-1f014d1084da None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:11.506991 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d248a-9693-411f-9f36-6e95df8d6454 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:11.546419 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09da650-d677-4df3-b1d8-8e128c3d722b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:11.547050 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09da650-d677-4df3-b1d8-8e128c3d722b None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:11.547329 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09da650-d677-4df3-b1d8-8e128c3d722b None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:11.547603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09da650-d677-4df3-b1d8-8e128c3d722b None admin] PATH_INFO: `/v3/roles/member` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:11.557446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116d22e-8d40-45d9-bf3b-dcb7a7dbb127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:11.558106 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116d22e-8d40-45d9-bf3b-dcb7a7dbb127 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:11.558383 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116d22e-8d40-45d9-bf3b-dcb7a7dbb127 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:11.558657 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116d22e-8d40-45d9-bf3b-dcb7a7dbb127 None admin] PATH_INFO: `/v3/users/4757bd29ffb0448ca0dc35345a8b1469` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:11.560760 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116d22e-8d40-45d9-bf3b-dcb7a7dbb127 None admin] RBAC: Authorizing `identity:get_user(user_id=4757bd29ffb0448ca0dc35345a8b1469)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:11.562227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116d22e-8d40-45d9-bf3b-dcb7a7dbb127 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:11.564049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 83/164] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:11 2022] GET /identity/v3/users/4757bd29ffb0448ca0dc35345a8b1469 => generated 247 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:11.564568 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116d22e-8d40-45d9-bf3b-dcb7a7dbb127 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:11.571138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09da650-d677-4df3-b1d8-8e128c3d722b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:11.576376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-e09da650-d677-4df3-b1d8-8e128c3d722b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:11.576376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:11.576376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:11.576376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:11.576376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:11.576376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:11.576376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:11.576376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:11.576376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:11.576376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:11.576376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:11.576376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:11.576376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:11.576376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:11.576376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:11.576376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:11.577430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:11.577430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:11.577430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:11.577430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:11.577430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:11.577430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:11.577430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:11.577430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:11.577430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:11.577430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:11.577430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:11.577430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:11.577430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:11.577430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:11.577430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:11.577430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:11.578224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:11.578224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:11.578224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:11.578224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:11.578224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:11.578224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:11.578224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:11.578224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:11.578224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:11.578224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:11.578224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:11.578224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:11.580080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 82/165] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:11.582430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09da650-d677-4df3-b1d8-8e128c3d722b None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:11.601632 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:11.630037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:11.771369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116d22e-8d40-45d9-bf3b-dcb7a7dbb127 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:11.775594 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09da650-d677-4df3-b1d8-8e128c3d722b None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:11.827174 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a30996-1d8d-4cf9-a35a-7267e56054b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:11.828069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a30996-1d8d-4cf9-a35a-7267e56054b5 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:11.828488 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a30996-1d8d-4cf9-a35a-7267e56054b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:11.828917 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a30996-1d8d-4cf9-a35a-7267e56054b5 None admin] PATH_INFO: `/v3/users/293b91ba2e5e4247b3d8b1a013fc2242` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:11.830192 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32f29a-29a0-4216-8582-b72ed694f87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:11.830345 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a30996-1d8d-4cf9-a35a-7267e56054b5 None admin] RBAC: Authorizing `identity:get_user(user_id=293b91ba2e5e4247b3d8b1a013fc2242)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:11.831106 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32f29a-29a0-4216-8582-b72ed694f87e None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:11.831767 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a30996-1d8d-4cf9-a35a-7267e56054b5 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:11.831971 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32f29a-29a0-4216-8582-b72ed694f87e None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:11.832536 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32f29a-29a0-4216-8582-b72ed694f87e None admin] PATH_INFO: `/v3/users/593f6ce1e9444c04a9a7be8feffd25f8` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:11.833949 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32f29a-29a0-4216-8582-b72ed694f87e None admin] RBAC: Authorizing `identity:get_user(user_id=593f6ce1e9444c04a9a7be8feffd25f8)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:11.835735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32f29a-29a0-4216-8582-b72ed694f87e None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:11.837506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 84/167] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:11 2022] GET /identity/v3/users/593f6ce1e9444c04a9a7be8feffd25f8 => generated 289 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:11.838431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32f29a-29a0-4216-8582-b72ed694f87e None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:11.838618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 83/167] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:11 2022] GET /identity/v3/users/293b91ba2e5e4247b3d8b1a013fc2242 => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:11.839491 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a30996-1d8d-4cf9-a35a-7267e56054b5 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:11.929911 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:11.937947 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:11.951161 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32f29a-29a0-4216-8582-b72ed694f87e None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:11.952103 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a30996-1d8d-4cf9-a35a-7267e56054b5 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:11.988755 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af176c-28ba-4006-b54c-61dc78d272b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:11.989753 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af176c-28ba-4006-b54c-61dc78d272b5 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:11.990014 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac15dbc-c382-482d-b2b4-9099f94428e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:11.990377 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af176c-28ba-4006-b54c-61dc78d272b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:11.990616 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac15dbc-c382-482d-b2b4-9099f94428e9 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:11.990912 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac15dbc-c382-482d-b2b4-9099f94428e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:11.991073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af176c-28ba-4006-b54c-61dc78d272b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:11.991203 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac15dbc-c382-482d-b2b4-9099f94428e9 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:11.991910 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac15dbc-c382-482d-b2b4-9099f94428e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:11.992210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac15dbc-c382-482d-b2b4-9099f94428e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:11.993655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac15dbc-c382-482d-b2b4-9099f94428e9 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:12.002574 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 84/168] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:12.003911 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0dc8b1-6913-47bd-baab-81a585a25392 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:12.004191 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0dc8b1-6913-47bd-baab-81a585a25392 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:12.004467 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0dc8b1-6913-47bd-baab-81a585a25392 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:12.009722 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 85/169] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:12.010615 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0dc8b1-6913-47bd-baab-81a585a25392 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:12.066079 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af176c-28ba-4006-b54c-61dc78d272b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:12.067840 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af176c-28ba-4006-b54c-61dc78d272b5 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:12.119268 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0dc8b1-6913-47bd-baab-81a585a25392 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:12.155260 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:12.155447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0f9a9-b9e1-4841-8833-6de8f719e4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:12.155926 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0f9a9-b9e1-4841-8833-6de8f719e4dc None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:12.156366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0f9a9-b9e1-4841-8833-6de8f719e4dc None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:12.156796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0f9a9-b9e1-4841-8833-6de8f719e4dc None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:12.158559 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0f9a9-b9e1-4841-8833-6de8f719e4dc None admin] RBAC: Authorizing `identity:get_project(project_id=92dea89f3bc4436195a8b5f4a64fd785)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:12.161943 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0f9a9-b9e1-4841-8833-6de8f719e4dc None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:12.163759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 86/170] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:12 2022] GET /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:12.164391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0f9a9-b9e1-4841-8833-6de8f719e4dc None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:12.177586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 85/171] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:12.178432 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af176c-28ba-4006-b54c-61dc78d272b5 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:12.192973 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:12.283902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0f9a9-b9e1-4841-8833-6de8f719e4dc None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:12.291310 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af176c-28ba-4006-b54c-61dc78d272b5 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:12.322342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b50b2c-99a6-4020-b6e1-ef3f1b0440ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:12.322871 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b50b2c-99a6-4020-b6e1-ef3f1b0440ba None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:12.323143 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b50b2c-99a6-4020-b6e1-ef3f1b0440ba None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:12.323410 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b50b2c-99a6-4020-b6e1-ef3f1b0440ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:12.326537 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05d37d-1dee-4d1b-b5ab-896804003966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:12.327161 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05d37d-1dee-4d1b-b5ab-896804003966 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:12.327440 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05d37d-1dee-4d1b-b5ab-896804003966 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:12.327709 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05d37d-1dee-4d1b-b5ab-896804003966 None admin] PATH_INFO: `/v3/users/293b91ba2e5e4247b3d8b1a013fc2242` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:12.328839 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05d37d-1dee-4d1b-b5ab-896804003966 None admin] RBAC: Authorizing `identity:get_user(user_id=293b91ba2e5e4247b3d8b1a013fc2242)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:12.330324 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05d37d-1dee-4d1b-b5ab-896804003966 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:12.332100 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 86/172] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:12 2022] GET /identity/v3/users/293b91ba2e5e4247b3d8b1a013fc2242 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:12.333836 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514abd73-21fd-4e0a-8336-e60d1d140c7e None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:12.334090 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514abd73-21fd-4e0a-8336-e60d1d140c7e None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:12.339474 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514abd73-21fd-4e0a-8336-e60d1d140c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:12.357458 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-514abd73-21fd-4e0a-8336-e60d1d140c7e None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:12.358681 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-514abd73-21fd-4e0a-8336-e60d1d140c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:12.397428 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b50b2c-99a6-4020-b6e1-ef3f1b0440ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:12.398935 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b50b2c-99a6-4020-b6e1-ef3f1b0440ba None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:12.405104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:12.416827 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:12.426420 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 87/173] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:12.427544 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290d63d-4d6a-4896-b6d6-4d0a19e76f47 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:12.427825 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290d63d-4d6a-4896-b6d6-4d0a19e76f47 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:12.428100 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290d63d-4d6a-4896-b6d6-4d0a19e76f47 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:12.429340 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 88/174] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:12.430043 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290d63d-4d6a-4896-b6d6-4d0a19e76f47 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:12.517457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 87/175] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:12.518489 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b50b2c-99a6-4020-b6e1-ef3f1b0440ba None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:12.550915 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290d63d-4d6a-4896-b6d6-4d0a19e76f47 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:12.587992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26795e-c81e-48f6-b1be-b5f1853b8a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:12.588734 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26795e-c81e-48f6-b1be-b5f1853b8a46 None admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:12.589087 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26795e-c81e-48f6-b1be-b5f1853b8a46 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:12.589370 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26795e-c81e-48f6-b1be-b5f1853b8a46 None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785/users/593f6ce1e9444c04a9a7be8feffd25f8/roles/791a6ff17232433d820343dc3ceee47a` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:12.591328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26795e-c81e-48f6-b1be-b5f1853b8a46 None admin] RBAC: Authorizing `identity:create_grant(project_id=92dea89f3bc4436195a8b5f4a64fd785, user_id=593f6ce1e9444c04a9a7be8feffd25f8, role_id=791a6ff17232433d820343dc3ceee47a)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:12.592771 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26795e-c81e-48f6-b1be-b5f1853b8a46 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:12.613498 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 89/176] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:31:12 2022] PUT /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785/users/593f6ce1e9444c04a9a7be8feffd25f8/roles/791a6ff17232433d820343dc3ceee47a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:31:12.613498 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2007a-c4f4-4270-a3c0-b65532bf2c99 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:12.613498 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2007a-c4f4-4270-a3c0-b65532bf2c99 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:12.613498 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2007a-c4f4-4270-a3c0-b65532bf2c99 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:12.613498 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 90/177] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:12.613498 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2007a-c4f4-4270-a3c0-b65532bf2c99 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:12.657722 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b50b2c-99a6-4020-b6e1-ef3f1b0440ba None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:12.668594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:12.689379 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:12.714257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566466f-24e3-4970-84b7-28dab1e4322a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:12.715071 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566466f-24e3-4970-84b7-28dab1e4322a None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:12.715330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566466f-24e3-4970-84b7-28dab1e4322a None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:12.715727 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566466f-24e3-4970-84b7-28dab1e4322a None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:12.718231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566466f-24e3-4970-84b7-28dab1e4322a None admin] RBAC: Authorizing `identity:get_project(project_id=92dea89f3bc4436195a8b5f4a64fd785)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:12.719717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566466f-24e3-4970-84b7-28dab1e4322a None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:12.721538 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 88/178] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:12 2022] GET /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:12.722943 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001598b7-168c-457c-90a3-70a5345b238c None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:12.723234 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001598b7-168c-457c-90a3-70a5345b238c None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:12.723511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001598b7-168c-457c-90a3-70a5345b238c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:12.745068 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-001598b7-168c-457c-90a3-70a5345b238c None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:12.746420 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-001598b7-168c-457c-90a3-70a5345b238c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:12.751941 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2007a-c4f4-4270-a3c0-b65532bf2c99 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:12.792706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5159a-978b-4894-8165-9ea208e7e4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:12.793320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5159a-978b-4894-8165-9ea208e7e4cd None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:12.793638 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5159a-978b-4894-8165-9ea208e7e4cd None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:12.793915 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5159a-978b-4894-8165-9ea208e7e4cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:12.821630 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 89/179] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:12.822815 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001598b7-168c-457c-90a3-70a5345b238c None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:12.883505 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5159a-978b-4894-8165-9ea208e7e4cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:12.885740 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5159a-978b-4894-8165-9ea208e7e4cd None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:12.929281 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001598b7-168c-457c-90a3-70a5345b238c None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:12.958550 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:12.964115 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:12.975252 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27cb57-4de6-4cd2-8243-23074699d945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:12.975833 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27cb57-4de6-4cd2-8243-23074699d945 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:12.976176 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27cb57-4de6-4cd2-8243-23074699d945 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:12.976524 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27cb57-4de6-4cd2-8243-23074699d945 None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:12.977777 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27cb57-4de6-4cd2-8243-23074699d945 None admin] RBAC: Authorizing `identity:get_project(project_id=92dea89f3bc4436195a8b5f4a64fd785)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:12.979283 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27cb57-4de6-4cd2-8243-23074699d945 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:12.981291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 90/180] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:12 2022] GET /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:12.982626 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d5ac9-f0f3-4de9-b2fb-d91019b48730 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:12.982971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d5ac9-f0f3-4de9-b2fb-d91019b48730 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:12.983302 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d5ac9-f0f3-4de9-b2fb-d91019b48730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:13.003065 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-792d5ac9-f0f3-4de9-b2fb-d91019b48730 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:13.004881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-792d5ac9-f0f3-4de9-b2fb-d91019b48730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:13.052350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 91/181] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:13.053964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5159a-978b-4894-8165-9ea208e7e4cd None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:13.081995 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 91/182] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:13.083081 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d5ac9-f0f3-4de9-b2fb-d91019b48730 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:13.185232 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d5ac9-f0f3-4de9-b2fb-d91019b48730 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:13.189576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5159a-978b-4894-8165-9ea208e7e4cd None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:13.224762 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b1f81-c9bb-417f-80dc-8b68236c5130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:13.224762 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b1f81-c9bb-417f-80dc-8b68236c5130 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:13.224762 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b1f81-c9bb-417f-80dc-8b68236c5130 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:13.224762 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b1f81-c9bb-417f-80dc-8b68236c5130 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:13.225152 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b1f81-c9bb-417f-80dc-8b68236c5130 None admin] RBAC: Adding query filter params (role.id=cd2effe8340d4be08a28d3a40db6979d, scope.project.id=92dea89f3bc4436195a8b5f4a64fd785, user.id=4757bd29ffb0448ca0dc35345a8b1469) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:13.227187 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b1f81-c9bb-417f-80dc-8b68236c5130 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:13.228320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b1f81-c9bb-417f-80dc-8b68236c5130 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:13.233556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:13.235436 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 92/183] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:31:13 2022] GET /identity/v3/role_assignments?user.id=4757bd29ffb0448ca0dc35345a8b1469&scope.project.id=92dea89f3bc4436195a8b5f4a64fd785&role.id=cd2effe8340d4be08a28d3a40db6979d => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:13.244353 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9115e2-3d05-4e18-804f-b80b52604b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:13.245431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9115e2-3d05-4e18-804f-b80b52604b9e None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:13.245936 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9115e2-3d05-4e18-804f-b80b52604b9e None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:13.246501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b1f81-c9bb-417f-80dc-8b68236c5130 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:13.247044 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9115e2-3d05-4e18-804f-b80b52604b9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:13.261161 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9115e2-3d05-4e18-804f-b80b52604b9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:13.269790 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:13.273020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-0b9115e2-3d05-4e18-804f-b80b52604b9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:31:13.273020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:13.273020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:13.273020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:13.273020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:13.273020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:13.273020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:13.273020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:13.273020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:13.273020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:13.273020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:13.273020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:13.273020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:13.273020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:13.273020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:13.273020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:13.274122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:13.274122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:13.274122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:13.274122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:13.274122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:13.274122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:13.274122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:13.274122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:13.274122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:13.274122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:13.274122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:13.274122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:13.274122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:13.274122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:13.274122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:13.274122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:13.275086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:13.275086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:13.275086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:13.275086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:13.275086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:13.275086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:13.275086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:13.275086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:13.275086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:13.275086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:13.275086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:31:13.275086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:13.278768 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 92/184] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:31:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:13.279741 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9115e2-3d05-4e18-804f-b80b52604b9e None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:13.427856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b1f81-c9bb-417f-80dc-8b68236c5130 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:13.475284 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9115e2-3d05-4e18-804f-b80b52604b9e None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:13.476832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd73789-b03b-4327-b8dd-658280fe70c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:13.478388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd73789-b03b-4327-b8dd-658280fe70c3 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:13.478752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd73789-b03b-4327-b8dd-658280fe70c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:13.479108 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd73789-b03b-4327-b8dd-658280fe70c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:13.479917 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd73789-b03b-4327-b8dd-658280fe70c3 None admin] RBAC: Adding query filter params (role.id=6c6a208f837c453cb9aceca635451134, scope.project.id=92dea89f3bc4436195a8b5f4a64fd785, user.id=293b91ba2e5e4247b3d8b1a013fc2242) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:13.480305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd73789-b03b-4327-b8dd-658280fe70c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:13.482150 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd73789-b03b-4327-b8dd-658280fe70c3 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:13.490544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 93/185] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:31:13 2022] GET /identity/v3/role_assignments?user.id=293b91ba2e5e4247b3d8b1a013fc2242&scope.project.id=92dea89f3bc4436195a8b5f4a64fd785&role.id=6c6a208f837c453cb9aceca635451134 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:13.491357 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd73789-b03b-4327-b8dd-658280fe70c3 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:13.517900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c066e-c613-4d62-b779-053c2210d633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:13.518611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c066e-c613-4d62-b779-053c2210d633 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:13.519473 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c066e-c613-4d62-b779-053c2210d633 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:13.519755 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c066e-c613-4d62-b779-053c2210d633 None admin] PATH_INFO: `/v3/projects/594d9be8305242cfb9399197c7df612d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:13.521015 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c066e-c613-4d62-b779-053c2210d633 None admin] RBAC: Authorizing `identity:get_project(project_id=594d9be8305242cfb9399197c7df612d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:13.522532 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c066e-c613-4d62-b779-053c2210d633 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:13.524320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 93/186] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:13 2022] GET /identity/v3/projects/594d9be8305242cfb9399197c7df612d => generated 312 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:13.530270 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c066e-c613-4d62-b779-053c2210d633 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:13.547439 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:13.625551 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd73789-b03b-4327-b8dd-658280fe70c3 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:13.634526 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:13.669967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f1c7c-957f-4234-bc5f-6db20a7a1102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:13.670604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f1c7c-957f-4234-bc5f-6db20a7a1102 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:13.670881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f1c7c-957f-4234-bc5f-6db20a7a1102 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:13.671151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f1c7c-957f-4234-bc5f-6db20a7a1102 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:13.681951 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c066e-c613-4d62-b779-053c2210d633 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:13.685658 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f1c7c-957f-4234-bc5f-6db20a7a1102 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:13.691576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-093f1c7c-957f-4234-bc5f-6db20a7a1102 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:13.691576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:13.691576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:13.691576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:13.691576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:13.691576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:13.691576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:13.691576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:13.691576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:13.691576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:13.691576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:13.691576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:13.691576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:13.691576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:13.691576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:13.691576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:13.692493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:13.692493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:13.692493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:13.692493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:13.692493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:13.692493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:13.692493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:13.692493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:13.692493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:13.692493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:13.692493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:13.692493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:13.692493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:13.692493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:13.692493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:13.692493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:13.693271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:13.693271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:13.693271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:13.693271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:13.693271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:13.693271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:13.693271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:13.693271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:13.693271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:13.693271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:13.693271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:13.693271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:13.693271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 94/187] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 09:31:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:13.698275 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f1c7c-957f-4234-bc5f-6db20a7a1102 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:13.732937 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd1948-f4f1-4660-9af5-cc1b10600f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:13.733653 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd1948-f4f1-4660-9af5-cc1b10600f51 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:13.733766 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd1948-f4f1-4660-9af5-cc1b10600f51 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:13.734029 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd1948-f4f1-4660-9af5-cc1b10600f51 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:13.734706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd1948-f4f1-4660-9af5-cc1b10600f51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:13.735013 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd1948-f4f1-4660-9af5-cc1b10600f51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:13.736520 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd1948-f4f1-4660-9af5-cc1b10600f51 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:13.749916 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 94/188] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:13.750913 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd1948-f4f1-4660-9af5-cc1b10600f51 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:13.826647 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f1c7c-957f-4234-bc5f-6db20a7a1102 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:13.828275 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:13.864937 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d4eba-27f4-4ba3-8a46-6867d9274520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:13.865633 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d4eba-27f4-4ba3-8a46-6867d9274520 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:13.865917 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d4eba-27f4-4ba3-8a46-6867d9274520 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:13.866198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d4eba-27f4-4ba3-8a46-6867d9274520 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:13.867309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d4eba-27f4-4ba3-8a46-6867d9274520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:13.868768 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d4eba-27f4-4ba3-8a46-6867d9274520 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:13.869035 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd1948-f4f1-4660-9af5-cc1b10600f51 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:13.870357 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 95/189] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:31:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:13.871111 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d4eba-27f4-4ba3-8a46-6867d9274520 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:13.904366 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:13.912550 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6cab1-e5b4-426b-90d0-79885cfd2d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:13.912691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6cab1-e5b4-426b-90d0-79885cfd2d41 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:13.912878 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6cab1-e5b4-426b-90d0-79885cfd2d41 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:13.913156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6cab1-e5b4-426b-90d0-79885cfd2d41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:13.913912 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6cab1-e5b4-426b-90d0-79885cfd2d41 None admin] RBAC: Adding query filter params (role.id=ec487838eecf4dc4bde1eaa59af3eb26, scope.project.id=594d9be8305242cfb9399197c7df612d, user.id=293b91ba2e5e4247b3d8b1a013fc2242) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:13.914223 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6cab1-e5b4-426b-90d0-79885cfd2d41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:13.915668 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6cab1-e5b4-426b-90d0-79885cfd2d41 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:13.921504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 95/190] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:31:13 2022] GET /identity/v3/role_assignments?user.id=293b91ba2e5e4247b3d8b1a013fc2242&scope.project.id=594d9be8305242cfb9399197c7df612d&role.id=ec487838eecf4dc4bde1eaa59af3eb26 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:13.922216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6cab1-e5b4-426b-90d0-79885cfd2d41 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:14.019510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d4eba-27f4-4ba3-8a46-6867d9274520 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:14.051517 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6cab1-e5b4-426b-90d0-79885cfd2d41 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:14.062130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405d741-2e73-4aa3-a478-52577e9b996e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:14.062770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405d741-2e73-4aa3-a478-52577e9b996e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:14.063032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405d741-2e73-4aa3-a478-52577e9b996e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:14.063305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405d741-2e73-4aa3-a478-52577e9b996e None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:14.063989 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405d741-2e73-4aa3-a478-52577e9b996e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:14.064292 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405d741-2e73-4aa3-a478-52577e9b996e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:14.065770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405d741-2e73-4aa3-a478-52577e9b996e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:14.079210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 96/191] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:31:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:14.079210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405d741-2e73-4aa3-a478-52577e9b996e None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:14.101592 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380fa5a-6634-4b6c-a5f1-ea3382f423ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:14.102422 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380fa5a-6634-4b6c-a5f1-ea3382f423ea None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:14.102794 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380fa5a-6634-4b6c-a5f1-ea3382f423ea None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:14.103076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380fa5a-6634-4b6c-a5f1-ea3382f423ea None admin] PATH_INFO: `/v3/users/95d7acd5823844fd80716d90e6223519` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:14.123064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380fa5a-6634-4b6c-a5f1-ea3382f423ea None admin] RBAC: Authorizing `identity:get_user(user_id=95d7acd5823844fd80716d90e6223519)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:14.123984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:14.124684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380fa5a-6634-4b6c-a5f1-ea3382f423ea None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:14.126321 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 96/192] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:13 2022] GET /identity/v3/users/95d7acd5823844fd80716d90e6223519 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:14.127227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380fa5a-6634-4b6c-a5f1-ea3382f423ea None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:14.194770 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:14.217684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405d741-2e73-4aa3-a478-52577e9b996e None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:14.255227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380fa5a-6634-4b6c-a5f1-ea3382f423ea None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:14.256998 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9209cb5-4ad3-4408-9ce5-31db80ed494d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:14.258377 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9209cb5-4ad3-4408-9ce5-31db80ed494d None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:14.258377 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9209cb5-4ad3-4408-9ce5-31db80ed494d None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:14.258377 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9209cb5-4ad3-4408-9ce5-31db80ed494d None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:14.258819 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9209cb5-4ad3-4408-9ce5-31db80ed494d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:14.260250 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9209cb5-4ad3-4408-9ce5-31db80ed494d None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:14.283342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 97/193] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 09:31:14 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:31:14.285083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9209cb5-4ad3-4408-9ce5-31db80ed494d None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:14.308494 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8b0e4-647e-4fff-8512-db7c29611737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:14.309243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8b0e4-647e-4fff-8512-db7c29611737 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:14.309724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8b0e4-647e-4fff-8512-db7c29611737 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:14.310074 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8b0e4-647e-4fff-8512-db7c29611737 None admin] PATH_INFO: `/v3/users/95d7acd5823844fd80716d90e6223519` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:14.311386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8b0e4-647e-4fff-8512-db7c29611737 None admin] RBAC: Authorizing `identity:get_user(user_id=95d7acd5823844fd80716d90e6223519)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:14.313097 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8b0e4-647e-4fff-8512-db7c29611737 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:14.315541 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 97/194] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:14 2022] GET /identity/v3/users/95d7acd5823844fd80716d90e6223519 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:14.321810 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8b0e4-647e-4fff-8512-db7c29611737 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:14.414751 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:14.432052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9209cb5-4ad3-4408-9ce5-31db80ed494d None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:14.454689 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8b0e4-647e-4fff-8512-db7c29611737 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:14.479849 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:14.481916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a1e6e-4372-451e-b3ef-3c4b1f8a2b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:14.482852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a1e6e-4372-451e-b3ef-3c4b1f8a2b78 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:14.483334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a1e6e-4372-451e-b3ef-3c4b1f8a2b78 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:14.483812 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a1e6e-4372-451e-b3ef-3c4b1f8a2b78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:14.499582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f28ec9-d999-4a0c-bef3-a796f7ce1430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:14.500197 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f28ec9-d999-4a0c-bef3-a796f7ce1430 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:14.500478 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f28ec9-d999-4a0c-bef3-a796f7ce1430 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:14.500752 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f28ec9-d999-4a0c-bef3-a796f7ce1430 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:14.574743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a1e6e-4372-451e-b3ef-3c4b1f8a2b78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:14.576232 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a1e6e-4372-451e-b3ef-3c4b1f8a2b78 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:14.586385 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f28ec9-d999-4a0c-bef3-a796f7ce1430 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:14.587962 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f28ec9-d999-4a0c-bef3-a796f7ce1430 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:14.699848 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:14.717842 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 98/195] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:14.718608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 98/196] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 09:31:14.719133 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f5f1e-a054-4547-ba0c-e7df72f411c6 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:14.719410 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f5f1e-a054-4547-ba0c-e7df72f411c6 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:14.719685 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f5f1e-a054-4547-ba0c-e7df72f411c6 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:14.720928 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 99/197] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:14.726507 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f5f1e-a054-4547-ba0c-e7df72f411c6 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:14.726657 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f28ec9-d999-4a0c-bef3-a796f7ce1430 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:14.757065 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:14.844979 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f5f1e-a054-4547-ba0c-e7df72f411c6 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:14.868784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f28ec9-d999-4a0c-bef3-a796f7ce1430 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:14.885134 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182ffc0-c51c-435c-a35f-ff45d41d472f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:14.885954 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182ffc0-c51c-435c-a35f-ff45d41d472f None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:14.886335 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182ffc0-c51c-435c-a35f-ff45d41d472f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:14.886706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182ffc0-c51c-435c-a35f-ff45d41d472f None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:14.888016 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182ffc0-c51c-435c-a35f-ff45d41d472f None admin] RBAC: Authorizing `identity:get_project(project_id=fab69605019c4852be1e8f0ff0978774)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:14.889658 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182ffc0-c51c-435c-a35f-ff45d41d472f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:14.891470 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 100/198] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:14 2022] GET /identity/v3/projects/fab69605019c4852be1e8f0ff0978774 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:14.892728 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97965642-c025-4587-9730-29c8fe268305 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:14.893111 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97965642-c025-4587-9730-29c8fe268305 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:14.893527 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97965642-c025-4587-9730-29c8fe268305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:14.911560 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05349f-a1be-483e-9ca1-a1877840cd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:14.912196 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05349f-a1be-483e-9ca1-a1877840cd41 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:14.912474 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05349f-a1be-483e-9ca1-a1877840cd41 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:14.912748 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05349f-a1be-483e-9ca1-a1877840cd41 None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:14.913659 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-97965642-c025-4587-9730-29c8fe268305 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:14.913909 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05349f-a1be-483e-9ca1-a1877840cd41 None admin] RBAC: Authorizing `identity:get_project(project_id=fab69605019c4852be1e8f0ff0978774)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:14.915093 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-97965642-c025-4587-9730-29c8fe268305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:14.915351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05349f-a1be-483e-9ca1-a1877840cd41 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:14.917536 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 99/199] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:14 2022] GET /identity/v3/projects/fab69605019c4852be1e8f0ff0978774 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:14.918323 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05349f-a1be-483e-9ca1-a1877840cd41 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:14.989233 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:15.014588 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 101/200] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:15.015936 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97965642-c025-4587-9730-29c8fe268305 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:15.046767 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:15.077263 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05349f-a1be-483e-9ca1-a1877840cd41 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:15.148300 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6678e-128e-46f3-9fd5-000540410fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:15.148824 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6678e-128e-46f3-9fd5-000540410fd0 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:15.149099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6678e-128e-46f3-9fd5-000540410fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:15.149374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6678e-128e-46f3-9fd5-000540410fd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:15.150148 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6678e-128e-46f3-9fd5-000540410fd0 None admin] RBAC: Adding query filter params (role.id=cd2effe8340d4be08a28d3a40db6979d, scope.project.id=fab69605019c4852be1e8f0ff0978774, user.id=95d7acd5823844fd80716d90e6223519) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:15.150456 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6678e-128e-46f3-9fd5-000540410fd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:15.151911 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6678e-128e-46f3-9fd5-000540410fd0 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:15.155700 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97965642-c025-4587-9730-29c8fe268305 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:15.167832 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 100/201] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:31:14 2022] GET /identity/v3/role_assignments?user.id=95d7acd5823844fd80716d90e6223519&scope.project.id=fab69605019c4852be1e8f0ff0978774&role.id=cd2effe8340d4be08a28d3a40db6979d => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:15.204643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546294e-d17d-4d65-832c-0791dda5174e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:15.205281 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546294e-d17d-4d65-832c-0791dda5174e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:15.205616 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546294e-d17d-4d65-832c-0791dda5174e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:15.205893 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546294e-d17d-4d65-832c-0791dda5174e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:15.206757 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546294e-d17d-4d65-832c-0791dda5174e None admin] RBAC: Adding query filter params (role.id=6c6a208f837c453cb9aceca635451134, scope.project.id=fab69605019c4852be1e8f0ff0978774, user.id=95d7acd5823844fd80716d90e6223519) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:15.207072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546294e-d17d-4d65-832c-0791dda5174e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:15.208628 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546294e-d17d-4d65-832c-0791dda5174e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:15.218367 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 102/202] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:31:15 2022] GET /identity/v3/role_assignments?user.id=95d7acd5823844fd80716d90e6223519&scope.project.id=fab69605019c4852be1e8f0ff0978774&role.id=6c6a208f837c453cb9aceca635451134 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:15.400901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6678e-128e-46f3-9fd5-000540410fd0 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:15.530719 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6678e-128e-46f3-9fd5-000540410fd0 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:15.571050 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b3be3-887d-49e8-8b12-f2a2d7162b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:15.571685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b3be3-887d-49e8-8b12-f2a2d7162b90 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:15.571965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b3be3-887d-49e8-8b12-f2a2d7162b90 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:15.572239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b3be3-887d-49e8-8b12-f2a2d7162b90 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:15.587663 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b3be3-887d-49e8-8b12-f2a2d7162b90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:15.592871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-c70b3be3-887d-49e8-8b12-f2a2d7162b90 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:31:15.592871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:15.592871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:15.592871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:15.592871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:15.592871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:15.592871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:15.592871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:15.592871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:15.592871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:15.592871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:15.592871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:15.592871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:15.592871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:15.592871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:15.592871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:15.593783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:15.593783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:15.593783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:15.593783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:15.593783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:15.593783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:15.593783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:15.593783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:15.593783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:15.593783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:15.593783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:15.593783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:15.593783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:15.593783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:15.593783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:15.593783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:15.594565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:15.594565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:15.594565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:15.594565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:15.594565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:15.594565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:15.594565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:15.594565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:15.594565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:15.594565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:15.594565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:31:15.594565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:15.594565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 101/203] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:15.601557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546294e-d17d-4d65-832c-0791dda5174e None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:15.671785 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:15.735838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546294e-d17d-4d65-832c-0791dda5174e None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:15.774152 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ffe9a-5570-4f13-aa8f-90d97034050f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:15.774894 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ffe9a-5570-4f13-aa8f-90d97034050f None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:15.775180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ffe9a-5570-4f13-aa8f-90d97034050f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:15.775460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ffe9a-5570-4f13-aa8f-90d97034050f None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:15.776140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ffe9a-5570-4f13-aa8f-90d97034050f None admin] RBAC: Adding query filter params (name=reader) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:15.776447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ffe9a-5570-4f13-aa8f-90d97034050f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:15.777848 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ffe9a-5570-4f13-aa8f-90d97034050f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:15.786949 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 103/204] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:15.794776 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b3be3-887d-49e8-8b12-f2a2d7162b90 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:15.832074 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:15.946470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b3be3-887d-49e8-8b12-f2a2d7162b90 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:15.981893 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f551e63-41b6-4ffc-925d-abaf9bf1f111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:15.982626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f551e63-41b6-4ffc-925d-abaf9bf1f111 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:15.982917 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f551e63-41b6-4ffc-925d-abaf9bf1f111 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:15.983194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f551e63-41b6-4ffc-925d-abaf9bf1f111 None admin] PATH_INFO: `/v3/users/593f6ce1e9444c04a9a7be8feffd25f8` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:15.984344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f551e63-41b6-4ffc-925d-abaf9bf1f111 None admin] RBAC: Authorizing `identity:get_user(user_id=593f6ce1e9444c04a9a7be8feffd25f8)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:15.985818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f551e63-41b6-4ffc-925d-abaf9bf1f111 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:15.987960 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 102/205] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:15 2022] GET /identity/v3/users/593f6ce1e9444c04a9a7be8feffd25f8 => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:15.993679 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ffe9a-5570-4f13-aa8f-90d97034050f None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:16.125408 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ffe9a-5570-4f13-aa8f-90d97034050f None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:16.146049 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:16.175855 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296306e5-3177-4c37-8c3f-c03220e3500f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:16.176476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296306e5-3177-4c37-8c3f-c03220e3500f None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:16.176734 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296306e5-3177-4c37-8c3f-c03220e3500f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:16.177007 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296306e5-3177-4c37-8c3f-c03220e3500f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:16.283972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296306e5-3177-4c37-8c3f-c03220e3500f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:16.285517 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296306e5-3177-4c37-8c3f-c03220e3500f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:16.428790 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 104/206] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:16.434363 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f551e63-41b6-4ffc-925d-abaf9bf1f111 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:16.566882 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:16.587434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f551e63-41b6-4ffc-925d-abaf9bf1f111 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:16.632238 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f764ec3-5fe2-4c87-9401-883b5071aec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:16.632879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f764ec3-5fe2-4c87-9401-883b5071aec7 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:16.633162 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f764ec3-5fe2-4c87-9401-883b5071aec7 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:16.633431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f764ec3-5fe2-4c87-9401-883b5071aec7 None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:16.638178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f764ec3-5fe2-4c87-9401-883b5071aec7 None admin] RBAC: Authorizing `identity:get_project(project_id=92dea89f3bc4436195a8b5f4a64fd785)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:16.639712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f764ec3-5fe2-4c87-9401-883b5071aec7 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:16.641388 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 103/207] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:16 2022] GET /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:16.647540 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296306e5-3177-4c37-8c3f-c03220e3500f None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:16.671946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:16.741401 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3426b8-8763-468f-a587-27c072ec1c53 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:16.742078 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3426b8-8763-468f-a587-27c072ec1c53 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:16.742548 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3426b8-8763-468f-a587-27c072ec1c53 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:16.745300 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 104/208] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:31:16.749702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892e2b4-444e-4004-b008-886785641f7a None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:16.750239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892e2b4-444e-4004-b008-886785641f7a None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:16.750710 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892e2b4-444e-4004-b008-886785641f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:16.775895 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-6892e2b4-444e-4004-b008-886785641f7a None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:16.778971 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-6892e2b4-444e-4004-b008-886785641f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:16.793948 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296306e5-3177-4c37-8c3f-c03220e3500f None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:16.844999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21db30d-ea46-438d-aacb-31f3fec9ae82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:16.845644 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21db30d-ea46-438d-aacb-31f3fec9ae82 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:16.845927 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21db30d-ea46-438d-aacb-31f3fec9ae82 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:16.846204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21db30d-ea46-438d-aacb-31f3fec9ae82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:16.847497 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21db30d-ea46-438d-aacb-31f3fec9ae82 None admin] RBAC: Adding query filter params (role.id=791a6ff17232433d820343dc3ceee47a, scope.project.id=92dea89f3bc4436195a8b5f4a64fd785, user.id=593f6ce1e9444c04a9a7be8feffd25f8) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:16.847808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21db30d-ea46-438d-aacb-31f3fec9ae82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:16.849520 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21db30d-ea46-438d-aacb-31f3fec9ae82 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:16.855876 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 105/209] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:31:16 2022] GET /identity/v3/role_assignments?user.id=593f6ce1e9444c04a9a7be8feffd25f8&scope.project.id=92dea89f3bc4436195a8b5f4a64fd785&role.id=791a6ff17232433d820343dc3ceee47a => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:16.861815 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b12e5f-fbc0-4ff9-b1a8-e2f1ebc15b96 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:16.862102 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b12e5f-fbc0-4ff9-b1a8-e2f1ebc15b96 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:16.862382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b12e5f-fbc0-4ff9-b1a8-e2f1ebc15b96 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:16.868878 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 106/210] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:16.871996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9656-f51b-4502-b409-55cf08d5928d None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:16.873933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9656-f51b-4502-b409-55cf08d5928d None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:16.874625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c9656-f51b-4502-b409-55cf08d5928d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:16.900912 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 105/211] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:31:16.913160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-b05c9656-f51b-4502-b409-55cf08d5928d None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:16.914765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-b05c9656-f51b-4502-b409-55cf08d5928d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:17.038130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 107/212] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:31:17.222840 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892e2b4-444e-4004-b008-886785641f7a None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:17.322279 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:17.346601 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892e2b4-444e-4004-b008-886785641f7a None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:17.365709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c9656-f51b-4502-b409-55cf08d5928d None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:17.374532 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:17.387861 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81517e-5d99-45a0-ab95-d6f019a4590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:17.388494 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81517e-5d99-45a0-ab95-d6f019a4590f None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:17.388770 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81517e-5d99-45a0-ab95-d6f019a4590f None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:17.389037 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81517e-5d99-45a0-ab95-d6f019a4590f None admin] PATH_INFO: `/v3/roles/member` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:17.404009 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81517e-5d99-45a0-ab95-d6f019a4590f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:17.408835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-ee81517e-5d99-45a0-ab95-d6f019a4590f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:17.408835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:17.408835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:17.408835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:17.408835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:17.408835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:17.408835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:17.408835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:17.408835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:17.408835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:17.408835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:17.408835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:17.408835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:17.408835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:17.408835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:17.408835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:17.411331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:17.411331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:17.411331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:17.411331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:17.411331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:17.411331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:17.411331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:17.411331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:17.411331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:17.411331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:17.411331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:17.411331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:17.411331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:17.411331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:17.411331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:17.411331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:17.412379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:17.412379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:17.412379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:17.412379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:17.412379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:17.412379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:17.412379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:17.412379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:17.412379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:17.412379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:17.412379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:17.412379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:17.412379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 106/213] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:17.416535 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81517e-5d99-45a0-ab95-d6f019a4590f None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:17.500707 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c9656-f51b-4502-b409-55cf08d5928d None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:17.528978 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81517e-5d99-45a0-ab95-d6f019a4590f None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:17.548169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75709930-77a1-4fa0-986c-1db5fed31f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:17.549669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75709930-77a1-4fa0-986c-1db5fed31f69 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:17.550259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75709930-77a1-4fa0-986c-1db5fed31f69 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:17.550744 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75709930-77a1-4fa0-986c-1db5fed31f69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:17.552643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75709930-77a1-4fa0-986c-1db5fed31f69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:17.554979 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75709930-77a1-4fa0-986c-1db5fed31f69 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:17.561608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 108/214] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:31:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:17.563333 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75709930-77a1-4fa0-986c-1db5fed31f69 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:17.577653 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a74142-9722-40ec-9bd5-5f0b8cbc6c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:17.578450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a74142-9722-40ec-9bd5-5f0b8cbc6c64 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:17.578803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a74142-9722-40ec-9bd5-5f0b8cbc6c64 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:17.579417 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a74142-9722-40ec-9bd5-5f0b8cbc6c64 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:17.580205 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a74142-9722-40ec-9bd5-5f0b8cbc6c64 None admin] RBAC: Adding query filter params (name=member) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:17.580542 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a74142-9722-40ec-9bd5-5f0b8cbc6c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:17.583128 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a74142-9722-40ec-9bd5-5f0b8cbc6c64 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:17.590118 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:17.597601 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 107/215] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:17.600962 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a74142-9722-40ec-9bd5-5f0b8cbc6c64 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:17.672010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:17.700936 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75709930-77a1-4fa0-986c-1db5fed31f69 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:17.731008 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a74142-9722-40ec-9bd5-5f0b8cbc6c64 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:17.738855 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626e0ff-5539-4305-8284-13fa61c17a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:17.739470 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626e0ff-5539-4305-8284-13fa61c17a72 None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:17.739749 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626e0ff-5539-4305-8284-13fa61c17a72 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:17.740026 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626e0ff-5539-4305-8284-13fa61c17a72 None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:17.740684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626e0ff-5539-4305-8284-13fa61c17a72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:17.742172 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626e0ff-5539-4305-8284-13fa61c17a72 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:17.763458 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 109/216] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 09:31:17 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:31:17.764644 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac49a52-5351-41b8-8197-56d02adfe08f None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:17.764890 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac49a52-5351-41b8-8197-56d02adfe08f None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:17.765168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac49a52-5351-41b8-8197-56d02adfe08f None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:17.766624 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 110/217] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:17.767504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753e66c-3c06-46c6-ba9f-aa6170939751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:17.768208 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753e66c-3c06-46c6-ba9f-aa6170939751 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:17.768490 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753e66c-3c06-46c6-ba9f-aa6170939751 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:17.768851 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753e66c-3c06-46c6-ba9f-aa6170939751 None admin] PATH_INFO: `/v3/users/91ad77ba2a874ff8b441d4e6bd83e0a0` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:17.772799 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141d6bc-da59-45bd-890e-6f591beeb9bd None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:17.773090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141d6bc-da59-45bd-890e-6f591beeb9bd None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:17.773379 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141d6bc-da59-45bd-890e-6f591beeb9bd None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:17.774810 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 111/218] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:17.775964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862c41a-6921-4bcd-b604-0777ad07ccbb None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:17.776223 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862c41a-6921-4bcd-b604-0777ad07ccbb None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:17.776576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862c41a-6921-4bcd-b604-0777ad07ccbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:17.794188 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753e66c-3c06-46c6-ba9f-aa6170939751 None admin] RBAC: Authorizing `identity:get_user(user_id=91ad77ba2a874ff8b441d4e6bd83e0a0)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:17.795724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753e66c-3c06-46c6-ba9f-aa6170939751 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:17.797142 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-e862c41a-6921-4bcd-b604-0777ad07ccbb None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:17.803379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 108/219] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:17 2022] GET /identity/v3/users/91ad77ba2a874ff8b441d4e6bd83e0a0 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:17.803565 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-e862c41a-6921-4bcd-b604-0777ad07ccbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:17.803642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c668fd-54ac-43cc-921e-0cc8538f025d None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:17.803642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c668fd-54ac-43cc-921e-0cc8538f025d None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:17.803642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c668fd-54ac-43cc-921e-0cc8538f025d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:17.818649 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-e8c668fd-54ac-43cc-921e-0cc8538f025d None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:17.819925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e8c668fd-54ac-43cc-921e-0cc8538f025d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:17.885325 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:17.885562 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 112/220] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:17.886540 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862c41a-6921-4bcd-b604-0777ad07ccbb None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:17.911455 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 109/221] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:17.962700 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:18.012664 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862c41a-6921-4bcd-b604-0777ad07ccbb None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:18.049831 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb658c-7641-4c5a-a886-7a6922b333e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:18.051231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb658c-7641-4c5a-a886-7a6922b333e7 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:18.051520 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb658c-7641-4c5a-a886-7a6922b333e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:18.051806 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb658c-7641-4c5a-a886-7a6922b333e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:18.125506 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb658c-7641-4c5a-a886-7a6922b333e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:18.126978 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb658c-7641-4c5a-a886-7a6922b333e7 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:18.156012 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c668fd-54ac-43cc-921e-0cc8538f025d None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:18.200600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:18.258195 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 113/222] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:18.258884 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb658c-7641-4c5a-a886-7a6922b333e7 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:18.301259 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c668fd-54ac-43cc-921e-0cc8538f025d None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:18.340616 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e8625-2633-4013-a4e5-b60165649d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:18.341265 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e8625-2633-4013-a4e5-b60165649d7d None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:18.341678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e8625-2633-4013-a4e5-b60165649d7d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:18.341963 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e8625-2633-4013-a4e5-b60165649d7d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:18.353643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e8625-2633-4013-a4e5-b60165649d7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:18.359268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-830e8625-2633-4013-a4e5-b60165649d7d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:18.359268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:18.359268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:18.359268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:18.359268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:18.359268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:18.359268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:18.359268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:18.359268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:18.359268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:18.359268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:18.359268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:18.359268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:18.359268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:18.359268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:18.359268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:18.360129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:18.360129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:18.360129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:18.360129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:18.360129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:18.360129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:18.360129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:18.360129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:18.360129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:18.360129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:18.360129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:18.360129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:18.360129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:18.360129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:18.360129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:18.360129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:18.360901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:18.360901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:18.360901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:18.360901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:18.360901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:18.360901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:18.360901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:18.360901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:18.360901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:18.360901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:18.360901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:18.360901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:18.360901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 110/223] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 09:31:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:31:18.362118 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e8625-2633-4013-a4e5-b60165649d7d None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:18.364647 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb658c-7641-4c5a-a886-7a6922b333e7 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:18.405873 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8a9e1-9b9e-4d3b-839c-c6f83b830a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:18.406659 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8a9e1-9b9e-4d3b-839c-c6f83b830a1c None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:18.406814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8a9e1-9b9e-4d3b-839c-c6f83b830a1c None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:18.407098 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8a9e1-9b9e-4d3b-839c-c6f83b830a1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:18.418980 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:18.423329 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8a9e1-9b9e-4d3b-839c-c6f83b830a1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:18.431915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-0ac8a9e1-9b9e-4d3b-839c-c6f83b830a1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:31:18.431915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:18.431915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:18.431915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:18.431915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:18.431915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:18.431915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:18.431915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:18.431915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:18.431915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:18.431915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:18.431915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:18.431915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:18.431915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:18.431915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:18.431915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:18.434272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:18.434272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:18.434272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:18.434272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:18.434272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:18.434272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:18.434272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:18.434272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:18.434272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:18.434272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:18.434272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:18.434272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:18.434272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:18.434272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:18.434272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:18.434272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:18.436262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:18.436262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:18.436262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:18.436262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:18.436262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:18.436262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:18.436262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:18.436262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:18.436262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:18.436262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:18.436262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:31:18.436262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:18.436262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 114/224] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:31:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:18.436262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8a9e1-9b9e-4d3b-839c-c6f83b830a1c None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:18.465763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:18.482950 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e8625-2633-4013-a4e5-b60165649d7d None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:18.531882 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59dfa2f-a362-4f77-aa70-e7a8ea13bdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:18.532878 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59dfa2f-a362-4f77-aa70-e7a8ea13bdb9 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:18.533172 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59dfa2f-a362-4f77-aa70-e7a8ea13bdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:18.533454 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59dfa2f-a362-4f77-aa70-e7a8ea13bdb9 None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:18.535189 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59dfa2f-a362-4f77-aa70-e7a8ea13bdb9 None admin] RBAC: Authorizing `identity:get_project(project_id=fab69605019c4852be1e8f0ff0978774)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:18.537253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59dfa2f-a362-4f77-aa70-e7a8ea13bdb9 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:18.539522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 111/225] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:18 2022] GET /identity/v3/projects/fab69605019c4852be1e8f0ff0978774 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:18.540648 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59dfa2f-a362-4f77-aa70-e7a8ea13bdb9 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:18.558327 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8a9e1-9b9e-4d3b-839c-c6f83b830a1c None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:18.598146 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974f8f6-0abc-4e70-8702-1c5a8c74033e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:18.599469 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974f8f6-0abc-4e70-8702-1c5a8c74033e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:18.599952 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974f8f6-0abc-4e70-8702-1c5a8c74033e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:18.600455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974f8f6-0abc-4e70-8702-1c5a8c74033e None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:18.601319 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974f8f6-0abc-4e70-8702-1c5a8c74033e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:18.602179 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974f8f6-0abc-4e70-8702-1c5a8c74033e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:18.603970 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974f8f6-0abc-4e70-8702-1c5a8c74033e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:18.615377 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 115/226] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:31:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:18.616499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974f8f6-0abc-4e70-8702-1c5a8c74033e None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:18.658798 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59dfa2f-a362-4f77-aa70-e7a8ea13bdb9 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:18.680694 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:18.695654 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa3c8a-843e-408c-997c-3c9d1a32cea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:18.696413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa3c8a-843e-408c-997c-3c9d1a32cea4 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:18.696794 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa3c8a-843e-408c-997c-3c9d1a32cea4 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:18.697192 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa3c8a-843e-408c-997c-3c9d1a32cea4 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:18.697997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa3c8a-843e-408c-997c-3c9d1a32cea4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:18.698411 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa3c8a-843e-408c-997c-3c9d1a32cea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:18.699918 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa3c8a-843e-408c-997c-3c9d1a32cea4 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:18.708511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 112/227] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:18.709445 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa3c8a-843e-408c-997c-3c9d1a32cea4 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:18.728129 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:18.765656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974f8f6-0abc-4e70-8702-1c5a8c74033e None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:18.815269 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbea29-d991-40e7-add2-cc47a991624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:18.816674 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbea29-d991-40e7-add2-cc47a991624b None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:18.817053 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbea29-d991-40e7-add2-cc47a991624b None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:18.817523 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbea29-d991-40e7-add2-cc47a991624b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:18.818366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebbea29-d991-40e7-add2-cc47a991624b None admin] RBAC: Adding query filter params (role.id=ec487838eecf4dc4bde1eaa59af3eb26, scope.project.id=fab69605019c4852be1e8f0ff0978774, user.id=91ad77ba2a874ff8b441d4e6bd83e0a0) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:18.818796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebbea29-d991-40e7-add2-cc47a991624b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:18.820447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebbea29-d991-40e7-add2-cc47a991624b None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:18.827039 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 116/228] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:31:18 2022] GET /identity/v3/role_assignments?user.id=91ad77ba2a874ff8b441d4e6bd83e0a0&scope.project.id=fab69605019c4852be1e8f0ff0978774&role.id=ec487838eecf4dc4bde1eaa59af3eb26 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:18.827890 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbea29-d991-40e7-add2-cc47a991624b None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:18.841557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa3c8a-843e-408c-997c-3c9d1a32cea4 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:18.890335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6240289-6525-4839-aeb5-e86ab882d986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:18.891253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6240289-6525-4839-aeb5-e86ab882d986 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:18.891532 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6240289-6525-4839-aeb5-e86ab882d986 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:18.891888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6240289-6525-4839-aeb5-e86ab882d986 None admin] PATH_INFO: `/v3/users/95d7acd5823844fd80716d90e6223519` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:18.895624 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6240289-6525-4839-aeb5-e86ab882d986 None admin] RBAC: Authorizing `identity:get_user(user_id=95d7acd5823844fd80716d90e6223519)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:18.897136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6240289-6525-4839-aeb5-e86ab882d986 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:18.901598 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 113/229] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:18 2022] GET /identity/v3/users/95d7acd5823844fd80716d90e6223519 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:18.908592 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6240289-6525-4839-aeb5-e86ab882d986 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:19.021941 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:19.055980 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbea29-d991-40e7-add2-cc47a991624b None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:19.093575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6240289-6525-4839-aeb5-e86ab882d986 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:19.110448 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4906f00-cce3-4076-847b-dddc4f94698a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:19.111095 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4906f00-cce3-4076-847b-dddc4f94698a None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:19.111373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4906f00-cce3-4076-847b-dddc4f94698a None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:19.111645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4906f00-cce3-4076-847b-dddc4f94698a None admin] PATH_INFO: `/v3/users/95d7acd5823844fd80716d90e6223519` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:19.112854 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4906f00-cce3-4076-847b-dddc4f94698a None admin] RBAC: Authorizing `identity:get_user(user_id=95d7acd5823844fd80716d90e6223519)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:19.114325 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4906f00-cce3-4076-847b-dddc4f94698a None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:19.115936 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 117/230] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:18 2022] GET /identity/v3/users/95d7acd5823844fd80716d90e6223519 => generated 283 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:19.121563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4906f00-cce3-4076-847b-dddc4f94698a None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:19.153857 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:19.161014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1f8bf-e733-4af6-84fc-a46655874cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:19.162005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1f8bf-e733-4af6-84fc-a46655874cd7 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:19.162491 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1f8bf-e733-4af6-84fc-a46655874cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:19.162960 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1f8bf-e733-4af6-84fc-a46655874cd7 None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:19.164485 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1f8bf-e733-4af6-84fc-a46655874cd7 None admin] RBAC: Authorizing `identity:get_project(project_id=fab69605019c4852be1e8f0ff0978774)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:19.168258 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1f8bf-e733-4af6-84fc-a46655874cd7 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:19.170720 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 114/231] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:18 2022] GET /identity/v3/projects/fab69605019c4852be1e8f0ff0978774 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:19.177918 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1f8bf-e733-4af6-84fc-a46655874cd7 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:19.344268 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4906f00-cce3-4076-847b-dddc4f94698a None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:19.379303 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1f8bf-e733-4af6-84fc-a46655874cd7 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:19.405997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:19.416111 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f227b47-851a-4e98-8619-3f38fc26145f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:19.417626 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f227b47-851a-4e98-8619-3f38fc26145f None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:19.418297 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f227b47-851a-4e98-8619-3f38fc26145f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:19.418739 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f227b47-851a-4e98-8619-3f38fc26145f None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:19.420097 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f227b47-851a-4e98-8619-3f38fc26145f None admin] RBAC: Authorizing `identity:get_project(project_id=fab69605019c4852be1e8f0ff0978774)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:19.425898 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f227b47-851a-4e98-8619-3f38fc26145f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:19.425898 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 118/232] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:19 2022] GET /identity/v3/projects/fab69605019c4852be1e8f0ff0978774 => generated 302 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:19.434394 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f227b47-851a-4e98-8619-3f38fc26145f None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:19.452689 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf987eb-42c9-4ee9-b106-ce024cbee6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:19.453356 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf987eb-42c9-4ee9-b106-ce024cbee6c5 None admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:19.453660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf987eb-42c9-4ee9-b106-ce024cbee6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:19.453935 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf987eb-42c9-4ee9-b106-ce024cbee6c5 None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774/users/95d7acd5823844fd80716d90e6223519/roles/6c6a208f837c453cb9aceca635451134` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:19.456088 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf987eb-42c9-4ee9-b106-ce024cbee6c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=fab69605019c4852be1e8f0ff0978774, user_id=95d7acd5823844fd80716d90e6223519, role_id=6c6a208f837c453cb9aceca635451134)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:19.458205 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf987eb-42c9-4ee9-b106-ce024cbee6c5 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:19.486253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 115/233] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:31:19 2022] PUT /identity/v3/projects/fab69605019c4852be1e8f0ff0978774/users/95d7acd5823844fd80716d90e6223519/roles/6c6a208f837c453cb9aceca635451134 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:31:19.554089 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:19.574592 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f227b47-851a-4e98-8619-3f38fc26145f None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:19.611746 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663653c-909d-45c2-b7fb-99a27cbd5d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:19.612329 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663653c-909d-45c2-b7fb-99a27cbd5d53 None admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:19.613121 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663653c-909d-45c2-b7fb-99a27cbd5d53 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:19.613395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663653c-909d-45c2-b7fb-99a27cbd5d53 None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774/users/95d7acd5823844fd80716d90e6223519/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:19.615403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663653c-909d-45c2-b7fb-99a27cbd5d53 None admin] RBAC: Authorizing `identity:create_grant(project_id=fab69605019c4852be1e8f0ff0978774, user_id=95d7acd5823844fd80716d90e6223519, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:19.617010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663653c-909d-45c2-b7fb-99a27cbd5d53 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:19.646351 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 119/234] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:31:19 2022] PUT /identity/v3/projects/fab69605019c4852be1e8f0ff0978774/users/95d7acd5823844fd80716d90e6223519/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:31:20.235269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b291e2-99a4-4d74-85a7-3afc383109d3 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:20.235716 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b291e2-99a4-4d74-85a7-3afc383109d3 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:20.235893 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b291e2-99a4-4d74-85a7-3afc383109d3 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:20.237297 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 116/235] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:20.248836 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b31a49-0dcc-4e5e-8714-e6e1ec6cb838 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:20.249122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b31a49-0dcc-4e5e-8714-e6e1ec6cb838 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:20.249394 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b31a49-0dcc-4e5e-8714-e6e1ec6cb838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:20.258748 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806aab2-767d-461f-8cdf-497eb6fe6fad None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:20.259039 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806aab2-767d-461f-8cdf-497eb6fe6fad None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:20.259322 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806aab2-767d-461f-8cdf-497eb6fe6fad None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:20.260669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 117/236] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:20.265915 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146daee-ce99-419a-9dce-53f0d0ed8cd6 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:20.266202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146daee-ce99-419a-9dce-53f0d0ed8cd6 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:20.266470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146daee-ce99-419a-9dce-53f0d0ed8cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:20.289866 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-71b31a49-0dcc-4e5e-8714-e6e1ec6cb838 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:20.291058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-71b31a49-0dcc-4e5e-8714-e6e1ec6cb838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:20.297667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-c146daee-ce99-419a-9dce-53f0d0ed8cd6 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:20.298814 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-c146daee-ce99-419a-9dce-53f0d0ed8cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:20.429685 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 120/237] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:20.439491 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 118/238] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:20.800383 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b31a49-0dcc-4e5e-8714-e6e1ec6cb838 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:20.831085 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146daee-ce99-419a-9dce-53f0d0ed8cd6 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:20.926101 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:20.982413 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b31a49-0dcc-4e5e-8714-e6e1ec6cb838 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:21.026278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146daee-ce99-419a-9dce-53f0d0ed8cd6 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:21.041841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:21.049043 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601fbea-71f4-4967-8bea-8183f19bb38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:21.049715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601fbea-71f4-4967-8bea-8183f19bb38b None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:21.050583 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601fbea-71f4-4967-8bea-8183f19bb38b None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:21.050842 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601fbea-71f4-4967-8bea-8183f19bb38b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:21.071937 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601fbea-71f4-4967-8bea-8183f19bb38b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:21.076879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-e601fbea-71f4-4967-8bea-8183f19bb38b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:31:21.076879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:21.076879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:21.076879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:21.076879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:21.076879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:21.076879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:21.076879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:21.076879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:21.076879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:21.076879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:21.076879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:21.076879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:21.076879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:21.076879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:21.076879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:21.077796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:21.077796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:21.077796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:21.077796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:21.077796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:21.077796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:21.077796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:21.077796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:21.077796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:21.077796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:21.077796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:21.077796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:21.077796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:21.077796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:21.077796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:21.077796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:21.078571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:21.078571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:21.078571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:21.078571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:21.078571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:21.078571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:21.078571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:21.078571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:21.078571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:21.078571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:21.078571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:31:21.078571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:21.080812 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 121/239] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:21.082398 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4515346-c87b-4fa8-89a8-4303c747f433 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:21.082684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4515346-c87b-4fa8-89a8-4303c747f433 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:21.082965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4515346-c87b-4fa8-89a8-4303c747f433 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:21.084254 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 122/240] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:21.087211 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4515346-c87b-4fa8-89a8-4303c747f433 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:21.091363 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c666c36-695d-4858-949e-21097faff38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:21.092008 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c666c36-695d-4858-949e-21097faff38d None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:21.092286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c666c36-695d-4858-949e-21097faff38d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:21.092558 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c666c36-695d-4858-949e-21097faff38d None admin] PATH_INFO: `/v3/domains/default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:21.093708 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c666c36-695d-4858-949e-21097faff38d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:21.095140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c666c36-695d-4858-949e-21097faff38d None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:21.096708 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 119/241] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:31:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:21.101784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f57f4-c1cb-4700-bbb0-f7c5b94cd956 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:21.101784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f57f4-c1cb-4700-bbb0-f7c5b94cd956 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:21.101784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f57f4-c1cb-4700-bbb0-f7c5b94cd956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:21.121901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-232f57f4-c1cb-4700-bbb0-f7c5b94cd956 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:21.123572 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-232f57f4-c1cb-4700-bbb0-f7c5b94cd956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:21.205240 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 120/242] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:21.206530 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f57f4-c1cb-4700-bbb0-f7c5b94cd956 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:21.217838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4515346-c87b-4fa8-89a8-4303c747f433 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:21.252589 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:21.260449 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154365e2-fb8c-4bf0-a8ab-2382f8dba79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:21.261299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154365e2-fb8c-4bf0-a8ab-2382f8dba79e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:21.261922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154365e2-fb8c-4bf0-a8ab-2382f8dba79e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:21.262347 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154365e2-fb8c-4bf0-a8ab-2382f8dba79e None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:21.263250 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154365e2-fb8c-4bf0-a8ab-2382f8dba79e None admin] RBAC: Adding query filter params (name=reader) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:21.263687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154365e2-fb8c-4bf0-a8ab-2382f8dba79e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:21.265329 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154365e2-fb8c-4bf0-a8ab-2382f8dba79e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:21.275398 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 123/243] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:21.280807 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154365e2-fb8c-4bf0-a8ab-2382f8dba79e None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:21.395447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154365e2-fb8c-4bf0-a8ab-2382f8dba79e None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:21.448061 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46800b-abf8-441c-82a5-741f64315495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:21.448721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46800b-abf8-441c-82a5-741f64315495 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:21.448959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46800b-abf8-441c-82a5-741f64315495 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:21.449235 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46800b-abf8-441c-82a5-741f64315495 None admin] PATH_INFO: `/v3/users/4c0909ee8bf94e1ea2b9ea49800d48c4` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:21.477150 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46800b-abf8-441c-82a5-741f64315495 None admin] RBAC: Authorizing `identity:get_user(user_id=4c0909ee8bf94e1ea2b9ea49800d48c4)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:21.479647 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46800b-abf8-441c-82a5-741f64315495 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:21.481340 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 124/244] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:21 2022] GET /identity/v3/users/4c0909ee8bf94e1ea2b9ea49800d48c4 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:21.484342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f57f4-c1cb-4700-bbb0-f7c5b94cd956 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:21.501961 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:21.503247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46800b-abf8-441c-82a5-741f64315495 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:21.548842 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7c3c2-e004-4919-ad09-8a1610bc3814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:21.549573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7c3c2-e004-4919-ad09-8a1610bc3814 None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:21.550660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7c3c2-e004-4919-ad09-8a1610bc3814 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:21.551793 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7c3c2-e004-4919-ad09-8a1610bc3814 None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:21.552449 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7c3c2-e004-4919-ad09-8a1610bc3814 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:21.553960 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7c3c2-e004-4919-ad09-8a1610bc3814 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:21.587818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 121/245] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 09:31:21 2022] POST /identity/v3/users => generated 293 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:31:21.589049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7c3c2-e004-4919-ad09-8a1610bc3814 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:21.592832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:21.680715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46800b-abf8-441c-82a5-741f64315495 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:21.723615 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d94d3-5202-4c52-a9b0-166f68fb366a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:21.724246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d94d3-5202-4c52-a9b0-166f68fb366a None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:21.724529 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d94d3-5202-4c52-a9b0-166f68fb366a None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:21.724806 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d94d3-5202-4c52-a9b0-166f68fb366a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:21.811390 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d94d3-5202-4c52-a9b0-166f68fb366a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:21.812868 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d94d3-5202-4c52-a9b0-166f68fb366a None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:21.845514 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7c3c2-e004-4919-ad09-8a1610bc3814 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:21.881400 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:21.889777 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ba434-8bb7-425e-845b-65d0bc779b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:21.890421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ba434-8bb7-425e-845b-65d0bc779b20 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:21.890707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ba434-8bb7-425e-845b-65d0bc779b20 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:21.890983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ba434-8bb7-425e-845b-65d0bc779b20 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:21.906026 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ba434-8bb7-425e-845b-65d0bc779b20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:21.912441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-3f4ba434-8bb7-425e-845b-65d0bc779b20 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:21.912441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:21.912441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:21.912441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:21.912441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:21.912441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:21.912441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:21.912441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:21.912441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:21.912441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:21.912441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:21.912441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:21.912441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:21.912441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:21.912441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:21.912441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:21.913304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:21.913304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:21.913304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:21.913304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:21.913304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:21.913304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:21.913304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:21.913304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:21.913304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:21.913304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:21.913304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:21.913304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:21.913304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:21.913304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:21.913304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:21.913304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:21.914136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:21.914136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:21.914136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:21.914136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:21.914136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:21.914136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:21.914136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:21.914136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:21.914136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:21.914136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:21.914136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:21.914136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:21.914762 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 122/246] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:21.915815 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f0c40-5085-4a27-9ae8-bafba9806efb None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:21.916095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f0c40-5085-4a27-9ae8-bafba9806efb None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:21.916385 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f0c40-5085-4a27-9ae8-bafba9806efb None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:21.918850 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 123/247] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:21.920912 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f0c40-5085-4a27-9ae8-bafba9806efb None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:21.947163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:21.948117 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 125/248] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 09:31:21.949530 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114635c-4245-4ee2-be2a-8b9facea1a33 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:21.950046 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114635c-4245-4ee2-be2a-8b9facea1a33 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:21.950330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114635c-4245-4ee2-be2a-8b9facea1a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:21.974455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-9114635c-4245-4ee2-be2a-8b9facea1a33 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:21.974455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-9114635c-4245-4ee2-be2a-8b9facea1a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:22.055513 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f0c40-5085-4a27-9ae8-bafba9806efb None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:22.057525 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 126/249] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:22.062905 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114635c-4245-4ee2-be2a-8b9facea1a33 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:22.100644 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fb0c7-ab4f-44e3-972b-58d1a8805718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:22.101634 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fb0c7-ab4f-44e3-972b-58d1a8805718 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:22.102279 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fb0c7-ab4f-44e3-972b-58d1a8805718 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:22.102759 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fb0c7-ab4f-44e3-972b-58d1a8805718 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:22.104414 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fb0c7-ab4f-44e3-972b-58d1a8805718 None admin] RBAC: Adding query filter params (name=member) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:22.104978 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fb0c7-ab4f-44e3-972b-58d1a8805718 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:22.106597 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fb0c7-ab4f-44e3-972b-58d1a8805718 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:22.119589 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 124/250] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:22.121242 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d303ce-8772-4cbc-b0cd-88d7befac075 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:22.121762 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d303ce-8772-4cbc-b0cd-88d7befac075 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:22.122417 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d303ce-8772-4cbc-b0cd-88d7befac075 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:22.124268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 125/251] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:22.125167 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d303ce-8772-4cbc-b0cd-88d7befac075 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:22.168711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:22.190473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114635c-4245-4ee2-be2a-8b9facea1a33 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:22.234667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:22.246267 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d960faa-14ed-4066-a581-0ebab45df47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:22.248897 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d960faa-14ed-4066-a581-0ebab45df47e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:22.249259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d960faa-14ed-4066-a581-0ebab45df47e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:22.249638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d960faa-14ed-4066-a581-0ebab45df47e None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:22.251583 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d960faa-14ed-4066-a581-0ebab45df47e None admin] RBAC: Authorizing `identity:get_project(project_id=fab69605019c4852be1e8f0ff0978774)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:22.253502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d960faa-14ed-4066-a581-0ebab45df47e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:22.255937 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 127/252] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:22 2022] GET /identity/v3/projects/fab69605019c4852be1e8f0ff0978774 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:22.260995 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b66c9-50af-4c9f-95c7-8c03b21b6429 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:22.260995 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b66c9-50af-4c9f-95c7-8c03b21b6429 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:22.260995 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b66c9-50af-4c9f-95c7-8c03b21b6429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:22.271825 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d303ce-8772-4cbc-b0cd-88d7befac075 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:22.279546 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-e84b66c9-50af-4c9f-95c7-8c03b21b6429 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:22.281278 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-e84b66c9-50af-4c9f-95c7-8c03b21b6429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:22.318848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c522d6b-2f44-43fa-a74e-3a63106fb32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:22.320887 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c522d6b-2f44-43fa-a74e-3a63106fb32b None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:22.322419 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c522d6b-2f44-43fa-a74e-3a63106fb32b None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:22.323117 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c522d6b-2f44-43fa-a74e-3a63106fb32b None admin] PATH_INFO: `/v3/users/91ad77ba2a874ff8b441d4e6bd83e0a0` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:22.326277 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c522d6b-2f44-43fa-a74e-3a63106fb32b None admin] RBAC: Authorizing `identity:get_user(user_id=91ad77ba2a874ff8b441d4e6bd83e0a0)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:22.328134 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c522d6b-2f44-43fa-a74e-3a63106fb32b None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:22.331705 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 126/253] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:22 2022] GET /identity/v3/users/91ad77ba2a874ff8b441d4e6bd83e0a0 => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:22.333878 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c522d6b-2f44-43fa-a74e-3a63106fb32b None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:22.412439 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 128/254] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:22.413895 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b66c9-50af-4c9f-95c7-8c03b21b6429 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:22.561764 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:22.568690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c522d6b-2f44-43fa-a74e-3a63106fb32b None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:22.613006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b66c9-50af-4c9f-95c7-8c03b21b6429 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:22.659610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5e2b8-b12a-4b0b-9fa7-93bf9f27bc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:22.659610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5e2b8-b12a-4b0b-9fa7-93bf9f27bc73 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:22.659610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5e2b8-b12a-4b0b-9fa7-93bf9f27bc73 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:22.659610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5e2b8-b12a-4b0b-9fa7-93bf9f27bc73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:22.660926 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5e2b8-b12a-4b0b-9fa7-93bf9f27bc73 None admin] RBAC: Adding query filter params (role.id=791a6ff17232433d820343dc3ceee47a, scope.project.id=fab69605019c4852be1e8f0ff0978774, user.id=4c0909ee8bf94e1ea2b9ea49800d48c4) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:22.661446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5e2b8-b12a-4b0b-9fa7-93bf9f27bc73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:22.664538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5e2b8-b12a-4b0b-9fa7-93bf9f27bc73 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:22.676744 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 127/255] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:31:22 2022] GET /identity/v3/role_assignments?user.id=4c0909ee8bf94e1ea2b9ea49800d48c4&scope.project.id=fab69605019c4852be1e8f0ff0978774&role.id=791a6ff17232433d820343dc3ceee47a => generated 259 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:22.682870 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5e2b8-b12a-4b0b-9fa7-93bf9f27bc73 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:22.733756 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:22.750231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ce93f-96e7-4f9e-8309-5aa6df22c584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:22.751551 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ce93f-96e7-4f9e-8309-5aa6df22c584 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:22.752034 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ce93f-96e7-4f9e-8309-5aa6df22c584 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:22.752521 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ce93f-96e7-4f9e-8309-5aa6df22c584 None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:22.759091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ce93f-96e7-4f9e-8309-5aa6df22c584 None admin] RBAC: Authorizing `identity:get_project(project_id=fab69605019c4852be1e8f0ff0978774)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:22.769501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ce93f-96e7-4f9e-8309-5aa6df22c584 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:22.772930 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 129/256] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:22 2022] GET /identity/v3/projects/fab69605019c4852be1e8f0ff0978774 => generated 302 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:22.774008 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ce93f-96e7-4f9e-8309-5aa6df22c584 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:22.976093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5e2b8-b12a-4b0b-9fa7-93bf9f27bc73 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:23.074463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56322664-1318-4349-9aff-feef6ab953fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:23.075686 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56322664-1318-4349-9aff-feef6ab953fe None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:23.076971 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56322664-1318-4349-9aff-feef6ab953fe None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:23.077450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56322664-1318-4349-9aff-feef6ab953fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:23.109925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ce93f-96e7-4f9e-8309-5aa6df22c584 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:23.112340 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56322664-1318-4349-9aff-feef6ab953fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:23.127293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-56322664-1318-4349-9aff-feef6ab953fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:23.127293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:23.127293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:23.127293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:23.127293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:23.127293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:23.127293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:23.127293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:23.127293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:23.127293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:23.127293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:23.127293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:23.127293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:23.127293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:23.127293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:23.127293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:23.128897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:23.128897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:23.128897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:23.128897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:23.128897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:23.128897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:23.128897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:23.128897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:23.128897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:23.128897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:23.128897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:23.128897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:23.128897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:23.128897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:23.128897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:23.128897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:23.129928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:23.129928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:23.129928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:23.129928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:23.129928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:23.129928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:23.129928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:23.129928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:23.129928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:23.129928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:23.129928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:23.129928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:23.132683 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 128/257] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 09:31:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 450 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:23.139769 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56322664-1318-4349-9aff-feef6ab953fe None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:23.220904 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7309f2-cce3-4007-a029-095a37d7f69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:23.221587 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7309f2-cce3-4007-a029-095a37d7f69e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:23.221907 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7309f2-cce3-4007-a029-095a37d7f69e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:23.222186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7309f2-cce3-4007-a029-095a37d7f69e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:23.255776 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7309f2-cce3-4007-a029-095a37d7f69e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:23.259862 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:23.269676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-9c7309f2-cce3-4007-a029-095a37d7f69e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:31:23.269676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:23.269676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:23.269676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:23.269676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:23.269676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:23.269676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:23.269676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:23.269676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:23.269676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:23.269676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:23.269676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:23.269676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:23.269676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:23.269676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:23.269676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:23.270563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:23.270563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:23.270563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:23.270563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:23.270563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:23.270563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:23.270563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:23.270563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:23.270563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:23.270563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:23.270563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:23.270563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:23.270563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:23.270563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:23.270563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:23.270563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:23.271322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:23.271322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:23.271322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:23.271322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:23.271322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:23.271322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:23.271322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:23.271322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:23.271322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:23.271322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:23.271322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:31:23.271322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:23.271322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 130/258] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:31:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 497 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:23.271960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7309f2-cce3-4007-a029-095a37d7f69e None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:23.304121 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:23.305684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56322664-1318-4349-9aff-feef6ab953fe None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:23.348656 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff6a24-1ceb-43de-948e-bef090938d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:23.349690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff6a24-1ceb-43de-948e-bef090938d52 None admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:23.350172 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff6a24-1ceb-43de-948e-bef090938d52 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:23.350670 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff6a24-1ceb-43de-948e-bef090938d52 None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774/users/91ad77ba2a874ff8b441d4e6bd83e0a0/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:23.352980 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff6a24-1ceb-43de-948e-bef090938d52 None admin] RBAC: Authorizing `identity:create_grant(project_id=fab69605019c4852be1e8f0ff0978774, user_id=91ad77ba2a874ff8b441d4e6bd83e0a0, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:23.354852 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff6a24-1ceb-43de-948e-bef090938d52 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:23.397040 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 129/259] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:31:23 2022] PUT /identity/v3/projects/fab69605019c4852be1e8f0ff0978774/users/91ad77ba2a874ff8b441d4e6bd83e0a0/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:31:23.397932 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff6a24-1ceb-43de-948e-bef090938d52 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:23.531766 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff6a24-1ceb-43de-948e-bef090938d52 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:23.536259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7309f2-cce3-4007-a029-095a37d7f69e None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:23.568925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614a111-68c5-48b6-a984-5734a74f2561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:23.569600 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614a111-68c5-48b6-a984-5734a74f2561 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:23.569835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614a111-68c5-48b6-a984-5734a74f2561 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:23.570111 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614a111-68c5-48b6-a984-5734a74f2561 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:23.570789 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614a111-68c5-48b6-a984-5734a74f2561 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:23.571092 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614a111-68c5-48b6-a984-5734a74f2561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:23.572516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614a111-68c5-48b6-a984-5734a74f2561 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:23.575174 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:23.583161 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 130/260] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:23.591049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614a111-68c5-48b6-a984-5734a74f2561 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:23.654757 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd22c97-7511-407a-af31-b9e2925ec780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:23.655414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd22c97-7511-407a-af31-b9e2925ec780 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:23.655672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd22c97-7511-407a-af31-b9e2925ec780 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:23.655945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd22c97-7511-407a-af31-b9e2925ec780 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:23.656631 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd22c97-7511-407a-af31-b9e2925ec780 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:23.656936 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd22c97-7511-407a-af31-b9e2925ec780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:23.658379 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd22c97-7511-407a-af31-b9e2925ec780 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:23.677493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 131/261] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:31:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:23.686540 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd22c97-7511-407a-af31-b9e2925ec780 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:23.713887 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614a111-68c5-48b6-a984-5734a74f2561 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:23.752303 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a90db-a6dc-41b7-a3fe-eba3eeadc347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:23.757493 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a90db-a6dc-41b7-a3fe-eba3eeadc347 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:23.757493 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a90db-a6dc-41b7-a3fe-eba3eeadc347 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:23.757493 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a90db-a6dc-41b7-a3fe-eba3eeadc347 None admin] PATH_INFO: `/v3/users/95d7acd5823844fd80716d90e6223519` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:23.757493 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a90db-a6dc-41b7-a3fe-eba3eeadc347 None admin] RBAC: Authorizing `identity:get_user(user_id=95d7acd5823844fd80716d90e6223519)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:23.757493 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a90db-a6dc-41b7-a3fe-eba3eeadc347 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:23.759540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 131/262] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:23 2022] GET /identity/v3/users/95d7acd5823844fd80716d90e6223519 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:23.766501 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a90db-a6dc-41b7-a3fe-eba3eeadc347 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:23.812812 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:23.847422 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:23.892394 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a90db-a6dc-41b7-a3fe-eba3eeadc347 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:23.901126 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd22c97-7511-407a-af31-b9e2925ec780 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:23.934027 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2f3b3-73ba-4c60-a370-509f18c7e165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:23.934974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2f3b3-73ba-4c60-a370-509f18c7e165 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:23.935435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2f3b3-73ba-4c60-a370-509f18c7e165 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:23.935908 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2f3b3-73ba-4c60-a370-509f18c7e165 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:23.973869 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c627dd2-89c0-44be-9cc8-572e61524fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:23.975901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c627dd2-89c0-44be-9cc8-572e61524fe9 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:23.976552 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c627dd2-89c0-44be-9cc8-572e61524fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:23.978133 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c627dd2-89c0-44be-9cc8-572e61524fe9 None admin] PATH_INFO: `/v3/users/95d7acd5823844fd80716d90e6223519` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:23.979730 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c627dd2-89c0-44be-9cc8-572e61524fe9 None admin] RBAC: Authorizing `identity:get_user(user_id=95d7acd5823844fd80716d90e6223519)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:23.983231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c627dd2-89c0-44be-9cc8-572e61524fe9 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:23.986518 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 132/263] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:23 2022] GET /identity/v3/users/95d7acd5823844fd80716d90e6223519 => generated 283 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:23.994483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c627dd2-89c0-44be-9cc8-572e61524fe9 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:24.074957 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2f3b3-73ba-4c60-a370-509f18c7e165 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:24.076738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2f3b3-73ba-4c60-a370-509f18c7e165 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:24.169479 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c627dd2-89c0-44be-9cc8-572e61524fe9 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:24.184943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:24.209134 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219dfd7-8ef4-48a5-a3ff-fc2a991c3809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:24.210099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219dfd7-8ef4-48a5-a3ff-fc2a991c3809 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:24.210562 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219dfd7-8ef4-48a5-a3ff-fc2a991c3809 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:24.211015 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219dfd7-8ef4-48a5-a3ff-fc2a991c3809 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:24.220812 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:24.297740 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 132/264] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:24.302940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b790214-2309-4a25-ab56-97db6e158bb0 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:24.302940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b790214-2309-4a25-ab56-97db6e158bb0 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:24.302940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b790214-2309-4a25-ab56-97db6e158bb0 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:24.304680 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 133/265] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:24.305634 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b790214-2309-4a25-ab56-97db6e158bb0 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:24.307413 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219dfd7-8ef4-48a5-a3ff-fc2a991c3809 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:24.309077 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219dfd7-8ef4-48a5-a3ff-fc2a991c3809 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:24.423144 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 133/266] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:24.424338 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28980ce-f7a8-4bb1-92bf-35c0ed837649 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:24.424629 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28980ce-f7a8-4bb1-92bf-35c0ed837649 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:24.425044 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28980ce-f7a8-4bb1-92bf-35c0ed837649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:24.449912 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-f28980ce-f7a8-4bb1-92bf-35c0ed837649 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:24.451376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f28980ce-f7a8-4bb1-92bf-35c0ed837649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:24.467352 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b790214-2309-4a25-ab56-97db6e158bb0 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:24.483940 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:24.508114 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44a10b-1df3-4347-93ca-664d6f3620d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:24.508979 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44a10b-1df3-4347-93ca-664d6f3620d8 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:24.509402 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44a10b-1df3-4347-93ca-664d6f3620d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:24.509876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44a10b-1df3-4347-93ca-664d6f3620d8 None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:24.511255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44a10b-1df3-4347-93ca-664d6f3620d8 None admin] RBAC: Authorizing `identity:get_project(project_id=fab69605019c4852be1e8f0ff0978774)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:24.512935 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44a10b-1df3-4347-93ca-664d6f3620d8 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:24.515027 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 134/267] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:24 2022] GET /identity/v3/projects/fab69605019c4852be1e8f0ff0978774 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:24.516329 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79735ea7-b48a-4f36-ae01-301a972e307f None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:24.516804 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79735ea7-b48a-4f36-ae01-301a972e307f None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:24.517290 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79735ea7-b48a-4f36-ae01-301a972e307f None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:24.519793 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 135/268] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:24.520709 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79735ea7-b48a-4f36-ae01-301a972e307f None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:24.531910 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 134/269] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:24.537640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28980ce-f7a8-4bb1-92bf-35c0ed837649 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:24.577343 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:24.673450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28980ce-f7a8-4bb1-92bf-35c0ed837649 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:24.712279 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6ccfa-046b-418f-bf90-cdf01203d609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:24.713181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6ccfa-046b-418f-bf90-cdf01203d609 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:24.713693 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6ccfa-046b-418f-bf90-cdf01203d609 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:24.714114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6ccfa-046b-418f-bf90-cdf01203d609 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:24.714983 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6ccfa-046b-418f-bf90-cdf01203d609 None admin] RBAC: Adding query filter params (role.id=cd2effe8340d4be08a28d3a40db6979d, scope.project.id=fab69605019c4852be1e8f0ff0978774, user.id=95d7acd5823844fd80716d90e6223519) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:24.715464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6ccfa-046b-418f-bf90-cdf01203d609 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:24.717062 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6ccfa-046b-418f-bf90-cdf01203d609 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:24.724717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 135/270] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:31:24 2022] GET /identity/v3/role_assignments?user.id=95d7acd5823844fd80716d90e6223519&scope.project.id=fab69605019c4852be1e8f0ff0978774&role.id=cd2effe8340d4be08a28d3a40db6979d => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:24.730430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af79b47-190c-46a3-86e3-c342f8f86160 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:24.730899 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af79b47-190c-46a3-86e3-c342f8f86160 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:24.731350 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af79b47-190c-46a3-86e3-c342f8f86160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:24.758772 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79735ea7-b48a-4f36-ae01-301a972e307f None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:24.764967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-1af79b47-190c-46a3-86e3-c342f8f86160 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:24.766465 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-1af79b47-190c-46a3-86e3-c342f8f86160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:24.805396 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:24.873107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c275573-5102-43f3-9369-341fbbe04644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:24.873107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c275573-5102-43f3-9369-341fbbe04644 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:24.873107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c275573-5102-43f3-9369-341fbbe04644 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:24.873107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c275573-5102-43f3-9369-341fbbe04644 None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:24.874619 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c275573-5102-43f3-9369-341fbbe04644 None admin] RBAC: Authorizing `identity:get_project(project_id=fab69605019c4852be1e8f0ff0978774)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:24.877728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c275573-5102-43f3-9369-341fbbe04644 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:24.881415 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 136/271] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:24 2022] GET /identity/v3/projects/fab69605019c4852be1e8f0ff0978774 => generated 302 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:24.882335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c275573-5102-43f3-9369-341fbbe04644 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:24.892653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 136/272] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:24.893553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af79b47-190c-46a3-86e3-c342f8f86160 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:25.068062 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af79b47-190c-46a3-86e3-c342f8f86160 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:25.120537 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c275573-5102-43f3-9369-341fbbe04644 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:25.123171 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:25.132276 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfe2ef-cbd8-414b-bf4d-4a97a54ea515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:25.132904 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfe2ef-cbd8-414b-bf4d-4a97a54ea515 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:25.133185 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfe2ef-cbd8-414b-bf4d-4a97a54ea515 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:25.133457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfe2ef-cbd8-414b-bf4d-4a97a54ea515 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:25.134227 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfe2ef-cbd8-414b-bf4d-4a97a54ea515 None admin] RBAC: Adding query filter params (role.id=6c6a208f837c453cb9aceca635451134, scope.project.id=fab69605019c4852be1e8f0ff0978774, user.id=95d7acd5823844fd80716d90e6223519) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:25.134541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfe2ef-cbd8-414b-bf4d-4a97a54ea515 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:25.135996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfe2ef-cbd8-414b-bf4d-4a97a54ea515 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:25.142766 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 137/273] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:31:24 2022] GET /identity/v3/role_assignments?user.id=95d7acd5823844fd80716d90e6223519&scope.project.id=fab69605019c4852be1e8f0ff0978774&role.id=6c6a208f837c453cb9aceca635451134 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:25.184428 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a5ac4-2fd5-4444-8eb8-d2b80ff09aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:25.185094 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a5ac4-2fd5-4444-8eb8-d2b80ff09aae None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:25.185377 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a5ac4-2fd5-4444-8eb8-d2b80ff09aae None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:25.185676 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a5ac4-2fd5-4444-8eb8-d2b80ff09aae None admin] PATH_INFO: `/v3/roles/member` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:25.206834 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a5ac4-2fd5-4444-8eb8-d2b80ff09aae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:25.211796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-b74a5ac4-2fd5-4444-8eb8-d2b80ff09aae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:25.211796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:25.211796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:25.211796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:25.211796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:25.211796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:25.211796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:25.211796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:25.211796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:25.211796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:25.211796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:25.211796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:25.211796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:25.211796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:25.211796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:25.211796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:25.212725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:25.212725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:25.212725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:25.212725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:25.212725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:25.212725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:25.212725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:25.212725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:25.212725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:25.212725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:25.212725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:25.212725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:25.212725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:25.212725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:25.212725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:25.212725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:25.213540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:25.213540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:25.213540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:25.213540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:25.213540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:25.213540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:25.213540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:25.213540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:25.213540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:25.213540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:25.213540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:25.213540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:25.213540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 137/274] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:25.221057 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfe2ef-cbd8-414b-bf4d-4a97a54ea515 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:25.275340 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:25.324209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a5ac4-2fd5-4444-8eb8-d2b80ff09aae None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:25.379492 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfe2ef-cbd8-414b-bf4d-4a97a54ea515 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:25.430387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd7af0-c9e1-4562-b0f5-9ee10215d8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:25.431011 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd7af0-c9e1-4562-b0f5-9ee10215d8e8 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:25.431293 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd7af0-c9e1-4562-b0f5-9ee10215d8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:25.431566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd7af0-c9e1-4562-b0f5-9ee10215d8e8 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:25.432244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd7af0-c9e1-4562-b0f5-9ee10215d8e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:25.432547 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd7af0-c9e1-4562-b0f5-9ee10215d8e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:25.434456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd7af0-c9e1-4562-b0f5-9ee10215d8e8 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:25.446154 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 138/275] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:25.451671 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd7af0-c9e1-4562-b0f5-9ee10215d8e8 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:25.466609 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a5ac4-2fd5-4444-8eb8-d2b80ff09aae None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:25.511085 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301955c-6394-4ecd-98c0-2310be018aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:25.511728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301955c-6394-4ecd-98c0-2310be018aaf None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:25.512001 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301955c-6394-4ecd-98c0-2310be018aaf None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:25.512272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6301955c-6394-4ecd-98c0-2310be018aaf None admin] PATH_INFO: `/v3/domains/default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:25.513580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301955c-6394-4ecd-98c0-2310be018aaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:25.515149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6301955c-6394-4ecd-98c0-2310be018aaf None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:25.517228 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 138/276] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:31:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:25.522927 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301955c-6394-4ecd-98c0-2310be018aaf None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:25.558464 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:25.572486 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:25.590276 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd7af0-c9e1-4562-b0f5-9ee10215d8e8 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:25.627871 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8d09f-aec9-4dbb-a107-395e90382ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:25.628642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8d09f-aec9-4dbb-a107-395e90382ddb None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:25.628921 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8d09f-aec9-4dbb-a107-395e90382ddb None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:25.629191 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8d09f-aec9-4dbb-a107-395e90382ddb None admin] PATH_INFO: `/v3/users/8ae4d4189afa4bfe95a450cb6e89adb7` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:25.642483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8d09f-aec9-4dbb-a107-395e90382ddb None admin] RBAC: Authorizing `identity:get_user(user_id=8ae4d4189afa4bfe95a450cb6e89adb7)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:25.644550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8d09f-aec9-4dbb-a107-395e90382ddb None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:25.646235 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 139/277] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:25 2022] GET /identity/v3/users/8ae4d4189afa4bfe95a450cb6e89adb7 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:25.647471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44238e-3ff4-4951-b59e-7ca432b2570d None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:25.647753 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44238e-3ff4-4951-b59e-7ca432b2570d None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:25.648024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44238e-3ff4-4951-b59e-7ca432b2570d None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:25.648261 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6301955c-6394-4ecd-98c0-2310be018aaf None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:25.653090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 140/278] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:25.653090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44238e-3ff4-4951-b59e-7ca432b2570d None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:25.693086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd613d-ef92-4e1f-b28b-345df329e951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:25.694080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd613d-ef92-4e1f-b28b-345df329e951 None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:25.694510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd613d-ef92-4e1f-b28b-345df329e951 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:25.694948 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd613d-ef92-4e1f-b28b-345df329e951 None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:25.695865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd613d-ef92-4e1f-b28b-345df329e951 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:25.697616 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd613d-ef92-4e1f-b28b-345df329e951 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:25.726277 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 139/279] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 09:31:25 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:31:25.727732 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24806e-d928-4583-a0ee-c47143c0dcd5 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:25.728166 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24806e-d928-4583-a0ee-c47143c0dcd5 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:25.728616 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24806e-d928-4583-a0ee-c47143c0dcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:25.750742 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-7d24806e-d928-4583-a0ee-c47143c0dcd5 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:25.752231 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7d24806e-d928-4583-a0ee-c47143c0dcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:25.776001 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44238e-3ff4-4951-b59e-7ca432b2570d None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:25.826994 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944b841-14f8-4192-8973-35976598416a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:25.827781 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944b841-14f8-4192-8973-35976598416a None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:25.828152 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944b841-14f8-4192-8973-35976598416a None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:25.828808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944b841-14f8-4192-8973-35976598416a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:25.829642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944b841-14f8-4192-8973-35976598416a None admin] RBAC: Adding query filter params (role.id=ec487838eecf4dc4bde1eaa59af3eb26, user.id=8ae4d4189afa4bfe95a450cb6e89adb7, scope.system=all) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:25.830018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944b841-14f8-4192-8973-35976598416a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:25.832919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944b841-14f8-4192-8973-35976598416a None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:25.845761 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 141/280] 10.222.0.58 () {56 vars in 1308 bytes} [Wed Aug 24 09:31:25 2022] GET /identity/v3/role_assignments?user.id=8ae4d4189afa4bfe95a450cb6e89adb7&scope.system=all&role.id=ec487838eecf4dc4bde1eaa59af3eb26 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:25.848155 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 140/281] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:26.157978 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d47090-1af8-4a0d-98a3-1864473b2188 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:26.158546 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d47090-1af8-4a0d-98a3-1864473b2188 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:26.159041 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d47090-1af8-4a0d-98a3-1864473b2188 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:26.161979 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 142/282] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:26.167845 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d47090-1af8-4a0d-98a3-1864473b2188 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:26.168550 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c0480-bdc9-4c7a-993c-dfd0cca1d3b9 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:26.169178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c0480-bdc9-4c7a-993c-dfd0cca1d3b9 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:26.169494 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c0480-bdc9-4c7a-993c-dfd0cca1d3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:26.184726 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:26.194915 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-369c0480-bdc9-4c7a-993c-dfd0cca1d3b9 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:26.196251 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-369c0480-bdc9-4c7a-993c-dfd0cca1d3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:26.206684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:26.295286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 141/283] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:31:26.343489 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d47090-1af8-4a0d-98a3-1864473b2188 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:26.380415 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c9ece-1649-42d3-a6c6-88b3e75536e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:26.381050 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c9ece-1649-42d3-a6c6-88b3e75536e3 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:26.381332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c9ece-1649-42d3-a6c6-88b3e75536e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:26.381641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c9ece-1649-42d3-a6c6-88b3e75536e3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:26.392823 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c9ece-1649-42d3-a6c6-88b3e75536e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:26.398797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-437c9ece-1649-42d3-a6c6-88b3e75536e3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:31:26.398797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:26.398797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:26.398797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:26.398797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:26.398797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:26.398797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:26.398797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:26.398797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:26.398797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:26.398797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:26.398797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:26.398797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:26.398797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:26.398797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:26.398797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:26.399672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:26.399672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:26.399672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:26.399672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:26.399672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:26.399672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:26.399672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:26.399672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:26.399672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:26.399672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:26.399672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:26.399672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:26.399672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:26.399672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:26.399672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:26.399672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:26.400838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:26.400838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:26.400838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:26.400838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:26.400838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:26.400838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:26.400838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:26.400838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:26.400838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:26.400838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:26.400838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:31:26.400838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:26.400838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 143/284] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:26.406024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c0480-bdc9-4c7a-993c-dfd0cca1d3b9 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:26.531764 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c0480-bdc9-4c7a-993c-dfd0cca1d3b9 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:26.582266 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e87916-e9d2-4e22-a82b-19f55af3c331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:26.582937 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e87916-e9d2-4e22-a82b-19f55af3c331 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:26.583213 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e87916-e9d2-4e22-a82b-19f55af3c331 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:26.583485 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e87916-e9d2-4e22-a82b-19f55af3c331 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:26.584155 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e87916-e9d2-4e22-a82b-19f55af3c331 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:26.584455 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e87916-e9d2-4e22-a82b-19f55af3c331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:26.585845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e87916-e9d2-4e22-a82b-19f55af3c331 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:26.594640 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 142/285] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:26.600299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c9ece-1649-42d3-a6c6-88b3e75536e3 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:26.610946 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e87916-e9d2-4e22-a82b-19f55af3c331 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:26.615188 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:26.738673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e87916-e9d2-4e22-a82b-19f55af3c331 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:26.762987 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:26.784832 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c4900-9071-456b-bda4-aaa741605b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:26.785523 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c4900-9071-456b-bda4-aaa741605b44 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:26.785807 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c4900-9071-456b-bda4-aaa741605b44 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:26.786076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c4900-9071-456b-bda4-aaa741605b44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:26.807033 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c4900-9071-456b-bda4-aaa741605b44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:26.813406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-c80c4900-9071-456b-bda4-aaa741605b44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:26.813406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:26.813406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:26.813406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:26.813406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:26.813406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:26.813406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:26.813406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:26.813406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:26.813406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:26.813406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:26.813406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:26.813406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:26.813406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:26.813406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:26.813406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:26.814276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:26.814276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:26.814276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:26.814276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:26.814276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:26.814276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:26.814276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:26.814276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:26.814276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:26.814276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:26.814276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:26.814276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:26.814276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:26.814276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:26.814276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:26.814276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:26.815045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:26.815045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:26.815045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:26.815045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:26.815045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:26.815045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:26.815045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:26.815045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:26.815045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:26.815045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:26.815045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:26.815045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:26.823268 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c9ece-1649-42d3-a6c6-88b3e75536e3 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:26.824930 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 143/286] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:31:26.825771 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c4900-9071-456b-bda4-aaa741605b44 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:26.880110 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2c8c9-ee48-4bbc-86b4-71647e7fba86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:26.880747 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2c8c9-ee48-4bbc-86b4-71647e7fba86 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:26.881018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2c8c9-ee48-4bbc-86b4-71647e7fba86 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:26.881287 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2c8c9-ee48-4bbc-86b4-71647e7fba86 None admin] PATH_INFO: `/v3/users/4c0909ee8bf94e1ea2b9ea49800d48c4` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:26.883393 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2c8c9-ee48-4bbc-86b4-71647e7fba86 None admin] RBAC: Authorizing `identity:get_user(user_id=4c0909ee8bf94e1ea2b9ea49800d48c4)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:26.884836 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2c8c9-ee48-4bbc-86b4-71647e7fba86 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:26.886649 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 144/287] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:26 2022] GET /identity/v3/users/4c0909ee8bf94e1ea2b9ea49800d48c4 => generated 297 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:26.892279 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2c8c9-ee48-4bbc-86b4-71647e7fba86 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:26.960085 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:27.040701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c4900-9071-456b-bda4-aaa741605b44 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:27.054792 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2c8c9-ee48-4bbc-86b4-71647e7fba86 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:27.095326 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c231a-9ea9-4c86-a44b-d8ba23ba32ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:27.095963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c231a-9ea9-4c86-a44b-d8ba23ba32ed None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:27.096397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c231a-9ea9-4c86-a44b-d8ba23ba32ed None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:27.096672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c231a-9ea9-4c86-a44b-d8ba23ba32ed None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:27.098319 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c231a-9ea9-4c86-a44b-d8ba23ba32ed None admin] RBAC: Authorizing `identity:get_project(project_id=fab69605019c4852be1e8f0ff0978774)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:27.100198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c231a-9ea9-4c86-a44b-d8ba23ba32ed None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:27.102605 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 145/288] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:26 2022] GET /identity/v3/projects/fab69605019c4852be1e8f0ff0978774 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:27.110605 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c231a-9ea9-4c86-a44b-d8ba23ba32ed None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:27.118467 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d7df3-d48a-4c62-88f9-b7b49b2a574f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:27.119099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d7df3-d48a-4c62-88f9-b7b49b2a574f None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:27.119380 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d7df3-d48a-4c62-88f9-b7b49b2a574f None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:27.119656 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d7df3-d48a-4c62-88f9-b7b49b2a574f None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:27.121451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d7df3-d48a-4c62-88f9-b7b49b2a574f None admin] RBAC: Adding query filter params (name=member) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:27.121795 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d7df3-d48a-4c62-88f9-b7b49b2a574f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:27.123195 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d7df3-d48a-4c62-88f9-b7b49b2a574f None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:27.131419 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:27.143946 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 144/289] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:27.148503 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d7df3-d48a-4c62-88f9-b7b49b2a574f None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:27.287026 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c231a-9ea9-4c86-a44b-d8ba23ba32ed None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:27.324063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d7df3-d48a-4c62-88f9-b7b49b2a574f None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:27.354642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:27.355925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be0c80-75d6-46c4-bd0f-4e2e03d60187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:27.356594 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be0c80-75d6-46c4-bd0f-4e2e03d60187 None admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:27.357194 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be0c80-75d6-46c4-bd0f-4e2e03d60187 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:27.357488 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be0c80-75d6-46c4-bd0f-4e2e03d60187 None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774/users/4c0909ee8bf94e1ea2b9ea49800d48c4/roles/791a6ff17232433d820343dc3ceee47a` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:27.359523 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be0c80-75d6-46c4-bd0f-4e2e03d60187 None admin] RBAC: Authorizing `identity:create_grant(project_id=fab69605019c4852be1e8f0ff0978774, user_id=4c0909ee8bf94e1ea2b9ea49800d48c4, role_id=791a6ff17232433d820343dc3ceee47a)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:27.364845 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be0c80-75d6-46c4-bd0f-4e2e03d60187 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:27.368648 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae7292-c146-4c28-9d86-3d9fa677b3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:27.369313 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae7292-c146-4c28-9d86-3d9fa677b3d5 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:27.369635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae7292-c146-4c28-9d86-3d9fa677b3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:27.369895 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae7292-c146-4c28-9d86-3d9fa677b3d5 None admin] PATH_INFO: `/v3/users/91ad77ba2a874ff8b441d4e6bd83e0a0` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:27.371032 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae7292-c146-4c28-9d86-3d9fa677b3d5 None admin] RBAC: Authorizing `identity:get_user(user_id=91ad77ba2a874ff8b441d4e6bd83e0a0)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:27.372517 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae7292-c146-4c28-9d86-3d9fa677b3d5 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:27.374810 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 145/290] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:27 2022] GET /identity/v3/users/91ad77ba2a874ff8b441d4e6bd83e0a0 => generated 297 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:27.386049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae7292-c146-4c28-9d86-3d9fa677b3d5 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:27.389753 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 146/291] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:31:27 2022] PUT /identity/v3/projects/fab69605019c4852be1e8f0ff0978774/users/4c0909ee8bf94e1ea2b9ea49800d48c4/roles/791a6ff17232433d820343dc3ceee47a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:31:27.530322 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae7292-c146-4c28-9d86-3d9fa677b3d5 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:27.586645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0be31-2912-45a8-b6de-80c83b1d6fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:27.587268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0be31-2912-45a8-b6de-80c83b1d6fbc None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:27.587548 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0be31-2912-45a8-b6de-80c83b1d6fbc None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:27.587819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0be31-2912-45a8-b6de-80c83b1d6fbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:27.669567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:27.679248 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0be31-2912-45a8-b6de-80c83b1d6fbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:27.680713 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0be31-2912-45a8-b6de-80c83b1d6fbc None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:27.825152 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 146/292] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:27.831824 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be0c80-75d6-46c4-bd0f-4e2e03d60187 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:27.949107 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:27.988728 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be0c80-75d6-46c4-bd0f-4e2e03d60187 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:28.040496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792a3f9-441b-4478-bb49-6a96d43c4629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:28.041493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792a3f9-441b-4478-bb49-6a96d43c4629 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:28.042016 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792a3f9-441b-4478-bb49-6a96d43c4629 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:28.042480 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792a3f9-441b-4478-bb49-6a96d43c4629 None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:28.043937 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792a3f9-441b-4478-bb49-6a96d43c4629 None admin] RBAC: Authorizing `identity:get_project(project_id=fab69605019c4852be1e8f0ff0978774)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:28.045759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792a3f9-441b-4478-bb49-6a96d43c4629 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:28.047772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 147/293] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:27 2022] GET /identity/v3/projects/fab69605019c4852be1e8f0ff0978774 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:28.054393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0be31-2912-45a8-b6de-80c83b1d6fbc None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:28.104242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd7697-b3a5-46c7-ab7e-924103fa82b8 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:28.104863 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd7697-b3a5-46c7-ab7e-924103fa82b8 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:28.105330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd7697-b3a5-46c7-ab7e-924103fa82b8 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:28.107463 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 148/294] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:28.120775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938ced9-3269-4fab-9a0c-97672c265a44 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:28.121340 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938ced9-3269-4fab-9a0c-97672c265a44 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:28.121835 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938ced9-3269-4fab-9a0c-97672c265a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:28.148467 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-a938ced9-3269-4fab-9a0c-97672c265a44 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:28.150782 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a938ced9-3269-4fab-9a0c-97672c265a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:28.240291 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:28.248497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0be31-2912-45a8-b6de-80c83b1d6fbc None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:28.256192 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 149/295] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:28.257827 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9ad08-c952-4daf-8d89-6c55a9c0bdfe None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:28.258327 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9ad08-c952-4daf-8d89-6c55a9c0bdfe None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:28.258814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9ad08-c952-4daf-8d89-6c55a9c0bdfe None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:28.260245 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 150/296] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:28.270963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dcb9a-6cad-4861-abea-4242361d5042 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:28.271512 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dcb9a-6cad-4861-abea-4242361d5042 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:28.272014 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dcb9a-6cad-4861-abea-4242361d5042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:28.310460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-c43dcb9a-6cad-4861-abea-4242361d5042 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:28.313942 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-c43dcb9a-6cad-4861-abea-4242361d5042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:28.321225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bccbf-7f79-4ae5-b0ae-b72d407bd368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:28.325787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bccbf-7f79-4ae5-b0ae-b72d407bd368 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:28.326285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bccbf-7f79-4ae5-b0ae-b72d407bd368 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:28.326770 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bccbf-7f79-4ae5-b0ae-b72d407bd368 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:28.327689 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bccbf-7f79-4ae5-b0ae-b72d407bd368 None admin] RBAC: Adding query filter params (role.id=ec487838eecf4dc4bde1eaa59af3eb26, scope.project.id=fab69605019c4852be1e8f0ff0978774, user.id=91ad77ba2a874ff8b441d4e6bd83e0a0) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:28.328191 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bccbf-7f79-4ae5-b0ae-b72d407bd368 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:28.331619 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bccbf-7f79-4ae5-b0ae-b72d407bd368 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:28.345103 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 147/297] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:31:28 2022] GET /identity/v3/role_assignments?user.id=91ad77ba2a874ff8b441d4e6bd83e0a0&scope.project.id=fab69605019c4852be1e8f0ff0978774&role.id=ec487838eecf4dc4bde1eaa59af3eb26 => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:28.405280 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:28.423444 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 151/298] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:31:28.492252 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d30a7-4aeb-467f-987e-d7848cbd20af None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:28.492871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d30a7-4aeb-467f-987e-d7848cbd20af None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:28.493336 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d30a7-4aeb-467f-987e-d7848cbd20af None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:28.495390 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 148/299] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:28.500723 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665ae8c-f601-4092-9e69-1d6295eeb523 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:28.501011 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665ae8c-f601-4092-9e69-1d6295eeb523 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:28.501267 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665ae8c-f601-4092-9e69-1d6295eeb523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:28.522716 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-4665ae8c-f601-4092-9e69-1d6295eeb523 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:28.523999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-4665ae8c-f601-4092-9e69-1d6295eeb523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:28.598511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 152/300] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:28.607845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d30a7-4aeb-467f-987e-d7848cbd20af None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:28.723936 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d30a7-4aeb-467f-987e-d7848cbd20af None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:28.736608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665ae8c-f601-4092-9e69-1d6295eeb523 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:28.769987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cb3b8-d74d-4c30-bd17-77d6595f90e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:28.770830 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cb3b8-d74d-4c30-bd17-77d6595f90e2 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:28.771117 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cb3b8-d74d-4c30-bd17-77d6595f90e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:28.771395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cb3b8-d74d-4c30-bd17-77d6595f90e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:28.790240 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3cb3b8-d74d-4c30-bd17-77d6595f90e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:28.797586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-1e3cb3b8-d74d-4c30-bd17-77d6595f90e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:31:28.797586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:28.797586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:28.797586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:28.797586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:28.797586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:28.797586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:28.797586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:28.797586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:28.797586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:28.797586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:28.797586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:28.797586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:28.797586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:28.797586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:28.797586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:28.798451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:28.798451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:28.798451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:28.798451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:28.798451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:28.798451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:28.798451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:28.798451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:28.798451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:28.798451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:28.798451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:28.798451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:28.798451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:28.798451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:28.798451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:28.798451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:28.799225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:28.799225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:28.799225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:28.799225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:28.799225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:28.799225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:28.799225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:28.799225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:28.799225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:28.799225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:28.799225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:31:28.799225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:28.799853 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 149/301] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:28.805944 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cb3b8-d74d-4c30-bd17-77d6595f90e2 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:28.837561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:28.873636 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665ae8c-f601-4092-9e69-1d6295eeb523 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:28.906466 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:28.921997 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b268fa3-1ba3-4935-800f-86ab56e6ab3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:28.922623 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b268fa3-1ba3-4935-800f-86ab56e6ab3e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:28.922910 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b268fa3-1ba3-4935-800f-86ab56e6ab3e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:28.923164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b268fa3-1ba3-4935-800f-86ab56e6ab3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:28.934212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b268fa3-1ba3-4935-800f-86ab56e6ab3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:28.937670 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cb3b8-d74d-4c30-bd17-77d6595f90e2 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:28.938840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-5b268fa3-1ba3-4935-800f-86ab56e6ab3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:28.938840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:28.938840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:28.938840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:28.938840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:28.938840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:28.938840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:28.938840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:28.938840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:28.938840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:28.938840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:28.938840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:28.938840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:28.938840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:28.938840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:28.938840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:28.939721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:28.939721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:28.939721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:28.939721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:28.939721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:28.939721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:28.939721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:28.939721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:28.939721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:28.939721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:28.939721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:28.939721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:28.939721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:28.939721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:28.939721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:28.939721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:28.941040 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:28.941040 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:28.941040 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:28.941040 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:28.941040 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:28.941040 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:28.941040 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:28.941040 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:28.941040 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:28.941040 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:28.941040 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:28.941040 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:28.941040 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 153/302] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:28.942543 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b268fa3-1ba3-4935-800f-86ab56e6ab3e None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:28.978636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1cabe-8d3a-4627-8cfe-3600ca3b486f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:28.979181 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1cabe-8d3a-4627-8cfe-3600ca3b486f None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:28.979456 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1cabe-8d3a-4627-8cfe-3600ca3b486f None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:28.979926 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1cabe-8d3a-4627-8cfe-3600ca3b486f None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:28.980374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1cabe-8d3a-4627-8cfe-3600ca3b486f None admin] RBAC: Adding query filter params (name=reader) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:28.980766 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1cabe-8d3a-4627-8cfe-3600ca3b486f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:28.982396 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1cabe-8d3a-4627-8cfe-3600ca3b486f None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:28.995667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 150/303] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:28.995667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1cabe-8d3a-4627-8cfe-3600ca3b486f None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:29.057928 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b268fa3-1ba3-4935-800f-86ab56e6ab3e None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:29.083148 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:29.097411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197371c4-2c94-4a87-b97f-2968c1e97a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:29.098101 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197371c4-2c94-4a87-b97f-2968c1e97a19 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:29.098383 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197371c4-2c94-4a87-b97f-2968c1e97a19 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:29.098665 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197371c4-2c94-4a87-b97f-2968c1e97a19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:29.099798 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197371c4-2c94-4a87-b97f-2968c1e97a19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:29.101433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197371c4-2c94-4a87-b97f-2968c1e97a19 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:29.103068 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 154/304] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:31:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:29.103829 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197371c4-2c94-4a87-b97f-2968c1e97a19 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:29.112378 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1cabe-8d3a-4627-8cfe-3600ca3b486f None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:29.148125 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662e53b-400d-46f3-af27-0bf0e2040425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:29.148726 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662e53b-400d-46f3-af27-0bf0e2040425 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:29.149002 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662e53b-400d-46f3-af27-0bf0e2040425 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:29.149272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662e53b-400d-46f3-af27-0bf0e2040425 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:29.149953 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662e53b-400d-46f3-af27-0bf0e2040425 None admin] RBAC: Adding query filter params (name=member) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:29.150260 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662e53b-400d-46f3-af27-0bf0e2040425 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:29.151657 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662e53b-400d-46f3-af27-0bf0e2040425 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:29.159890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 151/305] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:29.160715 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662e53b-400d-46f3-af27-0bf0e2040425 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:29.171133 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:29.228600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197371c4-2c94-4a87-b97f-2968c1e97a19 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:29.270937 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9173dd7-411b-4d8e-819e-ea0ecef38479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:29.271737 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9173dd7-411b-4d8e-819e-ea0ecef38479 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:29.272144 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9173dd7-411b-4d8e-819e-ea0ecef38479 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:29.272557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9173dd7-411b-4d8e-819e-ea0ecef38479 None admin] PATH_INFO: `/v3/users/ff9fdf8d2dbe4d20911f815050eba8b7` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:29.279810 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662e53b-400d-46f3-af27-0bf0e2040425 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:29.286972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9173dd7-411b-4d8e-819e-ea0ecef38479 None admin] RBAC: Authorizing `identity:get_user(user_id=ff9fdf8d2dbe4d20911f815050eba8b7)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:29.288526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9173dd7-411b-4d8e-819e-ea0ecef38479 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:29.295069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 155/306] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:29 2022] GET /identity/v3/users/ff9fdf8d2dbe4d20911f815050eba8b7 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:29.295069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9173dd7-411b-4d8e-819e-ea0ecef38479 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:29.323047 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b3ea0-46b4-41ec-85a6-8e5f7867bbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:29.323888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b3ea0-46b4-41ec-85a6-8e5f7867bbe9 None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:29.324421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b3ea0-46b4-41ec-85a6-8e5f7867bbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:29.324756 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b3ea0-46b4-41ec-85a6-8e5f7867bbe9 None admin] PATH_INFO: `/v3/groups` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:29.325558 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b3ea0-46b4-41ec-85a6-8e5f7867bbe9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:29.327668 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b3ea0-46b4-41ec-85a6-8e5f7867bbe9 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:29.347660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 152/307] 10.222.0.58 () {60 vars in 1134 bytes} [Wed Aug 24 09:31:29 2022] POST /identity/v3/groups => generated 229 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:31:29.348518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b3ea0-46b4-41ec-85a6-8e5f7867bbe9 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:29.360230 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:29.431793 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9173dd7-411b-4d8e-819e-ea0ecef38479 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:29.446447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:29.474018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4965f-acb2-43c1-8c15-e67b061b66e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:29.474785 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4965f-acb2-43c1-8c15-e67b061b66e2 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:29.475136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4965f-acb2-43c1-8c15-e67b061b66e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:29.475485 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4965f-acb2-43c1-8c15-e67b061b66e2 None admin] PATH_INFO: `/v3/users/8ae4d4189afa4bfe95a450cb6e89adb7` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:29.476907 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4965f-acb2-43c1-8c15-e67b061b66e2 None admin] RBAC: Authorizing `identity:get_user(user_id=8ae4d4189afa4bfe95a450cb6e89adb7)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:29.478762 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4965f-acb2-43c1-8c15-e67b061b66e2 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:29.481608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 156/308] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:29 2022] GET /identity/v3/users/8ae4d4189afa4bfe95a450cb6e89adb7 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:29.490788 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4965f-acb2-43c1-8c15-e67b061b66e2 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:29.503468 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b3ea0-46b4-41ec-85a6-8e5f7867bbe9 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:29.546697 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074ea8e-b5bf-47a9-9a2c-79f7001dbe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:29.547309 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074ea8e-b5bf-47a9-9a2c-79f7001dbe8b None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:29.547809 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074ea8e-b5bf-47a9-9a2c-79f7001dbe8b None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:29.547981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074ea8e-b5bf-47a9-9a2c-79f7001dbe8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:29.548697 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074ea8e-b5bf-47a9-9a2c-79f7001dbe8b None admin] RBAC: Adding query filter params (role.id=791a6ff17232433d820343dc3ceee47a, user.id=ff9fdf8d2dbe4d20911f815050eba8b7, scope.system=all) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:29.548990 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074ea8e-b5bf-47a9-9a2c-79f7001dbe8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:29.550583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074ea8e-b5bf-47a9-9a2c-79f7001dbe8b None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:29.556986 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 153/309] 10.222.0.58 () {56 vars in 1308 bytes} [Wed Aug 24 09:31:29 2022] GET /identity/v3/role_assignments?user.id=ff9fdf8d2dbe4d20911f815050eba8b7&scope.system=all&role.id=791a6ff17232433d820343dc3ceee47a => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:29.622885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4965f-acb2-43c1-8c15-e67b061b66e2 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:29.663213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4fa67-184e-4245-a5d6-5c2500a1c038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:29.664256 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4fa67-184e-4245-a5d6-5c2500a1c038 None admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:29.664832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4fa67-184e-4245-a5d6-5c2500a1c038 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:29.665318 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4fa67-184e-4245-a5d6-5c2500a1c038 None admin] PATH_INFO: `/v3/system/users/8ae4d4189afa4bfe95a450cb6e89adb7/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:29.667095 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4fa67-184e-4245-a5d6-5c2500a1c038 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8ae4d4189afa4bfe95a450cb6e89adb7, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:29.668728 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4fa67-184e-4245-a5d6-5c2500a1c038 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:29.679755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 157/310] 10.222.0.58 () {58 vars in 1334 bytes} [Wed Aug 24 09:31:29 2022] PUT /identity/v3/system/users/8ae4d4189afa4bfe95a450cb6e89adb7/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:31:29.787308 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5373503-6449-45c8-8f1d-38f1c425d4fd None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:29.787632 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5373503-6449-45c8-8f1d-38f1c425d4fd None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:29.787862 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5373503-6449-45c8-8f1d-38f1c425d4fd None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:29.789249 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 154/311] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:29.795226 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb66755-a741-4e1d-9490-e66990bfc514 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:29.795672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb66755-a741-4e1d-9490-e66990bfc514 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:29.796047 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb66755-a741-4e1d-9490-e66990bfc514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:29.815883 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-3bb66755-a741-4e1d-9490-e66990bfc514 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:29.817117 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-3bb66755-a741-4e1d-9490-e66990bfc514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:29.854673 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:29.890378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 158/312] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:30.166218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5373503-6449-45c8-8f1d-38f1c425d4fd None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:30.234697 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:30.273134 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5373503-6449-45c8-8f1d-38f1c425d4fd None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:30.308429 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354c71d-9128-491b-8274-04baf41f8ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:30.309310 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354c71d-9128-491b-8274-04baf41f8ef0 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:30.309792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354c71d-9128-491b-8274-04baf41f8ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:30.310243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354c71d-9128-491b-8274-04baf41f8ef0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:30.320754 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354c71d-9128-491b-8274-04baf41f8ef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:30.326320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-9354c71d-9128-491b-8274-04baf41f8ef0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:31:30.326320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:30.326320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:30.326320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:30.326320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:30.326320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:30.326320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:30.326320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:30.326320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:30.326320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:30.326320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:30.326320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:30.326320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:30.326320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:30.326320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:30.326320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:30.327193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:30.327193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:30.327193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:30.327193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:30.327193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:30.327193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:30.327193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:30.327193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:30.327193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:30.327193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:30.327193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:30.327193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:30.327193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:30.327193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:30.327193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:30.327193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:30.327981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:30.327981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:30.327981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:30.327981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:30.327981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:30.327981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:30.327981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:30.327981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:30.327981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:30.327981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:30.327981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:31:30.327981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:30.330140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 155/313] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:30.337486 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb66755-a741-4e1d-9490-e66990bfc514 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:30.437158 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb66755-a741-4e1d-9490-e66990bfc514 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:30.470865 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af908c5-8858-44fe-b329-75a3700b40b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:30.471468 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af908c5-8858-44fe-b329-75a3700b40b5 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:30.472370 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af908c5-8858-44fe-b329-75a3700b40b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:30.472573 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af908c5-8858-44fe-b329-75a3700b40b5 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:30.473208 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af908c5-8858-44fe-b329-75a3700b40b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:30.473531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af908c5-8858-44fe-b329-75a3700b40b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:30.474964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af908c5-8858-44fe-b329-75a3700b40b5 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:30.483724 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 159/314] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:30.489801 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354c71d-9128-491b-8274-04baf41f8ef0 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:30.597354 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354c71d-9128-491b-8274-04baf41f8ef0 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:30.623228 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:30.633980 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d89f57-c982-4ca1-8139-62e0debbfeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:30.634649 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d89f57-c982-4ca1-8139-62e0debbfeb5 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:30.634929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d89f57-c982-4ca1-8139-62e0debbfeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:30.635198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d89f57-c982-4ca1-8139-62e0debbfeb5 None admin] PATH_INFO: `/v3/users/4c0909ee8bf94e1ea2b9ea49800d48c4` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:30.636329 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d89f57-c982-4ca1-8139-62e0debbfeb5 None admin] RBAC: Authorizing `identity:get_user(user_id=4c0909ee8bf94e1ea2b9ea49800d48c4)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:30.637907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d89f57-c982-4ca1-8139-62e0debbfeb5 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:30.639834 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 156/315] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:30 2022] GET /identity/v3/users/4c0909ee8bf94e1ea2b9ea49800d48c4 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:30.645790 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af908c5-8858-44fe-b329-75a3700b40b5 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:30.689388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:30.766820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af908c5-8858-44fe-b329-75a3700b40b5 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:30.802058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb649f-dd4b-4cad-89f2-3218e6dbebce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:30.802882 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb649f-dd4b-4cad-89f2-3218e6dbebce None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:30.803307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb649f-dd4b-4cad-89f2-3218e6dbebce None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:30.803726 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb649f-dd4b-4cad-89f2-3218e6dbebce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:30.874938 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb649f-dd4b-4cad-89f2-3218e6dbebce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:30.876665 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb649f-dd4b-4cad-89f2-3218e6dbebce None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:30.911875 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:30.980622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 160/316] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:30.986418 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d89f57-c982-4ca1-8139-62e0debbfeb5 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:31.091193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d89f57-c982-4ca1-8139-62e0debbfeb5 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:31.128956 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecc313-972a-4c9f-8900-7036ea113502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:31.129929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecc313-972a-4c9f-8900-7036ea113502 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:31.130219 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecc313-972a-4c9f-8900-7036ea113502 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:31.130502 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecc313-972a-4c9f-8900-7036ea113502 None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:31.131690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ecc313-972a-4c9f-8900-7036ea113502 None admin] RBAC: Authorizing `identity:get_project(project_id=fab69605019c4852be1e8f0ff0978774)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:31.133156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ecc313-972a-4c9f-8900-7036ea113502 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:31.135142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 157/317] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:30 2022] GET /identity/v3/projects/fab69605019c4852be1e8f0ff0978774 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:31.141739 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb649f-dd4b-4cad-89f2-3218e6dbebce None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:31.249203 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb649f-dd4b-4cad-89f2-3218e6dbebce None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:31.285569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba5d8d-f7ea-4974-bf83-6638fa1167fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:31.286179 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba5d8d-f7ea-4974-bf83-6638fa1167fe None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:31.286457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba5d8d-f7ea-4974-bf83-6638fa1167fe None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:31.286730 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba5d8d-f7ea-4974-bf83-6638fa1167fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:31.287454 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba5d8d-f7ea-4974-bf83-6638fa1167fe None admin] RBAC: Adding query filter params (role.id=791a6ff17232433d820343dc3ceee47a, scope.project.id=fab69605019c4852be1e8f0ff0978774, user.id=4c0909ee8bf94e1ea2b9ea49800d48c4) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:31.287761 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba5d8d-f7ea-4974-bf83-6638fa1167fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:31.289202 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba5d8d-f7ea-4974-bf83-6638fa1167fe None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:31.291071 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:31.296044 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 161/318] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:31:31 2022] GET /identity/v3/role_assignments?user.id=4c0909ee8bf94e1ea2b9ea49800d48c4&scope.project.id=fab69605019c4852be1e8f0ff0978774&role.id=791a6ff17232433d820343dc3ceee47a => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:31.536694 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca0d10-cd20-44d0-9459-b667b687ace8 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:31.537176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca0d10-cd20-44d0-9459-b667b687ace8 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:31.537176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca0d10-cd20-44d0-9459-b667b687ace8 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:31.538804 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 158/319] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:31.543878 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d527ec-9785-4148-add8-53003aecf88d None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:31.544165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d527ec-9785-4148-add8-53003aecf88d None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:31.544441 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d527ec-9785-4148-add8-53003aecf88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:31.563232 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-a4d527ec-9785-4148-add8-53003aecf88d None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:31.564420 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a4d527ec-9785-4148-add8-53003aecf88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:31.590376 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306a4d0-2fd5-4e19-9817-a0c95963bf96 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:31.590655 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306a4d0-2fd5-4e19-9817-a0c95963bf96 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:31.591106 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306a4d0-2fd5-4e19-9817-a0c95963bf96 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:31.592449 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 159/320] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:31:31.597553 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee15cd5-64f5-4038-9ca6-e0ccdb7f3dc7 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:31.597842 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee15cd5-64f5-4038-9ca6-e0ccdb7f3dc7 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:31.598123 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee15cd5-64f5-4038-9ca6-e0ccdb7f3dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:31.616320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-eee15cd5-64f5-4038-9ca6-e0ccdb7f3dc7 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:31.617551 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-eee15cd5-64f5-4038-9ca6-e0ccdb7f3dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:31.637242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 162/321] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:31.673574 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:31.685517 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 160/322] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:31:31.714555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d90d6-ee21-46b7-97ea-ae5e00eaa50f None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:31.714842 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d90d6-ee21-46b7-97ea-ae5e00eaa50f None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:31.715316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d90d6-ee21-46b7-97ea-ae5e00eaa50f None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:31.716796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 163/323] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:31.721933 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fff107-af75-4bc6-a65d-27544b9b9b75 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:31.722225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fff107-af75-4bc6-a65d-27544b9b9b75 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:31.722503 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fff107-af75-4bc6-a65d-27544b9b9b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:31.740974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-a8fff107-af75-4bc6-a65d-27544b9b9b75 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:31.742201 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-a8fff107-af75-4bc6-a65d-27544b9b9b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:31.810233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 161/324] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:31.907122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d90d6-ee21-46b7-97ea-ae5e00eaa50f None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:31.955831 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fff107-af75-4bc6-a65d-27544b9b9b75 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:32.015613 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d90d6-ee21-46b7-97ea-ae5e00eaa50f None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:32.044949 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:32.055469 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1bcbd-3183-46b8-b0a5-60ca4e5f6c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:32.056359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1bcbd-3183-46b8-b0a5-60ca4e5f6c42 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:32.056812 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1bcbd-3183-46b8-b0a5-60ca4e5f6c42 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:32.057289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1bcbd-3183-46b8-b0a5-60ca4e5f6c42 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:32.066635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fff107-af75-4bc6-a65d-27544b9b9b75 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:32.068148 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1bcbd-3183-46b8-b0a5-60ca4e5f6c42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:32.072896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-3be1bcbd-3183-46b8-b0a5-60ca4e5f6c42 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:31:32.072896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:32.072896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:32.072896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:32.072896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:32.072896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:32.072896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:32.072896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:32.072896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:32.072896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:32.072896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:32.072896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:32.072896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:32.072896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:32.072896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:32.072896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:32.073996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:32.073996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:32.073996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:32.073996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:32.073996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:32.073996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:32.073996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:32.073996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:32.073996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:32.073996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:32.073996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:32.073996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:32.073996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:32.073996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:32.073996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:32.073996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:32.074803 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:32.074803 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:32.074803 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:32.074803 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:32.074803 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:32.074803 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:32.074803 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:32.074803 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:32.074803 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:32.074803 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:32.074803 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:31:32.074803 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:32.074803 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 164/325] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:32.078845 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1bcbd-3183-46b8-b0a5-60ca4e5f6c42 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:32.091891 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:32.103840 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87635c46-051c-4125-998c-b94ae257c0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:32.104472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87635c46-051c-4125-998c-b94ae257c0f7 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:32.104752 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87635c46-051c-4125-998c-b94ae257c0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:32.105027 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87635c46-051c-4125-998c-b94ae257c0f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:32.106155 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87635c46-051c-4125-998c-b94ae257c0f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:32.107844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87635c46-051c-4125-998c-b94ae257c0f7 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:32.109410 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 162/326] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:31:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:32.110188 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87635c46-051c-4125-998c-b94ae257c0f7 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:32.183998 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1bcbd-3183-46b8-b0a5-60ca4e5f6c42 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:32.208741 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87635c46-051c-4125-998c-b94ae257c0f7 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:32.226561 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe8b23-3d32-4d1e-930e-331c7647bb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:32.227191 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe8b23-3d32-4d1e-930e-331c7647bb99 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:32.227914 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe8b23-3d32-4d1e-930e-331c7647bb99 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:32.227914 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe8b23-3d32-4d1e-930e-331c7647bb99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:32.238688 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe8b23-3d32-4d1e-930e-331c7647bb99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:32.243992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-2cfe8b23-3d32-4d1e-930e-331c7647bb99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:32.243992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:32.243992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:32.243992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:32.243992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:32.243992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:32.243992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:32.243992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:32.243992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:32.243992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:32.243992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:32.243992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:32.243992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:32.243992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:32.243992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:32.243992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:32.244885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:32.244885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:32.244885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:32.244885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:32.244885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:32.244885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:32.244885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:32.244885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:32.244885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:32.244885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:32.244885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:32.244885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:32.244885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:32.244885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:32.244885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:32.244885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:32.245849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:32.245849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:32.245849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:32.245849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:32.245849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:32.245849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:32.245849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:32.245849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:32.245849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:32.245849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:32.245849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:32.245849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:32.245849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 165/327] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:32.245849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe8b23-3d32-4d1e-930e-331c7647bb99 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:32.252409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc6280-eb36-49e1-9ebd-8b7b58111b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:32.253776 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc6280-eb36-49e1-9ebd-8b7b58111b04 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:32.254253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc6280-eb36-49e1-9ebd-8b7b58111b04 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:32.254536 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc6280-eb36-49e1-9ebd-8b7b58111b04 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:32.255215 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc6280-eb36-49e1-9ebd-8b7b58111b04 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:32.255521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc6280-eb36-49e1-9ebd-8b7b58111b04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:32.256898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc6280-eb36-49e1-9ebd-8b7b58111b04 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:32.265225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 163/328] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:32.266051 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc6280-eb36-49e1-9ebd-8b7b58111b04 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:32.307397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:32.319877 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:32.358125 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe8b23-3d32-4d1e-930e-331c7647bb99 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:32.366258 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc6280-eb36-49e1-9ebd-8b7b58111b04 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:32.392640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf2149-5efa-4c3d-81f4-2457ea7b778f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:32.393244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf2149-5efa-4c3d-81f4-2457ea7b778f None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:32.394127 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf2149-5efa-4c3d-81f4-2457ea7b778f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:32.394409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf2149-5efa-4c3d-81f4-2457ea7b778f None admin] PATH_INFO: `/v3/groups` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:32.395024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf2149-5efa-4c3d-81f4-2457ea7b778f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:32.396443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf2149-5efa-4c3d-81f4-2457ea7b778f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:32.399816 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5a331-bd6c-4e51-b7be-5fb34b2727aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:32.400411 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5a331-bd6c-4e51-b7be-5fb34b2727aa None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:32.400697 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5a331-bd6c-4e51-b7be-5fb34b2727aa None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:32.400973 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5a331-bd6c-4e51-b7be-5fb34b2727aa None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:32.401670 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5a331-bd6c-4e51-b7be-5fb34b2727aa None admin] RBAC: Adding query filter params (name=member) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:32.401977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5a331-bd6c-4e51-b7be-5fb34b2727aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:32.403428 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5a331-bd6c-4e51-b7be-5fb34b2727aa None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:32.413348 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 164/329] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:32.414203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5a331-bd6c-4e51-b7be-5fb34b2727aa None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:32.429501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 166/330] 10.222.0.58 () {60 vars in 1134 bytes} [Wed Aug 24 09:31:32 2022] POST /identity/v3/groups => generated 226 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:31:32.429501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf2149-5efa-4c3d-81f4-2457ea7b778f None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:32.527901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5a331-bd6c-4e51-b7be-5fb34b2727aa None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:32.543630 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:32.554795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf2149-5efa-4c3d-81f4-2457ea7b778f None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:32.566115 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:32.569685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301ef01-6b29-4630-8111-b67b9369a0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:32.570382 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301ef01-6b29-4630-8111-b67b9369a0bd None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:32.570601 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301ef01-6b29-4630-8111-b67b9369a0bd None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:32.571350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301ef01-6b29-4630-8111-b67b9369a0bd None admin] PATH_INFO: `/v3/users/ff9fdf8d2dbe4d20911f815050eba8b7` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:32.572210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301ef01-6b29-4630-8111-b67b9369a0bd None admin] RBAC: Authorizing `identity:get_user(user_id=ff9fdf8d2dbe4d20911f815050eba8b7)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:32.573976 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301ef01-6b29-4630-8111-b67b9369a0bd None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:32.575797 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 165/331] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:32 2022] GET /identity/v3/users/ff9fdf8d2dbe4d20911f815050eba8b7 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:32.582865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301ef01-6b29-4630-8111-b67b9369a0bd None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:32.601045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f4e3d-5028-48e7-86c5-e8b12db5105e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:32.601867 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f4e3d-5028-48e7-86c5-e8b12db5105e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:32.602148 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f4e3d-5028-48e7-86c5-e8b12db5105e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:32.602703 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f4e3d-5028-48e7-86c5-e8b12db5105e None admin] PATH_INFO: `/v3/users/8ae4d4189afa4bfe95a450cb6e89adb7` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:32.603874 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f4e3d-5028-48e7-86c5-e8b12db5105e None admin] RBAC: Authorizing `identity:get_user(user_id=8ae4d4189afa4bfe95a450cb6e89adb7)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:32.605310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f4e3d-5028-48e7-86c5-e8b12db5105e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:32.607829 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 167/332] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:32 2022] GET /identity/v3/users/8ae4d4189afa4bfe95a450cb6e89adb7 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:32.613911 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f4e3d-5028-48e7-86c5-e8b12db5105e None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:32.701408 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301ef01-6b29-4630-8111-b67b9369a0bd None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:32.751812 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f4e3d-5028-48e7-86c5-e8b12db5105e None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:32.756302 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10f8f2-d26e-479c-9cbe-3d182775aed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:32.756934 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10f8f2-d26e-479c-9cbe-3d182775aed7 None admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:32.757216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10f8f2-d26e-479c-9cbe-3d182775aed7 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:32.757524 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10f8f2-d26e-479c-9cbe-3d182775aed7 None admin] PATH_INFO: `/v3/system/users/ff9fdf8d2dbe4d20911f815050eba8b7/roles/791a6ff17232433d820343dc3ceee47a` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:32.759016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10f8f2-d26e-479c-9cbe-3d182775aed7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ff9fdf8d2dbe4d20911f815050eba8b7, role_id=791a6ff17232433d820343dc3ceee47a)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:32.760397 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10f8f2-d26e-479c-9cbe-3d182775aed7 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:32.773190 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 166/333] 10.222.0.58 () {58 vars in 1334 bytes} [Wed Aug 24 09:31:32 2022] PUT /identity/v3/system/users/ff9fdf8d2dbe4d20911f815050eba8b7/roles/791a6ff17232433d820343dc3ceee47a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:31:32.799006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196a040-dda1-4868-bf4a-a04c6f20a940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:32.799633 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196a040-dda1-4868-bf4a-a04c6f20a940 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:32.800529 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196a040-dda1-4868-bf4a-a04c6f20a940 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:32.800806 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196a040-dda1-4868-bf4a-a04c6f20a940 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:32.801666 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196a040-dda1-4868-bf4a-a04c6f20a940 None admin] RBAC: Adding query filter params (role.id=ec487838eecf4dc4bde1eaa59af3eb26, user.id=8ae4d4189afa4bfe95a450cb6e89adb7, scope.system=all) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:32.801938 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196a040-dda1-4868-bf4a-a04c6f20a940 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:32.803557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196a040-dda1-4868-bf4a-a04c6f20a940 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:32.818491 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 168/334] 10.222.0.58 () {56 vars in 1308 bytes} [Wed Aug 24 09:31:32 2022] GET /identity/v3/role_assignments?user.id=8ae4d4189afa4bfe95a450cb6e89adb7&scope.system=all&role.id=ec487838eecf4dc4bde1eaa59af3eb26 => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:34.765162 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad820ba-780c-41b3-a91e-170d67c07657 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:34.765758 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad820ba-780c-41b3-a91e-170d67c07657 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:34.765758 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad820ba-780c-41b3-a91e-170d67c07657 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:34.767458 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 167/335] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:34.772902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f57fc7-8ae9-4879-8bc7-cfe06a002aec None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:34.773343 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f57fc7-8ae9-4879-8bc7-cfe06a002aec None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:34.773437 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f57fc7-8ae9-4879-8bc7-cfe06a002aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:34.798747 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-e6f57fc7-8ae9-4879-8bc7-cfe06a002aec None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:34.800552 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-e6f57fc7-8ae9-4879-8bc7-cfe06a002aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:34.832003 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:34.884115 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 169/336] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:34.991622 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dea5e-bc73-4b6a-aaf9-df288d74daca None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:34.991939 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dea5e-bc73-4b6a-aaf9-df288d74daca None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:34.992197 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dea5e-bc73-4b6a-aaf9-df288d74daca None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:34.993621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 168/337] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:34.999034 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69454631-51b2-4885-b66c-1c412b411fc5 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:34.999346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69454631-51b2-4885-b66c-1c412b411fc5 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:34.999590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69454631-51b2-4885-b66c-1c412b411fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:35.023810 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-69454631-51b2-4885-b66c-1c412b411fc5 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:35.024939 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-69454631-51b2-4885-b66c-1c412b411fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:35.116013 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 170/338] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:35.153003 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e889c97-5d19-4042-85ab-ba55cdf604e8 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:35.153683 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e889c97-5d19-4042-85ab-ba55cdf604e8 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:35.154173 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e889c97-5d19-4042-85ab-ba55cdf604e8 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:35.155977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 169/339] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:35.162025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60aede-1699-4627-8208-59c5bc7e8ff5 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:35.162311 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60aede-1699-4627-8208-59c5bc7e8ff5 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:35.162590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60aede-1699-4627-8208-59c5bc7e8ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:35.190533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-5c60aede-1699-4627-8208-59c5bc7e8ff5 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:35.191746 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-5c60aede-1699-4627-8208-59c5bc7e8ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:35.280206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 171/340] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:35.281179 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e889c97-5d19-4042-85ab-ba55cdf604e8 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:35.354274 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:35.419359 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e889c97-5d19-4042-85ab-ba55cdf604e8 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:35.458309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e68a0-ed2e-4f9a-a403-bd50452f295f None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:35.458939 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e68a0-ed2e-4f9a-a403-bd50452f295f None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:35.459415 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e68a0-ed2e-4f9a-a403-bd50452f295f None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:35.461199 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1851bf7-6ff2-4286-add9-b3b9f009fc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:35.461448 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 172/341] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:35.465500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1851bf7-6ff2-4286-add9-b3b9f009fc8c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:35.465500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1851bf7-6ff2-4286-add9-b3b9f009fc8c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:35.465500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1851bf7-6ff2-4286-add9-b3b9f009fc8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:35.467037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4c179-59f0-453f-948d-d4ce617d93ec None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:35.467595 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4c179-59f0-453f-948d-d4ce617d93ec None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:35.468073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4c179-59f0-453f-948d-d4ce617d93ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:35.479193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1851bf7-6ff2-4286-add9-b3b9f009fc8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:35.484892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-a1851bf7-6ff2-4286-add9-b3b9f009fc8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:35.484892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:35.484892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:35.484892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:35.484892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:35.484892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:35.484892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:35.484892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:35.484892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:35.484892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:35.484892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:35.484892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:35.484892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:35.484892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:35.484892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:35.484892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:35.485817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:35.485817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:35.485817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:35.485817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:35.485817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:35.485817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:35.485817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:35.485817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:35.485817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:35.485817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:35.485817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:35.485817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:35.485817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:35.485817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:35.485817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:35.485817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:35.486599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:35.486599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:35.486599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:35.486599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:35.486599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:35.486599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:35.486599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:35.486599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:35.486599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:35.486599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:35.486599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:35.486599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:35.490283 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 170/342] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 09:31:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:31:35.492425 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1851bf7-6ff2-4286-add9-b3b9f009fc8c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:35.505218 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-23d4c179-59f0-453f-948d-d4ce617d93ec None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:35.506796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-23d4c179-59f0-453f-948d-d4ce617d93ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:35.526666 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:35.602463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1851bf7-6ff2-4286-add9-b3b9f009fc8c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:35.604056 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 173/343] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:31:35.610347 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:35.648933 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38517615-4017-4380-aade-551394c1f763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:35.649563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38517615-4017-4380-aade-551394c1f763 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:35.649846 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38517615-4017-4380-aade-551394c1f763 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:35.650124 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38517615-4017-4380-aade-551394c1f763 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:35.650801 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38517615-4017-4380-aade-551394c1f763 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:35.651106 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38517615-4017-4380-aade-551394c1f763 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:35.652479 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38517615-4017-4380-aade-551394c1f763 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:35.656491 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4c179-59f0-453f-948d-d4ce617d93ec None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:35.671484 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 171/344] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:31:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:35.671484 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38517615-4017-4380-aade-551394c1f763 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:35.829752 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38517615-4017-4380-aade-551394c1f763 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:35.863965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4c179-59f0-453f-948d-d4ce617d93ec None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:35.874998 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54566d-cafc-415f-9fe0-fe2865f6d189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:35.875614 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54566d-cafc-415f-9fe0-fe2865f6d189 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:35.875891 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54566d-cafc-415f-9fe0-fe2865f6d189 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:35.876162 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54566d-cafc-415f-9fe0-fe2865f6d189 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:35.933434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:35.941663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32f6c1-fe36-4e14-ad07-0d311d742686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:35.942314 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32f6c1-fe36-4e14-ad07-0d311d742686 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:35.942589 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32f6c1-fe36-4e14-ad07-0d311d742686 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:35.942855 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32f6c1-fe36-4e14-ad07-0d311d742686 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:35.964680 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32f6c1-fe36-4e14-ad07-0d311d742686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:35.969769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-9a32f6c1-fe36-4e14-ad07-0d311d742686 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:35.969769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:35.969769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:35.969769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:35.969769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:35.969769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:35.969769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:35.969769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:35.969769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:35.969769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:35.969769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:35.969769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:35.969769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:35.969769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:35.969769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:35.969769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:35.970604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:35.970604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:35.970604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:35.970604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:35.970604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:35.970604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:35.970604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:35.970604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:35.970604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:35.970604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:35.970604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:35.970604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:35.970604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:35.970604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:35.970604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:35.970604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:35.971386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:35.971386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:35.971386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:35.971386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:35.971386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:35.971386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:35.971386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:35.971386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:35.971386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:35.971386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:35.971386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:35.971386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:35.974173 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 174/345] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:35.975176 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32f6c1-fe36-4e14-ad07-0d311d742686 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:35.983163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54566d-cafc-415f-9fe0-fe2865f6d189 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:35.983723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54566d-cafc-415f-9fe0-fe2865f6d189 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:35.999478 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:36.114631 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 172/346] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:36.120457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54566d-cafc-415f-9fe0-fe2865f6d189 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:36.125206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32f6c1-fe36-4e14-ad07-0d311d742686 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:36.178398 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf85ce1-4141-4fea-9c01-24bff3d1d01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:36.179040 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf85ce1-4141-4fea-9c01-24bff3d1d01e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:36.179322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf85ce1-4141-4fea-9c01-24bff3d1d01e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:36.179592 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf85ce1-4141-4fea-9c01-24bff3d1d01e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:36.195624 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf85ce1-4141-4fea-9c01-24bff3d1d01e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:36.202058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-1cf85ce1-4141-4fea-9c01-24bff3d1d01e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:31:36.202058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:36.202058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:36.202058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:36.202058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:36.202058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:36.202058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:36.202058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:36.202058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:36.202058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:36.202058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:36.202058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:36.202058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:36.202058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:36.202058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:36.202058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:36.202925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:36.202925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:36.202925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:36.202925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:36.202925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:36.202925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:36.202925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:36.202925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:36.202925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:36.202925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:36.202925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:36.202925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:36.202925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:36.202925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:36.202925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:36.202925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:36.203713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:36.203713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:36.203713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:36.203713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:36.203713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:36.203713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:36.203713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:36.203713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:36.203713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:36.203713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:36.203713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 09:31:36.203713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:36.203713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 175/347] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:36.204365 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf85ce1-4141-4fea-9c01-24bff3d1d01e None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:36.208240 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:36.260755 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54566d-cafc-415f-9fe0-fe2865f6d189 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:36.304642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeeed1f-6afe-499e-b857-cf73055f65d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:36.305270 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeeed1f-6afe-499e-b857-cf73055f65d1 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:36.305805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeeed1f-6afe-499e-b857-cf73055f65d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:36.306268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeeed1f-6afe-499e-b857-cf73055f65d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:36.318990 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeeed1f-6afe-499e-b857-cf73055f65d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:36.320245 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:36.325585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-faeeed1f-6afe-499e-b857-cf73055f65d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:36.325585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:36.325585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:36.325585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:36.325585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:36.325585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:36.325585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:36.325585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:36.325585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:36.325585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:36.325585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:36.325585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:36.325585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:36.325585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:36.325585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:36.325585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:36.326782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:36.326782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:36.326782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:36.326782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:36.326782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:36.326782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:36.326782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:36.326782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:36.326782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:36.326782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:36.326782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:36.326782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:36.326782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:36.326782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:36.326782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:36.326782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:36.327557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:36.327557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:36.327557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:36.327557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:36.327557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:36.327557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:36.327557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:36.327557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:36.327557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:36.327557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:36.327557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:36.327557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:36.330058 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 173/348] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:36.331689 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeeed1f-6afe-499e-b857-cf73055f65d1 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:36.358312 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf85ce1-4141-4fea-9c01-24bff3d1d01e None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:36.397560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605f385-0ea7-43d4-b6b0-7c8ecec11147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:36.398681 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605f385-0ea7-43d4-b6b0-7c8ecec11147 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:36.399166 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605f385-0ea7-43d4-b6b0-7c8ecec11147 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:36.399631 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605f385-0ea7-43d4-b6b0-7c8ecec11147 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:36.400545 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605f385-0ea7-43d4-b6b0-7c8ecec11147 None admin] RBAC: Adding query filter params (name=member) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:36.401043 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605f385-0ea7-43d4-b6b0-7c8ecec11147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:36.402679 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605f385-0ea7-43d4-b6b0-7c8ecec11147 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:36.414562 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 176/349] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:36.416580 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605f385-0ea7-43d4-b6b0-7c8ecec11147 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:36.458691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeeed1f-6afe-499e-b857-cf73055f65d1 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:36.489788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:36.503823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b390375-c121-4c71-9f4e-10db9d2def96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:36.504514 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b390375-c121-4c71-9f4e-10db9d2def96 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:36.504791 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b390375-c121-4c71-9f4e-10db9d2def96 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:36.505063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b390375-c121-4c71-9f4e-10db9d2def96 None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:36.506508 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b390375-c121-4c71-9f4e-10db9d2def96 None admin] RBAC: Authorizing `identity:get_project(project_id=92dea89f3bc4436195a8b5f4a64fd785)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:36.508249 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b390375-c121-4c71-9f4e-10db9d2def96 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:36.510556 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 174/350] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:36 2022] GET /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:36.511334 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b390375-c121-4c71-9f4e-10db9d2def96 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:36.536407 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605f385-0ea7-43d4-b6b0-7c8ecec11147 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:36.572890 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be538974-e795-41db-9622-5442036325cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:36.573901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be538974-e795-41db-9622-5442036325cd None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:36.574375 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be538974-e795-41db-9622-5442036325cd None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:36.574842 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be538974-e795-41db-9622-5442036325cd None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:36.575707 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be538974-e795-41db-9622-5442036325cd None admin] RBAC: Adding query filter params (name=reader) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:36.576198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be538974-e795-41db-9622-5442036325cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:36.577795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be538974-e795-41db-9622-5442036325cd None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:36.580375 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:36.590243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 177/351] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:36.591456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be538974-e795-41db-9622-5442036325cd None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:36.627156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b390375-c121-4c71-9f4e-10db9d2def96 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:36.663671 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e02f00-ba0d-4803-863d-146c4bbc6a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:36.664200 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e02f00-ba0d-4803-863d-146c4bbc6a57 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:36.664482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e02f00-ba0d-4803-863d-146c4bbc6a57 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:36.664759 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e02f00-ba0d-4803-863d-146c4bbc6a57 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:36.666521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e02f00-ba0d-4803-863d-146c4bbc6a57 None admin] RBAC: Adding query filter params (name=member) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:36.666521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e02f00-ba0d-4803-863d-146c4bbc6a57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:36.667254 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e02f00-ba0d-4803-863d-146c4bbc6a57 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:36.677700 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 175/352] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:36.682472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e02f00-ba0d-4803-863d-146c4bbc6a57 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:36.714587 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be538974-e795-41db-9622-5442036325cd None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:36.753600 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:36.755083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6f655-a4b3-49b5-aceb-f705d93dd46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:36.755952 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6f655-a4b3-49b5-aceb-f705d93dd46c None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:36.756585 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6f655-a4b3-49b5-aceb-f705d93dd46c None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:36.757092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6f655-a4b3-49b5-aceb-f705d93dd46c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:36.813739 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e02f00-ba0d-4803-863d-146c4bbc6a57 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:36.853404 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e05769-8e83-4aa1-bfe0-56e3e3394cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:36.854080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e05769-8e83-4aa1-bfe0-56e3e3394cbf None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:36.854570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e05769-8e83-4aa1-bfe0-56e3e3394cbf None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:36.854676 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e05769-8e83-4aa1-bfe0-56e3e3394cbf None admin] PATH_INFO: `/v3/groups/28e08e9548e34ec589968d0b864da1d6` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:36.861820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:36.861982 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e05769-8e83-4aa1-bfe0-56e3e3394cbf None admin] RBAC: Authorizing `identity:get_group(group_id=28e08e9548e34ec589968d0b864da1d6)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:36.864001 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e05769-8e83-4aa1-bfe0-56e3e3394cbf None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:36.867833 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 176/353] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 09:31:36 2022] GET /identity/v3/groups/28e08e9548e34ec589968d0b864da1d6 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:36.868521 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6f655-a4b3-49b5-aceb-f705d93dd46c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:36.868958 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e05769-8e83-4aa1-bfe0-56e3e3394cbf None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:36.870737 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6f655-a4b3-49b5-aceb-f705d93dd46c None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:36.992142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e05769-8e83-4aa1-bfe0-56e3e3394cbf None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:37.012320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 178/354] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:37.013195 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6f655-a4b3-49b5-aceb-f705d93dd46c None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:37.021358 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:37.034776 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac9b90-4340-4d45-baa6-9ca99f32df09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:37.035482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac9b90-4340-4d45-baa6-9ca99f32df09 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:37.035771 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac9b90-4340-4d45-baa6-9ca99f32df09 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:37.036045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac9b90-4340-4d45-baa6-9ca99f32df09 None admin] PATH_INFO: `/v3/users/ff9fdf8d2dbe4d20911f815050eba8b7` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:37.037960 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac9b90-4340-4d45-baa6-9ca99f32df09 None admin] RBAC: Authorizing `identity:get_user(user_id=ff9fdf8d2dbe4d20911f815050eba8b7)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:37.039647 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac9b90-4340-4d45-baa6-9ca99f32df09 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:37.041393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 177/355] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:31:36 2022] GET /identity/v3/users/ff9fdf8d2dbe4d20911f815050eba8b7 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:37.042630 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c29f86-60aa-4840-8b94-c0e145d9950d None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:37.042911 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c29f86-60aa-4840-8b94-c0e145d9950d None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:37.043184 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c29f86-60aa-4840-8b94-c0e145d9950d None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:37.044455 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 178/356] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:37.045225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c29f86-60aa-4840-8b94-c0e145d9950d None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:37.143022 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:37.147828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6f655-a4b3-49b5-aceb-f705d93dd46c None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:37.172394 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c29f86-60aa-4840-8b94-c0e145d9950d None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:37.192191 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0340fdc-a45a-4c65-922f-5a0db3525bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:37.192809 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0340fdc-a45a-4c65-922f-5a0db3525bf5 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:37.193090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0340fdc-a45a-4c65-922f-5a0db3525bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:37.193367 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0340fdc-a45a-4c65-922f-5a0db3525bf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:37.215294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441d2ed-a511-428d-bf80-9579741eb0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:37.216447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441d2ed-a511-428d-bf80-9579741eb0e4 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:37.216729 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441d2ed-a511-428d-bf80-9579741eb0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:37.217001 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441d2ed-a511-428d-bf80-9579741eb0e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:37.217768 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441d2ed-a511-428d-bf80-9579741eb0e4 None admin] RBAC: Adding query filter params (group.id=28e08e9548e34ec589968d0b864da1d6, role.id=6c6a208f837c453cb9aceca635451134, scope.project.id=92dea89f3bc4436195a8b5f4a64fd785) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:37.218079 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441d2ed-a511-428d-bf80-9579741eb0e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:37.219961 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441d2ed-a511-428d-bf80-9579741eb0e4 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:37.231241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 179/357] 10.222.0.58 () {56 vars in 1376 bytes} [Wed Aug 24 09:31:37 2022] GET /identity/v3/role_assignments?group.id=28e08e9548e34ec589968d0b864da1d6&scope.project.id=92dea89f3bc4436195a8b5f4a64fd785&role.id=6c6a208f837c453cb9aceca635451134 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:37.232432 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441d2ed-a511-428d-bf80-9579741eb0e4 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:37.277874 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0340fdc-a45a-4c65-922f-5a0db3525bf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:37.279268 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0340fdc-a45a-4c65-922f-5a0db3525bf5 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:37.312122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:37.374980 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441d2ed-a511-428d-bf80-9579741eb0e4 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:37.408515 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:37.415360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 179/358] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:37.416765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72a82e-ca40-4e8b-9a5c-7c0eef111367 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:37.417201 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72a82e-ca40-4e8b-9a5c-7c0eef111367 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:37.421711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72a82e-ca40-4e8b-9a5c-7c0eef111367 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:37.423560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 180/359] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:37.424311 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72a82e-ca40-4e8b-9a5c-7c0eef111367 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:37.426223 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eddae5-c19b-47a5-9abd-b84c41f0441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:37.427048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eddae5-c19b-47a5-9abd-b84c41f0441f None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:37.427465 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eddae5-c19b-47a5-9abd-b84c41f0441f None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:37.427899 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eddae5-c19b-47a5-9abd-b84c41f0441f None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:37.429632 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eddae5-c19b-47a5-9abd-b84c41f0441f None admin] RBAC: Authorizing `identity:get_project(project_id=92dea89f3bc4436195a8b5f4a64fd785)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:37.431207 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eddae5-c19b-47a5-9abd-b84c41f0441f None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:37.432995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 180/360] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:37 2022] GET /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:37.435336 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da0164-8fec-446d-b0f9-d4c3bc4f61be None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:37.435806 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da0164-8fec-446d-b0f9-d4c3bc4f61be None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:37.436287 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da0164-8fec-446d-b0f9-d4c3bc4f61be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:37.458345 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-a8da0164-8fec-446d-b0f9-d4c3bc4f61be None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:37.459559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-a8da0164-8fec-446d-b0f9-d4c3bc4f61be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:37.559065 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 181/361] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:37.560155 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da0164-8fec-446d-b0f9-d4c3bc4f61be None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:37.564226 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72a82e-ca40-4e8b-9a5c-7c0eef111367 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:37.606308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a75803-718c-428d-b45a-b68c1e12435c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:37.606966 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a75803-718c-428d-b45a-b68c1e12435c None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:37.607499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a75803-718c-428d-b45a-b68c1e12435c None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:37.607822 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a75803-718c-428d-b45a-b68c1e12435c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:37.608541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a75803-718c-428d-b45a-b68c1e12435c None admin] RBAC: Adding query filter params (role.id=791a6ff17232433d820343dc3ceee47a, user.id=ff9fdf8d2dbe4d20911f815050eba8b7, scope.system=all) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:37.609008 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a75803-718c-428d-b45a-b68c1e12435c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:37.611253 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a75803-718c-428d-b45a-b68c1e12435c None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:37.625666 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 181/362] 10.222.0.58 () {56 vars in 1308 bytes} [Wed Aug 24 09:31:37 2022] GET /identity/v3/role_assignments?user.id=ff9fdf8d2dbe4d20911f815050eba8b7&scope.system=all&role.id=791a6ff17232433d820343dc3ceee47a => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:37.627191 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d049ce-9be4-4de6-8564-fda5a68780a0 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:37.627616 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d049ce-9be4-4de6-8564-fda5a68780a0 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:37.628082 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d049ce-9be4-4de6-8564-fda5a68780a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:37.630405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:37.652563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-40d049ce-9be4-4de6-8564-fda5a68780a0 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:37.654183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-40d049ce-9be4-4de6-8564-fda5a68780a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:37.686817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da0164-8fec-446d-b0f9-d4c3bc4f61be None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:37.731826 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:37.749029 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834efdc-0759-43f5-b3b1-64b7b880ba6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:37.749913 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834efdc-0759-43f5-b3b1-64b7b880ba6c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:37.750325 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834efdc-0759-43f5-b3b1-64b7b880ba6c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:37.750607 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834efdc-0759-43f5-b3b1-64b7b880ba6c None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:37.753805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834efdc-0759-43f5-b3b1-64b7b880ba6c None admin] RBAC: Authorizing `identity:get_project(project_id=fab69605019c4852be1e8f0ff0978774)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:37.755280 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834efdc-0759-43f5-b3b1-64b7b880ba6c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:37.757220 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 182/363] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:37 2022] GET /identity/v3/projects/fab69605019c4852be1e8f0ff0978774 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:37.757862 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834efdc-0759-43f5-b3b1-64b7b880ba6c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:37.781099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 182/364] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:37.782001 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d049ce-9be4-4de6-8564-fda5a68780a0 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:37.937588 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d049ce-9be4-4de6-8564-fda5a68780a0 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:37.964910 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834efdc-0759-43f5-b3b1-64b7b880ba6c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:37.974882 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177e548-08cd-4807-8f2b-9c74c2a07dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:37.975796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177e548-08cd-4807-8f2b-9c74c2a07dd4 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:37.976216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177e548-08cd-4807-8f2b-9c74c2a07dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:37.976668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177e548-08cd-4807-8f2b-9c74c2a07dd4 None admin] PATH_INFO: `/v3/groups/28e08e9548e34ec589968d0b864da1d6` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:37.977964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177e548-08cd-4807-8f2b-9c74c2a07dd4 None admin] RBAC: Authorizing `identity:get_group(group_id=28e08e9548e34ec589968d0b864da1d6)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:37.979553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177e548-08cd-4807-8f2b-9c74c2a07dd4 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:37.981588 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 183/365] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 09:31:37 2022] GET /identity/v3/groups/28e08e9548e34ec589968d0b864da1d6 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:37.982770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177e548-08cd-4807-8f2b-9c74c2a07dd4 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:38.005035 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:38.014946 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bd109-c2d0-4d77-b548-a704ceede88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:38.016093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bd109-c2d0-4d77-b548-a704ceede88d None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:38.016694 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bd109-c2d0-4d77-b548-a704ceede88d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:38.017115 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bd109-c2d0-4d77-b548-a704ceede88d None admin] PATH_INFO: `/v3/groups/28e08e9548e34ec589968d0b864da1d6` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:38.020120 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192bd109-c2d0-4d77-b548-a704ceede88d None admin] RBAC: Authorizing `identity:get_group(group_id=28e08e9548e34ec589968d0b864da1d6)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:38.021880 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192bd109-c2d0-4d77-b548-a704ceede88d None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:38.023776 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 183/366] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 09:31:37 2022] GET /identity/v3/groups/28e08e9548e34ec589968d0b864da1d6 => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:38.024681 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bd109-c2d0-4d77-b548-a704ceede88d None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:38.046617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:38.095588 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177e548-08cd-4807-8f2b-9c74c2a07dd4 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:38.133150 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdf4dc-b053-49d6-a122-f61e66b2992a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:38.133857 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdf4dc-b053-49d6-a122-f61e66b2992a None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:38.134139 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdf4dc-b053-49d6-a122-f61e66b2992a None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:38.134408 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdf4dc-b053-49d6-a122-f61e66b2992a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:38.145054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabdf4dc-b053-49d6-a122-f61e66b2992a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:38.148776 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bd109-c2d0-4d77-b548-a704ceede88d None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:38.150289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-fabdf4dc-b053-49d6-a122-f61e66b2992a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:38.150289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:38.150289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:38.150289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:38.150289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:38.150289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:38.150289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:38.150289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:38.150289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:38.150289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:38.150289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:38.150289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:38.150289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:38.150289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:38.150289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:38.150289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:38.151186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:38.151186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:38.151186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:38.151186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:38.151186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:38.151186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:38.151186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:38.151186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:38.151186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:38.151186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:38.151186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:38.151186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:38.151186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:38.151186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:38.151186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:38.151186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:38.151967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:38.151967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:38.151967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:38.151967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:38.151967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:38.151967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:38.151967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:38.151967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:38.151967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:38.151967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:38.151967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:38.151967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:38.151967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 184/367] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 09:31:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:38.152616 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdf4dc-b053-49d6-a122-f61e66b2992a None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:38.190876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e088e3f-f645-4b2d-b6db-8f900ac76871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:38.191835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e088e3f-f645-4b2d-b6db-8f900ac76871 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:38.192313 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e088e3f-f645-4b2d-b6db-8f900ac76871 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:38.192781 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e088e3f-f645-4b2d-b6db-8f900ac76871 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:38.193780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e088e3f-f645-4b2d-b6db-8f900ac76871 None admin] RBAC: Adding query filter params (group.id=28e08e9548e34ec589968d0b864da1d6, role.id=ec487838eecf4dc4bde1eaa59af3eb26, scope.project.id=fab69605019c4852be1e8f0ff0978774) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:38.194322 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e088e3f-f645-4b2d-b6db-8f900ac76871 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:38.196133 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e088e3f-f645-4b2d-b6db-8f900ac76871 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:38.202854 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 184/368] 10.222.0.58 () {56 vars in 1376 bytes} [Wed Aug 24 09:31:38 2022] GET /identity/v3/role_assignments?group.id=28e08e9548e34ec589968d0b864da1d6&scope.project.id=fab69605019c4852be1e8f0ff0978774&role.id=ec487838eecf4dc4bde1eaa59af3eb26 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:38.204066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e088e3f-f645-4b2d-b6db-8f900ac76871 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:38.270923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabdf4dc-b053-49d6-a122-f61e66b2992a None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:38.286778 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:38.302710 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:38.322416 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60ffbe-6e07-4c11-ba01-9d4f99fddae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:38.323412 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60ffbe-6e07-4c11-ba01-9d4f99fddae0 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:38.323919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60ffbe-6e07-4c11-ba01-9d4f99fddae0 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:38.326722 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60ffbe-6e07-4c11-ba01-9d4f99fddae0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:38.327868 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60ffbe-6e07-4c11-ba01-9d4f99fddae0 None admin] RBAC: Adding query filter params (group.id=28e08e9548e34ec589968d0b864da1d6, role.id=ec487838eecf4dc4bde1eaa59af3eb26, scope.project.id=92dea89f3bc4436195a8b5f4a64fd785) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:38.328398 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60ffbe-6e07-4c11-ba01-9d4f99fddae0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:38.330153 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60ffbe-6e07-4c11-ba01-9d4f99fddae0 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:38.337717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 185/369] 10.222.0.58 () {56 vars in 1376 bytes} [Wed Aug 24 09:31:38 2022] GET /identity/v3/role_assignments?group.id=28e08e9548e34ec589968d0b864da1d6&scope.project.id=92dea89f3bc4436195a8b5f4a64fd785&role.id=ec487838eecf4dc4bde1eaa59af3eb26 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:38.338912 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60ffbe-6e07-4c11-ba01-9d4f99fddae0 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:38.377506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e088e3f-f645-4b2d-b6db-8f900ac76871 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:38.421074 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709cd14-a477-4842-a461-49f52ced69e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:38.421722 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709cd14-a477-4842-a461-49f52ced69e1 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:38.422162 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709cd14-a477-4842-a461-49f52ced69e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:38.422694 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709cd14-a477-4842-a461-49f52ced69e1 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:38.425393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709cd14-a477-4842-a461-49f52ced69e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:38.425999 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709cd14-a477-4842-a461-49f52ced69e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:38.427606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709cd14-a477-4842-a461-49f52ced69e1 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:38.439456 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 185/370] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:31:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:38.445678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709cd14-a477-4842-a461-49f52ced69e1 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:38.575610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709cd14-a477-4842-a461-49f52ced69e1 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:38.592275 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:38.613069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60ffbe-6e07-4c11-ba01-9d4f99fddae0 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:38.617373 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1443f83-df07-4fec-a2ac-d250645d9ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:38.618233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1443f83-df07-4fec-a2ac-d250645d9ade None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:38.618646 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1443f83-df07-4fec-a2ac-d250645d9ade None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:38.619072 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1443f83-df07-4fec-a2ac-d250645d9ade None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:38.658924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efe273-8815-4f79-a0e0-09d3fba222f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:38.660667 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efe273-8815-4f79-a0e0-09d3fba222f0 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:38.661112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efe273-8815-4f79-a0e0-09d3fba222f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:38.662414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efe273-8815-4f79-a0e0-09d3fba222f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:38.676657 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efe273-8815-4f79-a0e0-09d3fba222f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:38.684775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-82efe273-8815-4f79-a0e0-09d3fba222f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:31:38.684775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:38.684775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:38.684775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:38.684775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:38.684775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:38.684775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:38.684775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:38.684775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:38.684775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:38.684775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:38.684775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:38.684775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:38.684775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:38.684775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:38.684775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:38.685891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:38.685891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:38.685891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:38.685891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:38.685891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:38.685891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:38.685891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:38.685891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:38.685891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:38.685891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:38.685891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:38.685891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:38.685891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:38.685891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:38.685891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:38.685891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:38.686669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:38.686669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:38.686669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:38.686669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:38.686669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:38.686669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:38.686669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:38.686669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:38.686669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:38.686669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:38.686669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:31:38.686669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:38.689985 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 186/371] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:31:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:38.696308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efe273-8815-4f79-a0e0-09d3fba222f0 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:38.724509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1443f83-df07-4fec-a2ac-d250645d9ade None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:38.726029 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1443f83-df07-4fec-a2ac-d250645d9ade None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:38.751097 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:38.878788 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efe273-8815-4f79-a0e0-09d3fba222f0 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:38.929864 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 186/372] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 09:31:38.934808 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1443f83-df07-4fec-a2ac-d250645d9ade None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:38.952783 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01599a-b58e-4a0e-abc5-d89da7d8b11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:38.956981 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01599a-b58e-4a0e-abc5-d89da7d8b11c None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:38.957491 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01599a-b58e-4a0e-abc5-d89da7d8b11c None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:38.959711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01599a-b58e-4a0e-abc5-d89da7d8b11c None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:38.960600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01599a-b58e-4a0e-abc5-d89da7d8b11c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:38.961086 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01599a-b58e-4a0e-abc5-d89da7d8b11c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:38.963964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01599a-b58e-4a0e-abc5-d89da7d8b11c None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:38.967032 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:38.988156 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 187/373] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:38.993832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01599a-b58e-4a0e-abc5-d89da7d8b11c None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:39.092054 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1443f83-df07-4fec-a2ac-d250645d9ade None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:39.173141 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2697092-ddee-4fb8-8dfd-e281f17aea82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:39.173819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2697092-ddee-4fb8-8dfd-e281f17aea82 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:39.174092 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2697092-ddee-4fb8-8dfd-e281f17aea82 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:39.174370 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2697092-ddee-4fb8-8dfd-e281f17aea82 None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:39.177349 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2697092-ddee-4fb8-8dfd-e281f17aea82 None admin] RBAC: Authorizing `identity:get_project(project_id=fab69605019c4852be1e8f0ff0978774)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:39.178823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2697092-ddee-4fb8-8dfd-e281f17aea82 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:39.186428 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 187/374] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:38 2022] GET /identity/v3/projects/fab69605019c4852be1e8f0ff0978774 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:39.189906 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:39.191602 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2697092-ddee-4fb8-8dfd-e281f17aea82 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:39.194331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01599a-b58e-4a0e-abc5-d89da7d8b11c None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:39.272967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435198ff-7588-4f9f-b849-18c73674facd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:39.273609 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435198ff-7588-4f9f-b849-18c73674facd None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:39.273892 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435198ff-7588-4f9f-b849-18c73674facd None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:39.274169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435198ff-7588-4f9f-b849-18c73674facd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:39.341371 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:39.372518 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435198ff-7588-4f9f-b849-18c73674facd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:39.374103 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435198ff-7588-4f9f-b849-18c73674facd None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:39.374977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2697092-ddee-4fb8-8dfd-e281f17aea82 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:39.435975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2269a-ef2c-4c0b-9d52-81d6cd984a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:39.441796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2269a-ef2c-4c0b-9d52-81d6cd984a1d None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:39.442396 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2269a-ef2c-4c0b-9d52-81d6cd984a1d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:39.442889 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2269a-ef2c-4c0b-9d52-81d6cd984a1d None admin] PATH_INFO: `/v3/groups/28e08e9548e34ec589968d0b864da1d6` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:39.444276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2269a-ef2c-4c0b-9d52-81d6cd984a1d None admin] RBAC: Authorizing `identity:get_group(group_id=28e08e9548e34ec589968d0b864da1d6)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:39.446275 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2269a-ef2c-4c0b-9d52-81d6cd984a1d None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:39.449637 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 188/375] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 09:31:39 2022] GET /identity/v3/groups/28e08e9548e34ec589968d0b864da1d6 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:39.455414 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2269a-ef2c-4c0b-9d52-81d6cd984a1d None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:39.544379 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:39.550539 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 188/376] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 09:31:39.553193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c09832-9c1a-497a-ac71-1f518ac65190 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:39.553680 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c09832-9c1a-497a-ac71-1f518ac65190 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:39.553956 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c09832-9c1a-497a-ac71-1f518ac65190 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:39.555946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 189/377] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:39.556930 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c09832-9c1a-497a-ac71-1f518ac65190 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:39.603699 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2269a-ef2c-4c0b-9d52-81d6cd984a1d None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:39.644519 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059b418-351f-41db-bbd4-f541471445b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:39.645617 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059b418-351f-41db-bbd4-f541471445b8 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:39.646113 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059b418-351f-41db-bbd4-f541471445b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:39.646592 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059b418-351f-41db-bbd4-f541471445b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:39.647924 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059b418-351f-41db-bbd4-f541471445b8 None admin] RBAC: Adding query filter params (group.id=28e08e9548e34ec589968d0b864da1d6, role.id=6c6a208f837c453cb9aceca635451134, scope.project.id=fab69605019c4852be1e8f0ff0978774) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:39.648534 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059b418-351f-41db-bbd4-f541471445b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:39.650929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059b418-351f-41db-bbd4-f541471445b8 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:39.656900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 189/378] 10.222.0.58 () {56 vars in 1376 bytes} [Wed Aug 24 09:31:39 2022] GET /identity/v3/role_assignments?group.id=28e08e9548e34ec589968d0b864da1d6&scope.project.id=fab69605019c4852be1e8f0ff0978774&role.id=6c6a208f837c453cb9aceca635451134 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:39.658132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c8613-2506-4ef2-b378-d8f610a931f7 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:39.658411 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c8613-2506-4ef2-b378-d8f610a931f7 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:39.658682 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c8613-2506-4ef2-b378-d8f610a931f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:39.683777 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-682c8613-2506-4ef2-b378-d8f610a931f7 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:39.686174 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-682c8613-2506-4ef2-b378-d8f610a931f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:39.700805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:39.723633 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c09832-9c1a-497a-ac71-1f518ac65190 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:39.795404 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd1d6e-3970-4f94-a65f-07f11a6e7e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:39.796018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd1d6e-3970-4f94-a65f-07f11a6e7e49 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:39.796299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd1d6e-3970-4f94-a65f-07f11a6e7e49 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:39.796572 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd1d6e-3970-4f94-a65f-07f11a6e7e49 None admin] PATH_INFO: `/v3/projects/28c010260e5042edbe919c3cfc65493b` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:39.798661 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd1d6e-3970-4f94-a65f-07f11a6e7e49 None admin] RBAC: Authorizing `identity:get_project(project_id=28c010260e5042edbe919c3cfc65493b)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:39.801883 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd1d6e-3970-4f94-a65f-07f11a6e7e49 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:39.804232 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 190/379] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:39 2022] GET /identity/v3/projects/28c010260e5042edbe919c3cfc65493b => generated 344 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:39.810606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd1d6e-3970-4f94-a65f-07f11a6e7e49 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:39.825639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 190/380] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:39.889017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:39.932105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd1d6e-3970-4f94-a65f-07f11a6e7e49 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:39.967890 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7257f4-27b1-45d7-a622-da49e1a8b937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:39.968519 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7257f4-27b1-45d7-a622-da49e1a8b937 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:39.968826 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7257f4-27b1-45d7-a622-da49e1a8b937 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:39.969097 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7257f4-27b1-45d7-a622-da49e1a8b937 None admin] PATH_INFO: `/v3/groups/bcfb6844b3da4255a5bcba26701f8dfc` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:39.976724 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7257f4-27b1-45d7-a622-da49e1a8b937 None admin] RBAC: Authorizing `identity:get_group(group_id=bcfb6844b3da4255a5bcba26701f8dfc)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:39.978226 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7257f4-27b1-45d7-a622-da49e1a8b937 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:39.980144 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 191/381] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 09:31:39 2022] GET /identity/v3/groups/bcfb6844b3da4255a5bcba26701f8dfc => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:39.986074 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c8613-2506-4ef2-b378-d8f610a931f7 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:40.112323 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c8613-2506-4ef2-b378-d8f610a931f7 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:40.149250 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356569f-4049-449b-b540-f43462973f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:40.152059 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356569f-4049-449b-b540-f43462973f47 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:40.152596 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356569f-4049-449b-b540-f43462973f47 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:40.153073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356569f-4049-449b-b540-f43462973f47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:40.154304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356569f-4049-449b-b540-f43462973f47 None admin] RBAC: Adding query filter params (group.id=bcfb6844b3da4255a5bcba26701f8dfc, role.id=cd2effe8340d4be08a28d3a40db6979d, scope.project.id=28c010260e5042edbe919c3cfc65493b) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:40.154817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356569f-4049-449b-b540-f43462973f47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:40.156423 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356569f-4049-449b-b540-f43462973f47 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:40.162979 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 191/382] 10.222.0.58 () {56 vars in 1376 bytes} [Wed Aug 24 09:31:39 2022] GET /identity/v3/role_assignments?group.id=bcfb6844b3da4255a5bcba26701f8dfc&scope.project.id=28c010260e5042edbe919c3cfc65493b&role.id=cd2effe8340d4be08a28d3a40db6979d => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:40.281794 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7257f4-27b1-45d7-a622-da49e1a8b937 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:40.413403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7257f4-27b1-45d7-a622-da49e1a8b937 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:40.448119 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:40.456118 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a0678-ec8a-49c8-8889-59045319caa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:40.457122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a0678-ec8a-49c8-8889-59045319caa5 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:40.457487 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a0678-ec8a-49c8-8889-59045319caa5 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:40.457790 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a0678-ec8a-49c8-8889-59045319caa5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:40.478556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a0678-ec8a-49c8-8889-59045319caa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:40.484265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-296a0678-ec8a-49c8-8889-59045319caa5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:40.484265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:40.484265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:40.484265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:40.484265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:40.484265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:40.484265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:40.484265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:40.484265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:40.484265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:40.484265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:40.484265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:40.484265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:40.484265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:40.484265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:40.484265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:40.485200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:40.485200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:40.485200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:40.485200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:40.485200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:40.485200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:40.485200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:40.485200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:40.485200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:40.485200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:40.485200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:40.485200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:40.485200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:40.485200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:40.485200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:40.485200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:40.486073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:40.486073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:40.486073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:40.486073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:40.486073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:40.486073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:40.486073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:40.486073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:40.486073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:40.486073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:40.486073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:40.486073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:40.489600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 192/383] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 09:31:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:40.492762 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356569f-4049-449b-b540-f43462973f47 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:40.504468 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:40.641898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356569f-4049-449b-b540-f43462973f47 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:40.682670 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1c695-3833-41af-b529-b12d12322b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:40.683592 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1c695-3833-41af-b529-b12d12322b1b None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:40.684062 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1c695-3833-41af-b529-b12d12322b1b None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:40.684565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1c695-3833-41af-b529-b12d12322b1b None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:40.685422 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1c695-3833-41af-b529-b12d12322b1b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:40.685955 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1c695-3833-41af-b529-b12d12322b1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:40.687495 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1c695-3833-41af-b529-b12d12322b1b None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:40.701097 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 192/384] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:31:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:40.706925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a0678-ec8a-49c8-8889-59045319caa5 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:40.869413 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a0678-ec8a-49c8-8889-59045319caa5 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:40.919588 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91447dc7-1eea-470c-bc37-633ff6e8db37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:40.920233 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91447dc7-1eea-470c-bc37-633ff6e8db37 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:40.920512 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91447dc7-1eea-470c-bc37-633ff6e8db37 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:40.920787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91447dc7-1eea-470c-bc37-633ff6e8db37 None admin] PATH_INFO: `/v3/groups/28e08e9548e34ec589968d0b864da1d6` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:40.922101 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91447dc7-1eea-470c-bc37-633ff6e8db37 None admin] RBAC: Authorizing `identity:get_group(group_id=28e08e9548e34ec589968d0b864da1d6)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:40.923670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91447dc7-1eea-470c-bc37-633ff6e8db37 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:40.925290 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 193/385] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 09:31:40 2022] GET /identity/v3/groups/28e08e9548e34ec589968d0b864da1d6 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:40.927821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216034d-ee87-4857-b22f-d14e5967daef None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:40.928104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216034d-ee87-4857-b22f-d14e5967daef None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:40.928379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216034d-ee87-4857-b22f-d14e5967daef None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:40.930044 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 193/386] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:40.930596 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91447dc7-1eea-470c-bc37-633ff6e8db37 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:40.936575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660893d1-c785-472e-af1c-8fc99940ec39 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:40.936855 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660893d1-c785-472e-af1c-8fc99940ec39 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:40.937130 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660893d1-c785-472e-af1c-8fc99940ec39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:40.962139 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-660893d1-c785-472e-af1c-8fc99940ec39 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:40.963781 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-660893d1-c785-472e-af1c-8fc99940ec39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:41.023484 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:41.053841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:41.063801 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 194/387] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:31:41.066714 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbece3d-cfb1-44fc-aa28-7f5775a7d3a9 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:41.067585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbece3d-cfb1-44fc-aa28-7f5775a7d3a9 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:41.068071 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbece3d-cfb1-44fc-aa28-7f5775a7d3a9 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:41.070483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 195/388] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:41.076846 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0497bf-5fd7-47ee-8c6a-33d3ce0de2c5 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:41.077383 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0497bf-5fd7-47ee-8c6a-33d3ce0de2c5 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:41.077888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0497bf-5fd7-47ee-8c6a-33d3ce0de2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:41.091779 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91447dc7-1eea-470c-bc37-633ff6e8db37 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:41.118982 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-cb0497bf-5fd7-47ee-8c6a-33d3ce0de2c5 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:41.121454 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-cb0497bf-5fd7-47ee-8c6a-33d3ce0de2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:41.166500 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10db5c-6d06-438d-a808-e02cee763531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:41.167562 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10db5c-6d06-438d-a808-e02cee763531 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:41.168054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10db5c-6d06-438d-a808-e02cee763531 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:41.168557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10db5c-6d06-438d-a808-e02cee763531 None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:41.170075 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10db5c-6d06-438d-a808-e02cee763531 None admin] RBAC: Authorizing `identity:get_project(project_id=92dea89f3bc4436195a8b5f4a64fd785)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:41.171736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10db5c-6d06-438d-a808-e02cee763531 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:41.175388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 194/389] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:40 2022] GET /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:41.182807 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10db5c-6d06-438d-a808-e02cee763531 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:41.280001 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 196/390] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:41.342247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10db5c-6d06-438d-a808-e02cee763531 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:41.370260 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:41.381095 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61503e7a-c15c-4f10-9395-91a476e1b65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:41.381800 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61503e7a-c15c-4f10-9395-91a476e1b65c None admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:41.382080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61503e7a-c15c-4f10-9395-91a476e1b65c None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:41.382356 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61503e7a-c15c-4f10-9395-91a476e1b65c None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785/groups/28e08e9548e34ec589968d0b864da1d6/roles/6c6a208f837c453cb9aceca635451134` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:41.384563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61503e7a-c15c-4f10-9395-91a476e1b65c None admin] RBAC: Authorizing `identity:create_grant(project_id=92dea89f3bc4436195a8b5f4a64fd785, group_id=28e08e9548e34ec589968d0b864da1d6, role_id=6c6a208f837c453cb9aceca635451134)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:41.386037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61503e7a-c15c-4f10-9395-91a476e1b65c None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:41.403524 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 195/391] 10.222.0.58 () {58 vars in 1442 bytes} [Wed Aug 24 09:31:41 2022] PUT /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785/groups/28e08e9548e34ec589968d0b864da1d6/roles/6c6a208f837c453cb9aceca635451134 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:31:41.426836 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0497bf-5fd7-47ee-8c6a-33d3ce0de2c5 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:41.549021 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0497bf-5fd7-47ee-8c6a-33d3ce0de2c5 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:41.586061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:41.592419 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f485984-e914-4e79-b96f-11a599276040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:41.593398 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f485984-e914-4e79-b96f-11a599276040 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:41.594039 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f485984-e914-4e79-b96f-11a599276040 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:41.594715 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f485984-e914-4e79-b96f-11a599276040 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:41.607658 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f485984-e914-4e79-b96f-11a599276040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:41.612577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-0f485984-e914-4e79-b96f-11a599276040 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:41.612577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:41.612577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:41.612577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:41.612577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:41.612577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:41.612577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:41.612577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:41.612577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:41.612577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:41.612577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:41.612577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:41.612577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:41.612577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:41.612577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:41.612577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:41.613482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:41.613482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:41.613482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:41.613482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:41.613482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:41.613482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:41.613482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:41.613482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:41.613482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:41.613482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:41.613482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:41.613482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:41.613482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:41.613482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:41.613482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:41.613482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:41.614658 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:41.614658 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:41.614658 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:41.614658 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:41.614658 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:41.614658 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:41.614658 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:41.614658 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:41.614658 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:41.614658 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:41.614658 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:41.614658 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:41.614658 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 197/392] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:41.619581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61503e7a-c15c-4f10-9395-91a476e1b65c None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:41.729568 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f485984-e914-4e79-b96f-11a599276040 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:41.733073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61503e7a-c15c-4f10-9395-91a476e1b65c None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:41.815877 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e6fe3-4f2c-43b2-9a97-06f4d5e2978b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:41.816680 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e6fe3-4f2c-43b2-9a97-06f4d5e2978b None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:41.816962 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e6fe3-4f2c-43b2-9a97-06f4d5e2978b None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:41.817222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e6fe3-4f2c-43b2-9a97-06f4d5e2978b None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:41.817945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e6fe3-4f2c-43b2-9a97-06f4d5e2978b None admin] RBAC: Adding query filter params (name=member) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:41.818247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e6fe3-4f2c-43b2-9a97-06f4d5e2978b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:41.819672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e6fe3-4f2c-43b2-9a97-06f4d5e2978b None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:41.851744 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 196/393] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:41.872569 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f485984-e914-4e79-b96f-11a599276040 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:41.879100 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e6fe3-4f2c-43b2-9a97-06f4d5e2978b None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:41.912662 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a9992-4d5d-4052-ab61-0101e819d467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:41.913883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a9992-4d5d-4052-ab61-0101e819d467 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:41.914332 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a9992-4d5d-4052-ab61-0101e819d467 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:41.914761 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a9992-4d5d-4052-ab61-0101e819d467 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:41.930630 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a9992-4d5d-4052-ab61-0101e819d467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:41.936081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-4c5a9992-4d5d-4052-ab61-0101e819d467 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:41.936081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:41.936081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:41.936081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:41.936081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:41.936081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:41.936081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:41.936081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:41.936081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:41.936081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:41.936081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:41.936081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:41.936081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:41.936081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:41.936081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:41.936081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:41.937157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:41.937157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:41.937157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:41.937157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:41.937157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:41.937157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:41.937157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:41.937157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:41.937157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:41.937157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:41.937157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:41.937157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:41.937157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:41.937157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:41.937157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:41.937157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:41.938158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:41.938158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:41.938158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:41.938158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:41.938158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:41.938158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:41.938158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:41.938158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:41.938158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:41.938158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:41.938158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:41.938158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:41.940698 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 198/394] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:41.951288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a9992-4d5d-4052-ab61-0101e819d467 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:41.955228 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:42.041935 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:42.064942 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a9992-4d5d-4052-ab61-0101e819d467 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:42.088535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e6fe3-4f2c-43b2-9a97-06f4d5e2978b None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:42.103496 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4c27a-46e4-48ca-be8f-81e6b0d0c5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:42.104329 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4c27a-46e4-48ca-be8f-81e6b0d0c5b4 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:42.104778 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4c27a-46e4-48ca-be8f-81e6b0d0c5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:42.105194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4c27a-46e4-48ca-be8f-81e6b0d0c5b4 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:42.106032 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4c27a-46e4-48ca-be8f-81e6b0d0c5b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:42.106505 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4c27a-46e4-48ca-be8f-81e6b0d0c5b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:42.109324 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4c27a-46e4-48ca-be8f-81e6b0d0c5b4 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:42.120450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 199/395] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:42.126383 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4c27a-46e4-48ca-be8f-81e6b0d0c5b4 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:42.157680 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033931c0-0024-4f32-86c0-4581f40b7a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:42.158635 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033931c0-0024-4f32-86c0-4581f40b7a98 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:42.158979 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033931c0-0024-4f32-86c0-4581f40b7a98 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:42.159883 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033931c0-0024-4f32-86c0-4581f40b7a98 None admin] PATH_INFO: `/v3/groups/28e08e9548e34ec589968d0b864da1d6` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:42.161180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033931c0-0024-4f32-86c0-4581f40b7a98 None admin] RBAC: Authorizing `identity:get_group(group_id=28e08e9548e34ec589968d0b864da1d6)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:42.163237 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033931c0-0024-4f32-86c0-4581f40b7a98 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:42.169255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 197/396] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 09:31:41 2022] GET /identity/v3/groups/28e08e9548e34ec589968d0b864da1d6 => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:42.169255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a5e35-297a-4968-b165-3e5053b73f9f None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:42.169255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a5e35-297a-4968-b165-3e5053b73f9f None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:42.169255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a5e35-297a-4968-b165-3e5053b73f9f None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:42.169255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 198/397] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:42.173440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a5e35-297a-4968-b165-3e5053b73f9f None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:42.260642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4c27a-46e4-48ca-be8f-81e6b0d0c5b4 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:42.275565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:42.301161 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11be107-1916-47ef-b33c-7b3fd3687082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:42.302076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11be107-1916-47ef-b33c-7b3fd3687082 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:42.302536 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11be107-1916-47ef-b33c-7b3fd3687082 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:42.302958 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11be107-1916-47ef-b33c-7b3fd3687082 None admin] PATH_INFO: `/v3/groups/28e08e9548e34ec589968d0b864da1d6` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:42.303219 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a5e35-297a-4968-b165-3e5053b73f9f None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:42.304448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11be107-1916-47ef-b33c-7b3fd3687082 None admin] RBAC: Authorizing `identity:get_group(group_id=28e08e9548e34ec589968d0b864da1d6)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:42.307239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11be107-1916-47ef-b33c-7b3fd3687082 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:42.309306 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 200/398] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 09:31:42 2022] GET /identity/v3/groups/28e08e9548e34ec589968d0b864da1d6 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:42.311385 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c8fae-2aa6-407d-88e1-ca5e3c6b5748 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:42.311824 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c8fae-2aa6-407d-88e1-ca5e3c6b5748 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:42.312243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c8fae-2aa6-407d-88e1-ca5e3c6b5748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:42.324229 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:42.340729 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-f32c8fae-2aa6-407d-88e1-ca5e3c6b5748 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:42.342279 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-f32c8fae-2aa6-407d-88e1-ca5e3c6b5748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:42.344236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7580f-25f2-49b7-a20a-c9f07eed83f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:42.345038 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7580f-25f2-49b7-a20a-c9f07eed83f0 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:42.345315 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7580f-25f2-49b7-a20a-c9f07eed83f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:42.345628 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7580f-25f2-49b7-a20a-c9f07eed83f0 None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:42.348556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7580f-25f2-49b7-a20a-c9f07eed83f0 None admin] RBAC: Authorizing `identity:get_project(project_id=92dea89f3bc4436195a8b5f4a64fd785)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:42.350103 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7580f-25f2-49b7-a20a-c9f07eed83f0 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:42.356527 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 199/399] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:42 2022] GET /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:42.356527 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7580f-25f2-49b7-a20a-c9f07eed83f0 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:42.444388 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 201/400] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:42.445702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c8fae-2aa6-407d-88e1-ca5e3c6b5748 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:42.518059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7580f-25f2-49b7-a20a-c9f07eed83f0 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:42.560378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd79e18-8369-4cb1-84c9-16a02c51f593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:42.561013 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd79e18-8369-4cb1-84c9-16a02c51f593 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:42.561290 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd79e18-8369-4cb1-84c9-16a02c51f593 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:42.561621 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd79e18-8369-4cb1-84c9-16a02c51f593 None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:42.563446 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd79e18-8369-4cb1-84c9-16a02c51f593 None admin] RBAC: Authorizing `identity:get_project(project_id=fab69605019c4852be1e8f0ff0978774)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:42.565149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd79e18-8369-4cb1-84c9-16a02c51f593 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:42.568231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 200/401] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:42 2022] GET /identity/v3/projects/fab69605019c4852be1e8f0ff0978774 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:42.573382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd79e18-8369-4cb1-84c9-16a02c51f593 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:42.652954 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:42.681051 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c8fae-2aa6-407d-88e1-ca5e3c6b5748 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:42.707228 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:42.731770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd79e18-8369-4cb1-84c9-16a02c51f593 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:42.743194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beba514-93f1-4e7a-ace3-d3283ca4b155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:42.744292 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beba514-93f1-4e7a-ace3-d3283ca4b155 None admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:42.744586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beba514-93f1-4e7a-ace3-d3283ca4b155 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:42.744865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beba514-93f1-4e7a-ace3-d3283ca4b155 None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785/groups/28e08e9548e34ec589968d0b864da1d6/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:42.746799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beba514-93f1-4e7a-ace3-d3283ca4b155 None admin] RBAC: Authorizing `identity:create_grant(project_id=92dea89f3bc4436195a8b5f4a64fd785, group_id=28e08e9548e34ec589968d0b864da1d6, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:42.748227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beba514-93f1-4e7a-ace3-d3283ca4b155 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:42.771772 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 202/402] 10.222.0.58 () {58 vars in 1442 bytes} [Wed Aug 24 09:31:42 2022] PUT /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785/groups/28e08e9548e34ec589968d0b864da1d6/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:31:42.772127 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beba514-93f1-4e7a-ace3-d3283ca4b155 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:42.791736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b51f17-01e1-4dcc-bc45-a4f116c74536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:42.792420 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b51f17-01e1-4dcc-bc45-a4f116c74536 None admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:42.792704 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b51f17-01e1-4dcc-bc45-a4f116c74536 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:42.792984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b51f17-01e1-4dcc-bc45-a4f116c74536 None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774/groups/28e08e9548e34ec589968d0b864da1d6/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:42.795228 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b51f17-01e1-4dcc-bc45-a4f116c74536 None admin] RBAC: Authorizing `identity:create_grant(project_id=fab69605019c4852be1e8f0ff0978774, group_id=28e08e9548e34ec589968d0b864da1d6, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:42.796734 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b51f17-01e1-4dcc-bc45-a4f116c74536 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:42.820419 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 201/403] 10.222.0.58 () {58 vars in 1442 bytes} [Wed Aug 24 09:31:42 2022] PUT /identity/v3/projects/fab69605019c4852be1e8f0ff0978774/groups/28e08e9548e34ec589968d0b864da1d6/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:31:42.822206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc2a48-0289-4e5e-9473-1283c45e1f5a None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:42.822971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc2a48-0289-4e5e-9473-1283c45e1f5a None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:42.823259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc2a48-0289-4e5e-9473-1283c45e1f5a None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:42.829571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 202/404] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:42.833084 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9ee16-13d7-4fcf-b4af-2a74a4f13315 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:42.833918 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9ee16-13d7-4fcf-b4af-2a74a4f13315 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:42.834413 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9ee16-13d7-4fcf-b4af-2a74a4f13315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:42.858012 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-66c9ee16-13d7-4fcf-b4af-2a74a4f13315 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:42.859499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-66c9ee16-13d7-4fcf-b4af-2a74a4f13315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:42.941828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beba514-93f1-4e7a-ace3-d3283ca4b155 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:42.944003 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 203/405] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:42.980578 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda0b5b-3113-473e-8973-2b2dc89935d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:42.981217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda0b5b-3113-473e-8973-2b2dc89935d8 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:42.981542 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda0b5b-3113-473e-8973-2b2dc89935d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:42.981823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda0b5b-3113-473e-8973-2b2dc89935d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:42.994312 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda0b5b-3113-473e-8973-2b2dc89935d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:42.999244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-9eda0b5b-3113-473e-8973-2b2dc89935d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:42.999244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:42.999244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:42.999244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:42.999244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:42.999244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:42.999244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:42.999244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:42.999244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:42.999244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:42.999244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:42.999244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:42.999244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:42.999244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:42.999244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:42.999244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:43.000319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:43.000319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:43.000319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:43.000319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:43.000319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:43.000319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:43.000319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:43.000319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:43.000319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:43.000319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:43.000319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:43.000319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:43.000319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:43.000319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:43.000319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:43.000319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:43.001301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:43.001301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:43.001301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:43.001301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:43.001301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:43.001301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:43.001301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:43.001301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:43.001301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:43.001301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:43.001301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:43.001301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:43.003946 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 203/406] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 09:31:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:43.009510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9ee16-13d7-4fcf-b4af-2a74a4f13315 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:43.066762 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:43.131868 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9ee16-13d7-4fcf-b4af-2a74a4f13315 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:43.174351 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a56593-9ff8-4bae-a2b6-fc3b9f275f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:43.175245 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a56593-9ff8-4bae-a2b6-fc3b9f275f22 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:43.175571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a56593-9ff8-4bae-a2b6-fc3b9f275f22 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:43.175849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a56593-9ff8-4bae-a2b6-fc3b9f275f22 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:43.176524 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a56593-9ff8-4bae-a2b6-fc3b9f275f22 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:43.176829 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a56593-9ff8-4bae-a2b6-fc3b9f275f22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:43.178244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a56593-9ff8-4bae-a2b6-fc3b9f275f22 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:43.187322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 204/407] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:31:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:43.193553 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda0b5b-3113-473e-8973-2b2dc89935d8 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:43.249399 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:43.297607 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a56593-9ff8-4bae-a2b6-fc3b9f275f22 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:43.369615 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda0b5b-3113-473e-8973-2b2dc89935d8 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:43.418180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec593c94-d2ea-4618-b0e2-557be57fdf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:43.419252 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec593c94-d2ea-4618-b0e2-557be57fdf3c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:43.419752 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec593c94-d2ea-4618-b0e2-557be57fdf3c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:43.420239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec593c94-d2ea-4618-b0e2-557be57fdf3c None admin] PATH_INFO: `/v3/groups/28e08e9548e34ec589968d0b864da1d6` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:43.421596 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec593c94-d2ea-4618-b0e2-557be57fdf3c None admin] RBAC: Authorizing `identity:get_group(group_id=28e08e9548e34ec589968d0b864da1d6)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:43.423237 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec593c94-d2ea-4618-b0e2-557be57fdf3c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:43.429877 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 204/408] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 09:31:43 2022] GET /identity/v3/groups/28e08e9548e34ec589968d0b864da1d6 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:43.431948 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec593c94-d2ea-4618-b0e2-557be57fdf3c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:43.456968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a56593-9ff8-4bae-a2b6-fc3b9f275f22 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:43.467594 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:43.501723 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabad67-cd7a-42d6-b56c-175bf6627655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:43.502752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabad67-cd7a-42d6-b56c-175bf6627655 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:43.503261 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabad67-cd7a-42d6-b56c-175bf6627655 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:43.503746 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabad67-cd7a-42d6-b56c-175bf6627655 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:43.514643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabad67-cd7a-42d6-b56c-175bf6627655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:43.520499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-8dabad67-cd7a-42d6-b56c-175bf6627655 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:31:43.520499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:43.520499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:43.520499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:43.520499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:43.520499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:43.520499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:43.520499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:43.520499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:43.520499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:43.520499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:43.520499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:43.520499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:43.520499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:43.520499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:43.520499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:43.521384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:43.521384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:43.521384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:43.521384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:43.521384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:43.521384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:43.521384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:43.521384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:43.521384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:43.521384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:43.521384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:43.521384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:43.521384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:43.521384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:43.521384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:43.521384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:43.522210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:43.522210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:43.522210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:43.522210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:43.522210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:43.522210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:43.522210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:43.522210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:43.522210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:43.522210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:43.522210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:31:43.522210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:43.524777 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 205/409] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:31:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:31:43.534530 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabad67-cd7a-42d6-b56c-175bf6627655 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:43.552297 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:43.557423 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec593c94-d2ea-4618-b0e2-557be57fdf3c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:43.597090 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bd1d0-fb9a-43b4-9f31-81107b800d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:43.598486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bd1d0-fb9a-43b4-9f31-81107b800d84 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:43.598923 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bd1d0-fb9a-43b4-9f31-81107b800d84 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:43.599576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bd1d0-fb9a-43b4-9f31-81107b800d84 None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:43.601024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bd1d0-fb9a-43b4-9f31-81107b800d84 None admin] RBAC: Authorizing `identity:get_project(project_id=fab69605019c4852be1e8f0ff0978774)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:43.602961 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bd1d0-fb9a-43b4-9f31-81107b800d84 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:43.605434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 205/410] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:43 2022] GET /identity/v3/projects/fab69605019c4852be1e8f0ff0978774 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:43.615464 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bd1d0-fb9a-43b4-9f31-81107b800d84 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:43.741159 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabad67-cd7a-42d6-b56c-175bf6627655 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:43.781955 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bd1d0-fb9a-43b4-9f31-81107b800d84 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:43.806721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206b6b3-b34f-4ed2-a699-faba5c51c722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:43.807328 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206b6b3-b34f-4ed2-a699-faba5c51c722 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:43.807607 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206b6b3-b34f-4ed2-a699-faba5c51c722 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:43.809344 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206b6b3-b34f-4ed2-a699-faba5c51c722 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:43.810044 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206b6b3-b34f-4ed2-a699-faba5c51c722 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:43.810350 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206b6b3-b34f-4ed2-a699-faba5c51c722 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:43.811716 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3206b6b3-b34f-4ed2-a699-faba5c51c722 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:43.831936 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 206/411] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:43.838444 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206b6b3-b34f-4ed2-a699-faba5c51c722 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:43.861489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d57a59-fa12-4469-a940-de0b052120d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:43.861489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d57a59-fa12-4469-a940-de0b052120d7 None admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:43.861489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d57a59-fa12-4469-a940-de0b052120d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:43.861489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d57a59-fa12-4469-a940-de0b052120d7 None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774/groups/28e08e9548e34ec589968d0b864da1d6/roles/6c6a208f837c453cb9aceca635451134` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:43.866343 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d57a59-fa12-4469-a940-de0b052120d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fab69605019c4852be1e8f0ff0978774, group_id=28e08e9548e34ec589968d0b864da1d6, role_id=6c6a208f837c453cb9aceca635451134)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:43.867624 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d57a59-fa12-4469-a940-de0b052120d7 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:43.881897 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:43.889705 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 206/412] 10.222.0.58 () {58 vars in 1442 bytes} [Wed Aug 24 09:31:43 2022] PUT /identity/v3/projects/fab69605019c4852be1e8f0ff0978774/groups/28e08e9548e34ec589968d0b864da1d6/roles/6c6a208f837c453cb9aceca635451134 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:31:43.891584 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5823a-3b25-4d5c-a6b2-fb125c37ec5d None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:43.892123 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5823a-3b25-4d5c-a6b2-fb125c37ec5d None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:43.892540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5823a-3b25-4d5c-a6b2-fb125c37ec5d None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:43.894223 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 207/413] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:43.901161 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ace8b-272c-47ce-bae4-a032e82fae77 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:43.901711 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ace8b-272c-47ce-bae4-a032e82fae77 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:43.902147 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ace8b-272c-47ce-bae4-a032e82fae77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:43.933967 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-dd3ace8b-272c-47ce-bae4-a032e82fae77 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:43.935653 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-dd3ace8b-272c-47ce-bae4-a032e82fae77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:43.969650 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206b6b3-b34f-4ed2-a699-faba5c51c722 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:43.975800 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:44.009595 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29254630-025d-40ec-b576-ab4713535847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:44.010396 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29254630-025d-40ec-b576-ab4713535847 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:44.011406 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29254630-025d-40ec-b576-ab4713535847 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:44.011779 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29254630-025d-40ec-b576-ab4713535847 None admin] PATH_INFO: `/v3/groups/bcfb6844b3da4255a5bcba26701f8dfc` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:44.013100 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29254630-025d-40ec-b576-ab4713535847 None admin] RBAC: Authorizing `identity:get_group(group_id=bcfb6844b3da4255a5bcba26701f8dfc)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:44.014706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29254630-025d-40ec-b576-ab4713535847 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:44.016778 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 207/414] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 09:31:43 2022] GET /identity/v3/groups/bcfb6844b3da4255a5bcba26701f8dfc => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:44.027639 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29254630-025d-40ec-b576-ab4713535847 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:44.086879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 208/415] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:31:44.160411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:44.166295 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29254630-025d-40ec-b576-ab4713535847 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:44.202569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b58bf-6b49-4115-861b-8a090c3215f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:44.203301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b58bf-6b49-4115-861b-8a090c3215f1 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:44.203650 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b58bf-6b49-4115-861b-8a090c3215f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:44.203995 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b58bf-6b49-4115-861b-8a090c3215f1 None admin] PATH_INFO: `/v3/projects/28c010260e5042edbe919c3cfc65493b` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:44.205200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b58bf-6b49-4115-861b-8a090c3215f1 None admin] RBAC: Authorizing `identity:get_project(project_id=28c010260e5042edbe919c3cfc65493b)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:44.207532 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b58bf-6b49-4115-861b-8a090c3215f1 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:44.209587 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 208/416] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:44 2022] GET /identity/v3/projects/28c010260e5042edbe919c3cfc65493b => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:44.215317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ace8b-272c-47ce-bae4-a032e82fae77 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:44.345994 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ace8b-272c-47ce-bae4-a032e82fae77 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:44.394813 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dd46b-e035-4624-8bb9-0a067186c295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:44.395713 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dd46b-e035-4624-8bb9-0a067186c295 None admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:44.396139 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dd46b-e035-4624-8bb9-0a067186c295 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:44.396560 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dd46b-e035-4624-8bb9-0a067186c295 None admin] PATH_INFO: `/v3/projects/28c010260e5042edbe919c3cfc65493b/groups/bcfb6844b3da4255a5bcba26701f8dfc/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:44.398694 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dd46b-e035-4624-8bb9-0a067186c295 None admin] RBAC: Authorizing `identity:create_grant(project_id=28c010260e5042edbe919c3cfc65493b, group_id=bcfb6844b3da4255a5bcba26701f8dfc, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:44.400254 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dd46b-e035-4624-8bb9-0a067186c295 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:44.402259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b58bf-6b49-4115-861b-8a090c3215f1 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:44.415568 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 209/417] 10.222.0.58 () {58 vars in 1442 bytes} [Wed Aug 24 09:31:44 2022] PUT /identity/v3/projects/28c010260e5042edbe919c3cfc65493b/groups/bcfb6844b3da4255a5bcba26701f8dfc/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:31:44.525925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b58bf-6b49-4115-861b-8a090c3215f1 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:44.564187 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61df22-5f9e-4339-9af7-f4c3ebe3c9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:44.565080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61df22-5f9e-4339-9af7-f4c3ebe3c9c4 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:44.566112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61df22-5f9e-4339-9af7-f4c3ebe3c9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:44.566785 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61df22-5f9e-4339-9af7-f4c3ebe3c9c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:44.578099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61df22-5f9e-4339-9af7-f4c3ebe3c9c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:44.583963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-1d61df22-5f9e-4339-9af7-f4c3ebe3c9c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:44.583963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:44.583963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:44.583963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:44.583963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:44.583963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:44.583963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:44.583963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:44.583963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:44.583963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:44.583963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:44.583963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:44.583963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:44.583963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:44.583963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:44.583963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:44.585080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:44.585080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:44.585080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:44.585080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:44.585080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:44.585080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:44.585080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:44.585080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:44.585080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:44.585080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:44.585080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:44.585080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:44.585080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:44.585080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:44.585080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:44.585080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:44.586112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:44.586112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:44.586112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:44.586112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:44.586112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:44.586112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:44.586112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:44.586112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:44.586112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:44.586112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:44.586112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:44.586112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:44.588485 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 209/418] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 09:31:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:44.594093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dd46b-e035-4624-8bb9-0a067186c295 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:44.622899 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:44.722703 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dd46b-e035-4624-8bb9-0a067186c295 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:44.762058 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04295f-c8f3-48a3-b4d8-6dd9b3edb1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:44.762669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04295f-c8f3-48a3-b4d8-6dd9b3edb1e0 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:44.762947 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04295f-c8f3-48a3-b4d8-6dd9b3edb1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:44.763220 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04295f-c8f3-48a3-b4d8-6dd9b3edb1e0 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:44.763885 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04295f-c8f3-48a3-b4d8-6dd9b3edb1e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:44.764188 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04295f-c8f3-48a3-b4d8-6dd9b3edb1e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:44.765568 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04295f-c8f3-48a3-b4d8-6dd9b3edb1e0 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:44.774792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 210/419] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:31:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:44.780016 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61df22-5f9e-4339-9af7-f4c3ebe3c9c4 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:44.836575 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:44.944412 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61df22-5f9e-4339-9af7-f4c3ebe3c9c4 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:44.990352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4955a-2a04-4061-a0bf-8119928493b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:44.990973 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4955a-2a04-4061-a0bf-8119928493b5 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:44.991251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4955a-2a04-4061-a0bf-8119928493b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:44.991524 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4955a-2a04-4061-a0bf-8119928493b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:45.091507 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4955a-2a04-4061-a0bf-8119928493b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:45.092982 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4955a-2a04-4061-a0bf-8119928493b5 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:45.128043 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:45.257423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 210/420] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:45.263639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04295f-c8f3-48a3-b4d8-6dd9b3edb1e0 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:45.295729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec31393-2b03-497c-8ecd-349932debe7f None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:45.296245 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec31393-2b03-497c-8ecd-349932debe7f None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:45.296672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec31393-2b03-497c-8ecd-349932debe7f None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:45.298454 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 211/421] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:31:45.303790 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a48b6-41bc-415d-88e0-2582c03b6fb8 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:45.304268 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a48b6-41bc-415d-88e0-2582c03b6fb8 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:45.304702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a48b6-41bc-415d-88e0-2582c03b6fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:45.326224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-f48a48b6-41bc-415d-88e0-2582c03b6fb8 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:45.327655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f48a48b6-41bc-415d-88e0-2582c03b6fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:45.383159 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:45.408137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04295f-c8f3-48a3-b4d8-6dd9b3edb1e0 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:45.413310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 212/422] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:31:45.418791 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab26d16-fa94-457f-9730-e8108540452c None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:45.419286 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab26d16-fa94-457f-9730-e8108540452c None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:45.419758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab26d16-fa94-457f-9730-e8108540452c None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:45.421505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 213/423] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:45.427216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af91691-ee19-4395-b427-19a5548cd187 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:45.428103 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af91691-ee19-4395-b427-19a5548cd187 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:45.428746 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af91691-ee19-4395-b427-19a5548cd187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:45.462039 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-4af91691-ee19-4395-b427-19a5548cd187 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:45.464162 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-4af91691-ee19-4395-b427-19a5548cd187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:45.476124 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cc01b-7121-41fd-92ab-f0cb6cb7bade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:45.477089 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cc01b-7121-41fd-92ab-f0cb6cb7bade None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:45.477596 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cc01b-7121-41fd-92ab-f0cb6cb7bade None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:45.478128 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cc01b-7121-41fd-92ab-f0cb6cb7bade None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:45.479585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4cc01b-7121-41fd-92ab-f0cb6cb7bade None admin] RBAC: Authorizing `identity:get_project(project_id=92dea89f3bc4436195a8b5f4a64fd785)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:45.482142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4cc01b-7121-41fd-92ab-f0cb6cb7bade None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:45.484372 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 211/424] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:45 2022] GET /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:45.491280 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cc01b-7121-41fd-92ab-f0cb6cb7bade None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:45.562028 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:45.601617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 214/425] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:45.659758 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cc01b-7121-41fd-92ab-f0cb6cb7bade None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:45.726759 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6abbfa-3922-4439-9e97-e43e6bcffe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:45.727459 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6abbfa-3922-4439-9e97-e43e6bcffe33 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:45.727744 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6abbfa-3922-4439-9e97-e43e6bcffe33 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:45.728012 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6abbfa-3922-4439-9e97-e43e6bcffe33 None admin] PATH_INFO: `/v3/groups/28e08e9548e34ec589968d0b864da1d6` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:45.729202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6abbfa-3922-4439-9e97-e43e6bcffe33 None admin] RBAC: Authorizing `identity:get_group(group_id=28e08e9548e34ec589968d0b864da1d6)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:45.730589 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6abbfa-3922-4439-9e97-e43e6bcffe33 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:45.732756 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 212/426] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 09:31:45 2022] GET /identity/v3/groups/28e08e9548e34ec589968d0b864da1d6 => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:45.738856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af91691-ee19-4395-b427-19a5548cd187 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:45.756705 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6abbfa-3922-4439-9e97-e43e6bcffe33 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:45.786304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:45.871651 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6abbfa-3922-4439-9e97-e43e6bcffe33 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:45.907556 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81982e-c0e5-4f8f-b944-8498cb2b8e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:45.908187 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81982e-c0e5-4f8f-b944-8498cb2b8e9a None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:45.908476 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81982e-c0e5-4f8f-b944-8498cb2b8e9a None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:45.908752 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81982e-c0e5-4f8f-b944-8498cb2b8e9a None admin] PATH_INFO: `/v3/roles/member` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:45.930765 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81982e-c0e5-4f8f-b944-8498cb2b8e9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:45.940612 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af91691-ee19-4395-b427-19a5548cd187 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:45.945570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-8e81982e-c0e5-4f8f-b944-8498cb2b8e9a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:45.945570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:45.945570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:45.945570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:45.945570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:45.945570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:45.945570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:45.945570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:45.945570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:45.945570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:45.945570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:45.945570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:45.945570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:45.945570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:45.945570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:45.945570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:45.946436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:45.946436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:45.946436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:45.946436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:45.946436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:45.946436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:45.946436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:45.946436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:45.946436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:45.946436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:45.946436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:45.946436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:45.946436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:45.946436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:45.946436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:45.946436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:45.947216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:45.947216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:45.947216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:45.947216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:45.947216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:45.947216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:45.947216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:45.947216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:45.947216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:45.947216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:45.947216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:45.947216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:45.947216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 213/427] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:45.952921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81982e-c0e5-4f8f-b944-8498cb2b8e9a None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:45.976325 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1532bb9-d30d-488f-beca-3bc1fae610e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:45.976982 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1532bb9-d30d-488f-beca-3bc1fae610e6 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:45.977258 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1532bb9-d30d-488f-beca-3bc1fae610e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:45.977564 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1532bb9-d30d-488f-beca-3bc1fae610e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:45.978285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1532bb9-d30d-488f-beca-3bc1fae610e6 None admin] RBAC: Adding query filter params (group.id=28e08e9548e34ec589968d0b864da1d6, role.id=6c6a208f837c453cb9aceca635451134, scope.project.id=92dea89f3bc4436195a8b5f4a64fd785) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:45.978589 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1532bb9-d30d-488f-beca-3bc1fae610e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:45.980070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1532bb9-d30d-488f-beca-3bc1fae610e6 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:45.986503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 215/428] 10.222.0.58 () {56 vars in 1376 bytes} [Wed Aug 24 09:31:45 2022] GET /identity/v3/role_assignments?group.id=28e08e9548e34ec589968d0b864da1d6&scope.project.id=92dea89f3bc4436195a8b5f4a64fd785&role.id=6c6a208f837c453cb9aceca635451134 => generated 611 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:46.061971 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:46.104697 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81982e-c0e5-4f8f-b944-8498cb2b8e9a None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:46.114125 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1532bb9-d30d-488f-beca-3bc1fae610e6 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:46.167768 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc47a0e-ac58-4493-93fb-11ca83e29a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:46.168786 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc47a0e-ac58-4493-93fb-11ca83e29a22 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:46.169319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc47a0e-ac58-4493-93fb-11ca83e29a22 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:46.169822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc47a0e-ac58-4493-93fb-11ca83e29a22 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:46.169926 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:46.170809 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc47a0e-ac58-4493-93fb-11ca83e29a22 None admin] RBAC: Adding query filter params (name=member) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:46.171327 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc47a0e-ac58-4493-93fb-11ca83e29a22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:46.172993 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc47a0e-ac58-4493-93fb-11ca83e29a22 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:46.183091 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 214/429] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:46.194500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc47a0e-ac58-4493-93fb-11ca83e29a22 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:46.244061 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1532bb9-d30d-488f-beca-3bc1fae610e6 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:46.288449 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6dc09f-9255-4642-88e2-ba97c4509e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:46.289251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dc09f-9255-4642-88e2-ba97c4509e37 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:46.289657 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dc09f-9255-4642-88e2-ba97c4509e37 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:46.290023 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dc09f-9255-4642-88e2-ba97c4509e37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:46.303077 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6dc09f-9255-4642-88e2-ba97c4509e37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:46.309755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-5d6dc09f-9255-4642-88e2-ba97c4509e37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:46.309755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:46.309755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:46.309755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:46.309755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:46.309755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:46.309755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:46.309755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:46.309755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:46.309755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:46.309755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:46.309755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:46.309755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:46.309755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:46.309755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:46.309755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:46.310772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:46.310772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:46.310772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:46.310772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:46.310772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:46.310772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:46.310772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:46.310772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:46.310772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:46.310772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:46.310772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:46.310772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:46.310772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:46.310772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:46.310772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:46.310772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:46.311560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:46.311560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:46.311560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:46.311560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:46.311560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:46.311560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:46.311560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:46.311560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:46.311560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:46.311560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:46.311560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 09:31:46.311560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:46.313549 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 216/430] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:46.319193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6dc09f-9255-4642-88e2-ba97c4509e37 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:46.331692 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc47a0e-ac58-4493-93fb-11ca83e29a22 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:46.381148 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea2718-cde4-4fa5-bd6a-b9631336b513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:46.381801 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea2718-cde4-4fa5-bd6a-b9631336b513 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:46.382081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea2718-cde4-4fa5-bd6a-b9631336b513 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:46.382354 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea2718-cde4-4fa5-bd6a-b9631336b513 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:46.417864 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:46.452473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6dc09f-9255-4642-88e2-ba97c4509e37 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:46.464277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:46.473110 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea2718-cde4-4fa5-bd6a-b9631336b513 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:46.474736 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea2718-cde4-4fa5-bd6a-b9631336b513 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:46.493784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6260c7-08d1-4049-a977-8cb3c8c72f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:46.494806 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6260c7-08d1-4049-a977-8cb3c8c72f9d None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:46.495276 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6260c7-08d1-4049-a977-8cb3c8c72f9d None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:46.495754 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6260c7-08d1-4049-a977-8cb3c8c72f9d None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:46.496698 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6260c7-08d1-4049-a977-8cb3c8c72f9d None admin] RBAC: Adding query filter params (name=member) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:46.497233 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6260c7-08d1-4049-a977-8cb3c8c72f9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:46.498845 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6260c7-08d1-4049-a977-8cb3c8c72f9d None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:46.508379 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 217/431] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:31:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:46.514687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6260c7-08d1-4049-a977-8cb3c8c72f9d None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:46.590316 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 215/432] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:46.595875 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea2718-cde4-4fa5-bd6a-b9631336b513 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:46.628162 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6260c7-08d1-4049-a977-8cb3c8c72f9d None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:46.637788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:46.663328 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8811f-b4de-4ab5-aff3-13d9f063395c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:46.663926 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8811f-b4de-4ab5-aff3-13d9f063395c None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:46.664201 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8811f-b4de-4ab5-aff3-13d9f063395c None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:46.664470 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8811f-b4de-4ab5-aff3-13d9f063395c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:46.703563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:46.711386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea2718-cde4-4fa5-bd6a-b9631336b513 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:46.732599 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8811f-b4de-4ab5-aff3-13d9f063395c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:46.734068 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8811f-b4de-4ab5-aff3-13d9f063395c None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:46.746005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beff1c6-1102-4e79-9ab9-4797accaa3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:46.746555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beff1c6-1102-4e79-9ab9-4797accaa3e6 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:46.746831 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beff1c6-1102-4e79-9ab9-4797accaa3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:46.747099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beff1c6-1102-4e79-9ab9-4797accaa3e6 None admin] PATH_INFO: `/v3/projects/92dea89f3bc4436195a8b5f4a64fd785` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:46.748220 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beff1c6-1102-4e79-9ab9-4797accaa3e6 None admin] RBAC: Authorizing `identity:get_project(project_id=92dea89f3bc4436195a8b5f4a64fd785)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:46.749664 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beff1c6-1102-4e79-9ab9-4797accaa3e6 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:46.751270 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 216/433] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:46 2022] GET /identity/v3/projects/92dea89f3bc4436195a8b5f4a64fd785 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:46.757965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec3b29-3039-4992-9d50-1c7038c15c21 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:46.758242 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec3b29-3039-4992-9d50-1c7038c15c21 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:46.758515 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec3b29-3039-4992-9d50-1c7038c15c21 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:46.759859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 217/434] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:46.760719 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dc9f5-2207-4ffb-90ff-29165aa1e585 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:46.760994 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dc9f5-2207-4ffb-90ff-29165aa1e585 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:46.761268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dc9f5-2207-4ffb-90ff-29165aa1e585 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:46.762589 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 218/435] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:46.763132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378dc9f5-2207-4ffb-90ff-29165aa1e585 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:46.839587 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 218/436] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:46.841193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca976d-a6fc-4a0b-bf0e-08f5f21bdf35 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:46.841505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca976d-a6fc-4a0b-bf0e-08f5f21bdf35 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:46.841785 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca976d-a6fc-4a0b-bf0e-08f5f21bdf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:46.859915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-9fca976d-a6fc-4a0b-bf0e-08f5f21bdf35 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:46.861109 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-9fca976d-a6fc-4a0b-bf0e-08f5f21bdf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:46.866742 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378dc9f5-2207-4ffb-90ff-29165aa1e585 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:46.869050 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:46.902044 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2ede6-2f28-4f6f-8e1e-7aa137024d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:46.902663 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2ede6-2f28-4f6f-8e1e-7aa137024d9b None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:46.902946 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2ede6-2f28-4f6f-8e1e-7aa137024d9b None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:46.903228 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2ede6-2f28-4f6f-8e1e-7aa137024d9b None admin] PATH_INFO: `/v3/groups/28e08e9548e34ec589968d0b864da1d6` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:46.904348 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2ede6-2f28-4f6f-8e1e-7aa137024d9b None admin] RBAC: Authorizing `identity:get_group(group_id=28e08e9548e34ec589968d0b864da1d6)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:46.905819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2ede6-2f28-4f6f-8e1e-7aa137024d9b None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:46.907385 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 219/437] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 09:31:46 2022] GET /identity/v3/groups/28e08e9548e34ec589968d0b864da1d6 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:46.908558 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6085c46-8588-44c9-b5a0-cfef72ecd051 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:46.908839 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6085c46-8588-44c9-b5a0-cfef72ecd051 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:46.909158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6085c46-8588-44c9-b5a0-cfef72ecd051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:46.926666 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-f6085c46-8588-44c9-b5a0-cfef72ecd051 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:46.927881 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-f6085c46-8588-44c9-b5a0-cfef72ecd051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:46.928944 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:46.933364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 219/438] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:46.934406 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca976d-a6fc-4a0b-bf0e-08f5f21bdf35 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:47.012005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 220/439] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:47.014498 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6085c46-8588-44c9-b5a0-cfef72ecd051 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:47.053559 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca976d-a6fc-4a0b-bf0e-08f5f21bdf35 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:47.096281 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9566739-e73c-4646-9982-9b3b9d70adcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:47.097670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9566739-e73c-4646-9982-9b3b9d70adcd None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:47.098165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9566739-e73c-4646-9982-9b3b9d70adcd None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:47.098623 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9566739-e73c-4646-9982-9b3b9d70adcd None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:47.100202 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9566739-e73c-4646-9982-9b3b9d70adcd None admin] RBAC: Authorizing `identity:get_project(project_id=fab69605019c4852be1e8f0ff0978774)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:47.102669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9566739-e73c-4646-9982-9b3b9d70adcd None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:47.110284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 220/440] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:46 2022] GET /identity/v3/projects/fab69605019c4852be1e8f0ff0978774 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:47.111303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9566739-e73c-4646-9982-9b3b9d70adcd None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:47.146113 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6085c46-8588-44c9-b5a0-cfef72ecd051 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:47.148179 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:47.183990 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:47.191352 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cce39-e6bd-4be8-ba0b-2ec7db4696b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:47.192242 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cce39-e6bd-4be8-ba0b-2ec7db4696b1 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:47.192749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cce39-e6bd-4be8-ba0b-2ec7db4696b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:47.193221 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cce39-e6bd-4be8-ba0b-2ec7db4696b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:47.194204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185cce39-e6bd-4be8-ba0b-2ec7db4696b1 None admin] RBAC: Adding query filter params (group.id=28e08e9548e34ec589968d0b864da1d6, role.id=ec487838eecf4dc4bde1eaa59af3eb26, scope.project.id=92dea89f3bc4436195a8b5f4a64fd785) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:47.194718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185cce39-e6bd-4be8-ba0b-2ec7db4696b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:47.196771 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185cce39-e6bd-4be8-ba0b-2ec7db4696b1 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:47.205244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 221/441] 10.222.0.58 () {56 vars in 1376 bytes} [Wed Aug 24 09:31:47 2022] GET /identity/v3/role_assignments?group.id=28e08e9548e34ec589968d0b864da1d6&scope.project.id=92dea89f3bc4436195a8b5f4a64fd785&role.id=ec487838eecf4dc4bde1eaa59af3eb26 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:47.207268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cce39-e6bd-4be8-ba0b-2ec7db4696b1 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:47.236313 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9566739-e73c-4646-9982-9b3b9d70adcd None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:47.302387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabd479-e110-410a-a486-f3c00f9a972e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:47.303085 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabd479-e110-410a-a486-f3c00f9a972e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:47.303442 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabd479-e110-410a-a486-f3c00f9a972e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:47.303786 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabd479-e110-410a-a486-f3c00f9a972e None admin] PATH_INFO: `/v3/groups/28e08e9548e34ec589968d0b864da1d6` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:47.305035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabd479-e110-410a-a486-f3c00f9a972e None admin] RBAC: Authorizing `identity:get_group(group_id=28e08e9548e34ec589968d0b864da1d6)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:47.306591 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabd479-e110-410a-a486-f3c00f9a972e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:47.308226 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 221/442] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 09:31:47 2022] GET /identity/v3/groups/28e08e9548e34ec589968d0b864da1d6 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:47.309017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabd479-e110-410a-a486-f3c00f9a972e None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:47.345935 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cce39-e6bd-4be8-ba0b-2ec7db4696b1 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:47.383430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308a30b-8976-4c1d-8619-40cf72efb874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:47.383890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308a30b-8976-4c1d-8619-40cf72efb874 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:47.384167 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308a30b-8976-4c1d-8619-40cf72efb874 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:47.384436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308a30b-8976-4c1d-8619-40cf72efb874 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:47.397407 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308a30b-8976-4c1d-8619-40cf72efb874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:47.402606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-0308a30b-8976-4c1d-8619-40cf72efb874 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:47.402606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:47.402606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:47.402606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:47.402606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:47.402606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:47.402606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:47.402606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:47.402606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:47.402606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:47.402606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:47.402606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:47.402606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:47.402606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:47.402606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:47.402606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:47.403687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:47.403687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:47.403687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:47.403687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:47.403687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:47.403687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:47.403687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:47.403687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:47.403687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:47.403687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:47.403687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:47.403687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:47.403687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:47.403687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:47.403687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:47.403687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:47.404477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:47.404477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:47.404477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:47.404477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:47.404477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:47.404477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:47.404477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:47.404477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:47.404477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:47.404477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:47.404477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:47.404477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:47.404477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 222/443] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 09:31:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:47.404477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308a30b-8976-4c1d-8619-40cf72efb874 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:47.431620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabd479-e110-410a-a486-f3c00f9a972e None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:47.437227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:47.469618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e450aa-ca51-4d31-b0b2-5f0086106279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:47.470402 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e450aa-ca51-4d31-b0b2-5f0086106279 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:47.470750 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e450aa-ca51-4d31-b0b2-5f0086106279 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:47.471029 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e450aa-ca51-4d31-b0b2-5f0086106279 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:47.474069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:47.484099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e450aa-ca51-4d31-b0b2-5f0086106279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:47.489505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-c1e450aa-ca51-4d31-b0b2-5f0086106279 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:31:47.489505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:47.489505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:47.489505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:47.489505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:47.489505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:47.489505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:47.489505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:47.489505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:47.489505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:47.489505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:47.489505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:47.489505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:47.489505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:47.489505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:47.489505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:47.490371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:47.490371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:47.490371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:47.490371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:47.490371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:47.490371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:47.490371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:47.490371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:47.490371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:47.490371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:47.490371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:47.490371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:47.490371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:47.490371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:47.490371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:47.490371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:47.491157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:47.491157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:47.491157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:47.491157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:47.491157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:47.491157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:47.491157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:47.491157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:47.491157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:47.491157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:47.491157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:31:47.491157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:47.491157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 222/444] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:31:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:47.491795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e450aa-ca51-4d31-b0b2-5f0086106279 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:47.541825 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308a30b-8976-4c1d-8619-40cf72efb874 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:47.582215 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582f728-a0d1-4cda-8c2d-5a4d44fb3b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:47.582825 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582f728-a0d1-4cda-8c2d-5a4d44fb3b1d None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:47.583098 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582f728-a0d1-4cda-8c2d-5a4d44fb3b1d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:47.583366 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582f728-a0d1-4cda-8c2d-5a4d44fb3b1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:47.584088 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582f728-a0d1-4cda-8c2d-5a4d44fb3b1d None admin] RBAC: Adding query filter params (group.id=28e08e9548e34ec589968d0b864da1d6, role.id=ec487838eecf4dc4bde1eaa59af3eb26, scope.project.id=fab69605019c4852be1e8f0ff0978774) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:47.584391 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582f728-a0d1-4cda-8c2d-5a4d44fb3b1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:47.585843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582f728-a0d1-4cda-8c2d-5a4d44fb3b1d None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:47.592750 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 223/445] 10.222.0.58 () {56 vars in 1376 bytes} [Wed Aug 24 09:31:47 2022] GET /identity/v3/role_assignments?group.id=28e08e9548e34ec589968d0b864da1d6&scope.project.id=fab69605019c4852be1e8f0ff0978774&role.id=ec487838eecf4dc4bde1eaa59af3eb26 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:47.593580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582f728-a0d1-4cda-8c2d-5a4d44fb3b1d None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:47.612736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e450aa-ca51-4d31-b0b2-5f0086106279 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:47.663714 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531a5c2-26ce-4cfd-9813-3b8f3b236658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:47.664345 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531a5c2-26ce-4cfd-9813-3b8f3b236658 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:47.664624 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531a5c2-26ce-4cfd-9813-3b8f3b236658 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:47.664895 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531a5c2-26ce-4cfd-9813-3b8f3b236658 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:47.665625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531a5c2-26ce-4cfd-9813-3b8f3b236658 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:47.665940 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531a5c2-26ce-4cfd-9813-3b8f3b236658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:47.667362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531a5c2-26ce-4cfd-9813-3b8f3b236658 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:47.678832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 223/446] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:31:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:47.684782 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531a5c2-26ce-4cfd-9813-3b8f3b236658 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:47.726881 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:47.743269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582f728-a0d1-4cda-8c2d-5a4d44fb3b1d None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:47.767918 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:47.789163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e522ae4-b80c-44c6-af74-db23d7815991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:47.789943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e522ae4-b80c-44c6-af74-db23d7815991 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:47.790247 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e522ae4-b80c-44c6-af74-db23d7815991 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:47.790577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e522ae4-b80c-44c6-af74-db23d7815991 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:47.791272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e522ae4-b80c-44c6-af74-db23d7815991 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:47.791579 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e522ae4-b80c-44c6-af74-db23d7815991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:47.793096 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e522ae4-b80c-44c6-af74-db23d7815991 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:47.806009 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 224/447] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:47.811354 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e522ae4-b80c-44c6-af74-db23d7815991 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:47.823925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531a5c2-26ce-4cfd-9813-3b8f3b236658 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:47.865873 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26eb3e-4d3f-4cf3-9ef0-fe2519a2f455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:47.866411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26eb3e-4d3f-4cf3-9ef0-fe2519a2f455 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:47.867219 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26eb3e-4d3f-4cf3-9ef0-fe2519a2f455 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:47.867219 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26eb3e-4d3f-4cf3-9ef0-fe2519a2f455 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:47.930982 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e522ae4-b80c-44c6-af74-db23d7815991 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:47.947889 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26eb3e-4d3f-4cf3-9ef0-fe2519a2f455 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:47.949353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26eb3e-4d3f-4cf3-9ef0-fe2519a2f455 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:47.971967 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3b60a-0f65-44d0-9b00-9bd620d5ab42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:47.972582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3b60a-0f65-44d0-9b00-9bd620d5ab42 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:47.972863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3b60a-0f65-44d0-9b00-9bd620d5ab42 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:47.973139 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3b60a-0f65-44d0-9b00-9bd620d5ab42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:47.995117 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:48.011782 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:48.043406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3b60a-0f65-44d0-9b00-9bd620d5ab42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:48.044881 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f3b60a-0f65-44d0-9b00-9bd620d5ab42 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:48.054708 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 224/448] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 09:31:48.060453 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26eb3e-4d3f-4cf3-9ef0-fe2519a2f455 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:48.142876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 225/449] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 09:31:48.148934 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3b60a-0f65-44d0-9b00-9bd620d5ab42 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:48.157687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26eb3e-4d3f-4cf3-9ef0-fe2519a2f455 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:48.193888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47f655-e1cd-44bc-a4b0-23a104b56c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:48.194506 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47f655-e1cd-44bc-a4b0-23a104b56c85 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:48.194786 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47f655-e1cd-44bc-a4b0-23a104b56c85 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:48.195062 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47f655-e1cd-44bc-a4b0-23a104b56c85 None admin] PATH_INFO: `/v3/projects/fab69605019c4852be1e8f0ff0978774` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:48.196181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47f655-e1cd-44bc-a4b0-23a104b56c85 None admin] RBAC: Authorizing `identity:get_project(project_id=fab69605019c4852be1e8f0ff0978774)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:48.197634 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47f655-e1cd-44bc-a4b0-23a104b56c85 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:48.199269 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 225/450] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:48 2022] GET /identity/v3/projects/fab69605019c4852be1e8f0ff0978774 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:48.199396 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:48.204988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47f655-e1cd-44bc-a4b0-23a104b56c85 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:48.233218 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:48.250766 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3b60a-0f65-44d0-9b00-9bd620d5ab42 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:48.285049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac3523-f424-45d4-869f-aed84a2a224e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:48.285696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac3523-f424-45d4-869f-aed84a2a224e None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:48.285979 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac3523-f424-45d4-869f-aed84a2a224e None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:48.286254 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac3523-f424-45d4-869f-aed84a2a224e None admin] PATH_INFO: `/v3/projects/28c010260e5042edbe919c3cfc65493b` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:48.287397 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac3523-f424-45d4-869f-aed84a2a224e None admin] RBAC: Authorizing `identity:get_project(project_id=28c010260e5042edbe919c3cfc65493b)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:48.288829 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac3523-f424-45d4-869f-aed84a2a224e None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:48.290481 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 226/451] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:31:48 2022] GET /identity/v3/projects/28c010260e5042edbe919c3cfc65493b => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:48.295983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac3523-f424-45d4-869f-aed84a2a224e None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:48.306186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47f655-e1cd-44bc-a4b0-23a104b56c85 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:48.338975 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc1cf3-4ade-42e1-95fd-80265d62be23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:48.339592 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc1cf3-4ade-42e1-95fd-80265d62be23 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:48.339868 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc1cf3-4ade-42e1-95fd-80265d62be23 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:48.340138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc1cf3-4ade-42e1-95fd-80265d62be23 None admin] PATH_INFO: `/v3/groups/28e08e9548e34ec589968d0b864da1d6` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:48.341244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc1cf3-4ade-42e1-95fd-80265d62be23 None admin] RBAC: Authorizing `identity:get_group(group_id=28e08e9548e34ec589968d0b864da1d6)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:48.342694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc1cf3-4ade-42e1-95fd-80265d62be23 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:48.344251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 226/452] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 09:31:48 2022] GET /identity/v3/groups/28e08e9548e34ec589968d0b864da1d6 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:48.350543 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc1cf3-4ade-42e1-95fd-80265d62be23 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:48.398383 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac3523-f424-45d4-869f-aed84a2a224e None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:48.418438 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:48.431973 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd7a0d-8f98-4b97-9ee1-f7abf1fd6206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:48.432597 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd7a0d-8f98-4b97-9ee1-f7abf1fd6206 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:48.432874 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd7a0d-8f98-4b97-9ee1-f7abf1fd6206 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:48.433141 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd7a0d-8f98-4b97-9ee1-f7abf1fd6206 None admin] PATH_INFO: `/v3/groups/bcfb6844b3da4255a5bcba26701f8dfc` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:48.434283 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd7a0d-8f98-4b97-9ee1-f7abf1fd6206 None admin] RBAC: Authorizing `identity:get_group(group_id=bcfb6844b3da4255a5bcba26701f8dfc)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:48.435699 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd7a0d-8f98-4b97-9ee1-f7abf1fd6206 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:48.437254 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 227/453] 10.222.0.58 () {56 vars in 1180 bytes} [Wed Aug 24 09:31:48 2022] GET /identity/v3/groups/bcfb6844b3da4255a5bcba26701f8dfc => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:48.444269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd7a0d-8f98-4b97-9ee1-f7abf1fd6206 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:48.459960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:48.467147 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc1cf3-4ade-42e1-95fd-80265d62be23 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:48.501322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbad7ce-b8c2-45b0-927f-80a8593e38d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:48.501951 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbad7ce-b8c2-45b0-927f-80a8593e38d7 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:48.502233 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbad7ce-b8c2-45b0-927f-80a8593e38d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:48.502508 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbad7ce-b8c2-45b0-927f-80a8593e38d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:48.503826 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbad7ce-b8c2-45b0-927f-80a8593e38d7 None admin] RBAC: Adding query filter params (group.id=28e08e9548e34ec589968d0b864da1d6, role.id=6c6a208f837c453cb9aceca635451134, scope.project.id=fab69605019c4852be1e8f0ff0978774) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:48.504079 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbad7ce-b8c2-45b0-927f-80a8593e38d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:48.505535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbad7ce-b8c2-45b0-927f-80a8593e38d7 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:48.511165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 227/454] 10.222.0.58 () {56 vars in 1376 bytes} [Wed Aug 24 09:31:48 2022] GET /identity/v3/role_assignments?group.id=28e08e9548e34ec589968d0b864da1d6&scope.project.id=fab69605019c4852be1e8f0ff0978774&role.id=6c6a208f837c453cb9aceca635451134 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:48.547130 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd7a0d-8f98-4b97-9ee1-f7abf1fd6206 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:48.584072 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a356c52-3e2e-4733-ae99-9be092d69301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:48.584694 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a356c52-3e2e-4733-ae99-9be092d69301 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:48.584974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a356c52-3e2e-4733-ae99-9be092d69301 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:48.585247 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a356c52-3e2e-4733-ae99-9be092d69301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:48.586034 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a356c52-3e2e-4733-ae99-9be092d69301 None admin] RBAC: Adding query filter params (group.id=bcfb6844b3da4255a5bcba26701f8dfc, role.id=cd2effe8340d4be08a28d3a40db6979d, scope.project.id=28c010260e5042edbe919c3cfc65493b) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:48.586348 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a356c52-3e2e-4733-ae99-9be092d69301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:48.587810 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a356c52-3e2e-4733-ae99-9be092d69301 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:48.594232 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 228/455] 10.222.0.58 () {56 vars in 1376 bytes} [Wed Aug 24 09:31:48 2022] GET /identity/v3/role_assignments?group.id=bcfb6844b3da4255a5bcba26701f8dfc&scope.project.id=28c010260e5042edbe919c3cfc65493b&role.id=cd2effe8340d4be08a28d3a40db6979d => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:51.188580 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff5cae-dadf-47ae-977e-ca770159d96f None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:51.189112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff5cae-dadf-47ae-977e-ca770159d96f None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:51.189112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff5cae-dadf-47ae-977e-ca770159d96f None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:51.191619 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 228/456] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:51.197206 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26cf5f-d0be-465d-a328-176c0c87ad83 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:51.197667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26cf5f-d0be-465d-a328-176c0c87ad83 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:51.197843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26cf5f-d0be-465d-a328-176c0c87ad83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:51.226951 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-9b26cf5f-d0be-465d-a328-176c0c87ad83 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:51.227788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-9b26cf5f-d0be-465d-a328-176c0c87ad83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:51.294603 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:51.326147 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 229/457] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:51.329281 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90163915-1c5b-452f-b37e-6123166b7106 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:51.329602 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90163915-1c5b-452f-b37e-6123166b7106 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:51.329883 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90163915-1c5b-452f-b37e-6123166b7106 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:51.332194 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 229/458] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:51.338551 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae88d47-9fd4-48b3-a988-a734fc756659 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:51.338849 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae88d47-9fd4-48b3-a988-a734fc756659 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:51.339122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae88d47-9fd4-48b3-a988-a734fc756659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:51.364620 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-9ae88d47-9fd4-48b3-a988-a734fc756659 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:51.365978 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-9ae88d47-9fd4-48b3-a988-a734fc756659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:51.459196 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 230/459] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:51.638890 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90163915-1c5b-452f-b37e-6123166b7106 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:51.668920 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e17bd4-f939-41b9-bfbd-7a3a20bdd383 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:51.669251 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e17bd4-f939-41b9-bfbd-7a3a20bdd383 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:51.669495 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e17bd4-f939-41b9-bfbd-7a3a20bdd383 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:51.671120 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 231/460] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:51.684934 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce077b1-0f44-4654-ada5-04f8db36c8fe None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:51.685210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce077b1-0f44-4654-ada5-04f8db36c8fe None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:51.685506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce077b1-0f44-4654-ada5-04f8db36c8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:51.736809 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-8ce077b1-0f44-4654-ada5-04f8db36c8fe None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:51.738582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-8ce077b1-0f44-4654-ada5-04f8db36c8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:51.759920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90163915-1c5b-452f-b37e-6123166b7106 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:51.835273 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f68e9f-a206-4278-bfb7-201fec59133e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:51.835914 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f68e9f-a206-4278-bfb7-201fec59133e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:51.836192 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f68e9f-a206-4278-bfb7-201fec59133e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:51.836467 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f68e9f-a206-4278-bfb7-201fec59133e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:51.850355 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f68e9f-a206-4278-bfb7-201fec59133e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:51.851920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f68e9f-a206-4278-bfb7-201fec59133e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:51.859922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 232/461] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 24 09:31:51.860790 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce077b1-0f44-4654-ada5-04f8db36c8fe None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:51.868678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-e9f68e9f-a206-4278-bfb7-201fec59133e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:31:51.868678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:51.868678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:51.868678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:51.868678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:51.868678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:51.868678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:51.868678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:51.868678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:51.868678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:51.868678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:51.868678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:51.868678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:31:51.868678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:31:51.868678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:31:51.868678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:31:51.869618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:51.869618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:51.869618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:51.869618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:51.869618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:51.869618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:51.869618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:51.869618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:51.869618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:51.869618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:51.869618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:51.869618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:51.869618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:51.869618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:51.869618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:51.869618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:51.869618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:31:51.870444 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:31:51.870444 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:31:51.870444 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:51.874742 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 230/462] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:51.875998 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67706864-b36f-4491-8a84-9898e45e8361 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:51.876384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67706864-b36f-4491-8a84-9898e45e8361 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:51.876666 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67706864-b36f-4491-8a84-9898e45e8361 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:51.878891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 231/463] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:51.879601 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67706864-b36f-4491-8a84-9898e45e8361 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:51.893931 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:51.913692 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:51.995439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce077b1-0f44-4654-ada5-04f8db36c8fe None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:52.005242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67706864-b36f-4491-8a84-9898e45e8361 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:52.042408 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be79306-0dae-463f-86f5-37e1faa469bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:52.043175 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be79306-0dae-463f-86f5-37e1faa469bc None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:52.043553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be79306-0dae-463f-86f5-37e1faa469bc None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:52.043929 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be79306-0dae-463f-86f5-37e1faa469bc None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:52.044036 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b18f4-ba9c-4a40-be41-115d90e554b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:52.044634 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b18f4-ba9c-4a40-be41-115d90e554b8 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:52.044846 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be79306-0dae-463f-86f5-37e1faa469bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:52.044962 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b18f4-ba9c-4a40-be41-115d90e554b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:52.045178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b18f4-ba9c-4a40-be41-115d90e554b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:52.045379 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be79306-0dae-463f-86f5-37e1faa469bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:52.046827 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be79306-0dae-463f-86f5-37e1faa469bc None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:52.056684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b18f4-ba9c-4a40-be41-115d90e554b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:52.058644 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b18f4-ba9c-4a40-be41-115d90e554b8 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:52.065804 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 232/464] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:52.068201 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b0e51-6896-4fa0-b7d4-75a48f09a4b9 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:52.068761 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b0e51-6896-4fa0-b7d4-75a48f09a4b9 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:52.069310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b0e51-6896-4fa0-b7d4-75a48f09a4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:52.082823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-048b18f4-ba9c-4a40-be41-115d90e554b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:31:52.082823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:52.082823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:52.082823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:52.082823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:52.082823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:52.082823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:52.082823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:52.082823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:52.082823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:52.082823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:52.082823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:52.082823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:31:52.082823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:31:52.082823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:31:52.082823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:31:52.084749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:52.084749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:52.084749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:52.084749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:52.084749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:52.084749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:52.084749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:52.084749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:52.084749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:52.084749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:52.084749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:52.084749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:52.084749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:52.084749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:52.084749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:52.084749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:52.084749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:31:52.086877 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:31:52.086877 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:31:52.086877 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:52.086877 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 233/465] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:52.086877 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b18f4-ba9c-4a40-be41-115d90e554b8 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:52.093456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-6e1b0e51-6896-4fa0-b7d4-75a48f09a4b9 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:52.094810 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-6e1b0e51-6896-4fa0-b7d4-75a48f09a4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:52.170242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:52.176936 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 233/466] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:52.177859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b0e51-6896-4fa0-b7d4-75a48f09a4b9 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:52.201600 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:52.210318 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b18f4-ba9c-4a40-be41-115d90e554b8 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:52.260246 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d90cc7-a57b-4b51-8a0e-45bb82c6c1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:52.260779 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d90cc7-a57b-4b51-8a0e-45bb82c6c1f7 None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:52.261058 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d90cc7-a57b-4b51-8a0e-45bb82c6c1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:52.261346 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d90cc7-a57b-4b51-8a0e-45bb82c6c1f7 None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:52.261999 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d90cc7-a57b-4b51-8a0e-45bb82c6c1f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:52.263426 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d90cc7-a57b-4b51-8a0e-45bb82c6c1f7 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:52.287098 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 234/467] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 09:31:52 2022] POST /identity/v3/users => generated 246 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:31:52.287919 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d90cc7-a57b-4b51-8a0e-45bb82c6c1f7 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:52.330277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b0e51-6896-4fa0-b7d4-75a48f09a4b9 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:52.376543 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d325d-f8ae-4432-8f95-e08a4b547e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:52.377160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d325d-f8ae-4432-8f95-e08a4b547e35 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:52.378754 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d325d-f8ae-4432-8f95-e08a4b547e35 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:52.379026 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d325d-f8ae-4432-8f95-e08a4b547e35 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:52.379758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d325d-f8ae-4432-8f95-e08a4b547e35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:52.379982 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d325d-f8ae-4432-8f95-e08a4b547e35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:52.381428 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d325d-f8ae-4432-8f95-e08a4b547e35 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:52.399069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 234/468] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:52.400507 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd8317-9f81-4710-870f-01404660d71e None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:52.400794 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd8317-9f81-4710-870f-01404660d71e None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:52.401064 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd8317-9f81-4710-870f-01404660d71e None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:52.402722 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 235/469] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:52.409224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a8174-58a7-4043-ac3a-51d5d572db20 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:52.409625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a8174-58a7-4043-ac3a-51d5d572db20 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:52.409959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a8174-58a7-4043-ac3a-51d5d572db20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:52.434890 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-2d9a8174-58a7-4043-ac3a-51d5d572db20 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:52.437030 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2d9a8174-58a7-4043-ac3a-51d5d572db20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:52.456521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d90cc7-a57b-4b51-8a0e-45bb82c6c1f7 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:52.497923 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7a504-02af-4529-9c17-4647af44892b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:52.498562 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7a504-02af-4529-9c17-4647af44892b None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:52.498842 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7a504-02af-4529-9c17-4647af44892b None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:52.499119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7a504-02af-4529-9c17-4647af44892b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:52.506533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:52.511028 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7a504-02af-4529-9c17-4647af44892b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:52.512492 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7a504-02af-4529-9c17-4647af44892b None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:52.520564 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 236/470] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:52.521975 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a8174-58a7-4043-ac3a-51d5d572db20 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:52.527521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-1af7a504-02af-4529-9c17-4647af44892b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:31:52.527521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:52.527521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:52.527521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:52.527521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:52.527521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:52.527521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:52.527521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:52.527521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:52.527521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:52.527521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:52.527521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:52.527521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:31:52.527521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:31:52.527521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:31:52.527521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:31:52.528583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:52.528583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:52.528583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:52.528583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:52.528583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:52.528583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:52.528583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:52.528583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:52.528583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:52.528583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:52.528583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:52.528583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:52.528583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:52.528583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:52.528583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:52.528583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:52.528583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:31:52.529623 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:31:52.529623 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:31:52.529623 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:52.531332 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 235/471] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:31:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:52.532150 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7a504-02af-4529-9c17-4647af44892b None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:52.535877 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:52.646184 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7a504-02af-4529-9c17-4647af44892b None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:52.667728 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a8174-58a7-4043-ac3a-51d5d572db20 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:52.683476 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de2ff9-6c33-4e60-9065-b7c3bc944383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:52.684240 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de2ff9-6c33-4e60-9065-b7c3bc944383 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:52.684591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de2ff9-6c33-4e60-9065-b7c3bc944383 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:52.684934 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de2ff9-6c33-4e60-9065-b7c3bc944383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:52.696390 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de2ff9-6c33-4e60-9065-b7c3bc944383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:52.697941 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de2ff9-6c33-4e60-9065-b7c3bc944383 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:52.711260 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1353f0f-6dc1-4c64-aa9b-a6727e5285f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:52.712040 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1353f0f-6dc1-4c64-aa9b-a6727e5285f5 None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:52.712458 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1353f0f-6dc1-4c64-aa9b-a6727e5285f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:52.712862 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1353f0f-6dc1-4c64-aa9b-a6727e5285f5 None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:52.713692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1353f0f-6dc1-4c64-aa9b-a6727e5285f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:52.715242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1353f0f-6dc1-4c64-aa9b-a6727e5285f5 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:52.715642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-65de2ff9-6c33-4e60-9065-b7c3bc944383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:31:52.715642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:52.715642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:52.715642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:52.715642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:52.715642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:52.715642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:52.715642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:52.715642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:52.715642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:52.715642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:52.715642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:52.715642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:31:52.715642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:31:52.715642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:31:52.715642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:31:52.716595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:52.716595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:52.716595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:52.716595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:52.716595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:52.716595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:52.716595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:52.716595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:52.716595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:52.716595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:52.716595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:52.716595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:52.716595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:52.716595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:52.716595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:52.716595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:52.716595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:31:52.717396 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:31:52.717396 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:31:52.717396 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:52.717925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 236/472] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:31:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:52.718815 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de2ff9-6c33-4e60-9065-b7c3bc944383 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:52.754211 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 237/473] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 09:31:52 2022] POST /identity/v3/users => generated 248 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:31:52.754211 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1353f0f-6dc1-4c64-aa9b-a6727e5285f5 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:52.806471 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:52.851346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:52.863326 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de2ff9-6c33-4e60-9065-b7c3bc944383 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:52.901857 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c9847-cf9b-4857-a603-5f17f40939cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:52.902461 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c9847-cf9b-4857-a603-5f17f40939cd None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:52.902737 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c9847-cf9b-4857-a603-5f17f40939cd None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:52.903008 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c9847-cf9b-4857-a603-5f17f40939cd None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:52.903653 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c9847-cf9b-4857-a603-5f17f40939cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:52.903952 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c9847-cf9b-4857-a603-5f17f40939cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:52.905310 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c9847-cf9b-4857-a603-5f17f40939cd None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:52.918774 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 237/474] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:52.919584 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c9847-cf9b-4857-a603-5f17f40939cd None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:52.926838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1353f0f-6dc1-4c64-aa9b-a6727e5285f5 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:52.970551 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffc972-93a5-4b71-8a14-796faf471ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:52.971519 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffc972-93a5-4b71-8a14-796faf471ece None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:52.972132 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffc972-93a5-4b71-8a14-796faf471ece None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:52.972585 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffc972-93a5-4b71-8a14-796faf471ece None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:52.973449 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffc972-93a5-4b71-8a14-796faf471ece None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:52.973781 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffc972-93a5-4b71-8a14-796faf471ece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:52.975157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffc972-93a5-4b71-8a14-796faf471ece None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:52.989612 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 238/475] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:52.990463 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffc972-93a5-4b71-8a14-796faf471ece None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:53.054974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c9847-cf9b-4857-a603-5f17f40939cd None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:53.080706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:53.097640 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6959e9-d2a7-4db5-8b8c-c793ec5f4bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:53.098615 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6959e9-d2a7-4db5-8b8c-c793ec5f4bff None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:53.099085 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6959e9-d2a7-4db5-8b8c-c793ec5f4bff None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:53.099561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6959e9-d2a7-4db5-8b8c-c793ec5f4bff None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:53.100416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6959e9-d2a7-4db5-8b8c-c793ec5f4bff None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:53.102286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6959e9-d2a7-4db5-8b8c-c793ec5f4bff None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:53.112057 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.sql.core [None req-9d6959e9-d2a7-4db5-8b8c-c793ec5f4bff None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 09:31:53.112057 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 09:31:53.112057 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [parameters: {'id': 'f10209859af04e728b1edcc337e35e2f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 09:31:53.112057 dv-cinder-854271-2-smb devstack@keystone.service[82884]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82884) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 09:31:53.114871 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffc972-93a5-4b71-8a14-796faf471ece None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:53.133815 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:53.134420 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-9d6959e9-d2a7-4db5-8b8c-c793ec5f4bff None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 09:31:53.134420 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:53.134420 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 09:31:53.134420 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 09:31:53.134420 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 09:31:53.134420 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 09:31:53.134420 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 09:31:53.134420 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 09:31:53.134420 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 09:31:53.134420 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application conn.query(q) Aug 24 09:31:53.134420 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 09:31:53.134420 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 09:31:53.134420 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 09:31:53.134420 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application result.read() Aug 24 09:31:53.134420 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 09:31:53.135257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 09:31:53.135257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 09:31:53.135257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 09:31:53.135257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 09:31:53.135257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 09:31:53.135257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 09:31:53.135257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 09:31:53.135257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 09:31:53.135257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:53.135257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 09:31:53.135257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:53.135257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:53.135257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 09:31:53.135257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 09:31:53.135257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 09:31:53.135257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 09:31:53.135257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 09:31:53.135257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application next(self.gen) Aug 24 09:31:53.136160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 09:31:53.136160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application yield resource Aug 24 09:31:53.136160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 09:31:53.136160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application next(self.gen) Aug 24 09:31:53.136160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 09:31:53.136160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 09:31:53.136160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 09:31:53.136160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 09:31:53.136160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 09:31:53.136160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise self.value Aug 24 09:31:53.136160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 09:31:53.136160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 09:31:53.136160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 09:31:53.136160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application session.commit() Aug 24 09:31:53.136160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 09:31:53.136160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 09:31:53.136160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 09:31:53.137093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 09:31:53.137093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 09:31:53.137093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self.session.flush() Aug 24 09:31:53.137093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 09:31:53.137093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 09:31:53.137093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 09:31:53.137093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 09:31:53.137093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 09:31:53.137093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application compat.raise_( Aug 24 09:31:53.137093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 09:31:53.137093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception Aug 24 09:31:53.137093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 09:31:53.137093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 09:31:53.137093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 09:31:53.137093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 09:31:53.137093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 09:31:53.137093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 09:31:53.138575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 09:31:53.138575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 09:31:53.138575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 09:31:53.138575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 09:31:53.138575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 09:31:53.138575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 09:31:53.138575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 09:31:53.138575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 09:31:53.138575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 09:31:53.138575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 09:31:53.138575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 09:31:53.138575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 09:31:53.138575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 09:31:53.138575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 09:31:53.138575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 09:31:53.138575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception Aug 24 09:31:53.140690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 09:31:53.140690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 09:31:53.140690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 09:31:53.140690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 09:31:53.140690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 09:31:53.140690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 09:31:53.140690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 09:31:53.140690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application conn.query(q) Aug 24 09:31:53.140690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 09:31:53.140690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 09:31:53.140690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 09:31:53.140690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application result.read() Aug 24 09:31:53.140690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 09:31:53.140690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 09:31:53.140690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 09:31:53.140690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 09:31:53.143244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 09:31:53.143244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 09:31:53.143244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 09:31:53.143244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 09:31:53.143244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 09:31:53.143244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 09:31:53.143244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [parameters: {'id': 'f10209859af04e728b1edcc337e35e2f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 09:31:53.143244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 09:31:53.143244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:53.143244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:31:53.143244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:53.143244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:53.143244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:53.143244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:53.143244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:53.143244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:53.146331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:53.146331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:53.146331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:53.146331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:53.146331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:53.146331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:53.146331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 09:31:53.146331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 09:31:53.146331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:53.146331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:53.146331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 09:31:53.146331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 09:31:53.146331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 09:31:53.146331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 09:31:53.146331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 09:31:53.146331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:53.149049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 238/476] 10.222.0.58 () {60 vars in 1131 bytes} [Wed Aug 24 09:31:52 2022] POST /identity/v3/roles => generated 144 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:53.149049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6959e9-d2a7-4db5-8b8c-c793ec5f4bff None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:53.163877 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd5cfb-d29d-45e6-a979-19f3c92310c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:53.164891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd5cfb-d29d-45e6-a979-19f3c92310c7 None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:53.165651 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd5cfb-d29d-45e6-a979-19f3c92310c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:53.166184 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd5cfb-d29d-45e6-a979-19f3c92310c7 None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:53.167134 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd5cfb-d29d-45e6-a979-19f3c92310c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:53.169554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd5cfb-d29d-45e6-a979-19f3c92310c7 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:53.201393 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 239/477] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 09:31:52 2022] POST /identity/v3/users => generated 248 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:31:53.202936 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd5cfb-d29d-45e6-a979-19f3c92310c7 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:53.320579 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6959e9-d2a7-4db5-8b8c-c793ec5f4bff None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:53.382490 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f772fd-8eb7-42e5-abcb-4b8d7d20be5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:53.383109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f772fd-8eb7-42e5-abcb-4b8d7d20be5b None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:53.383392 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f772fd-8eb7-42e5-abcb-4b8d7d20be5b None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:53.383668 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f772fd-8eb7-42e5-abcb-4b8d7d20be5b None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:53.384323 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f772fd-8eb7-42e5-abcb-4b8d7d20be5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:53.385799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f772fd-8eb7-42e5-abcb-4b8d7d20be5b None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:53.418126 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 239/478] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 09:31:53 2022] POST /identity/v3/users => generated 249 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:31:53.428693 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd5cfb-d29d-45e6-a979-19f3c92310c7 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:53.473884 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7674e-3711-4b26-b8aa-4fbbb7a81b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:53.474570 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7674e-3711-4b26-b8aa-4fbbb7a81b38 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:53.474820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7674e-3711-4b26-b8aa-4fbbb7a81b38 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:53.475154 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7674e-3711-4b26-b8aa-4fbbb7a81b38 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:53.487644 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7674e-3711-4b26-b8aa-4fbbb7a81b38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:53.493006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-cff7674e-3711-4b26-b8aa-4fbbb7a81b38 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:53.493006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:53.493006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:53.493006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:53.493006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:53.493006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:53.493006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:53.493006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:53.493006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:53.493006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:53.493006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:53.493006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:53.493006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:53.493006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:53.493006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:53.493006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:53.494180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:53.494180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:53.494180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:53.494180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:53.494180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:53.494180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:53.494180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:53.494180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:53.494180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:53.494180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:53.494180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:53.494180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:53.494180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:53.494180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:53.494180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:53.494180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:53.495161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:53.495161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:53.495161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:53.495161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:53.495161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:53.495161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:53.495161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:53.495161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:53.495161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:53.495161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:53.495161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 09:31:53.495161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:53.495161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 240/479] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 09:31:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:53.502402 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f772fd-8eb7-42e5-abcb-4b8d7d20be5b None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:53.550804 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:53.635467 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f772fd-8eb7-42e5-abcb-4b8d7d20be5b None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:53.671537 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c858a0-2e01-4962-a0fe-a38d08a80e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:53.672154 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c858a0-2e01-4962-a0fe-a38d08a80e75 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:53.672507 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c858a0-2e01-4962-a0fe-a38d08a80e75 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:53.672840 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c858a0-2e01-4962-a0fe-a38d08a80e75 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:53.673538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c858a0-2e01-4962-a0fe-a38d08a80e75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:53.673848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c858a0-2e01-4962-a0fe-a38d08a80e75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:53.675389 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c858a0-2e01-4962-a0fe-a38d08a80e75 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:53.684186 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 240/480] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:31:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:54.646144 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87af261-8d0a-495a-92cf-84a9a75c8362 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:54.646696 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87af261-8d0a-495a-92cf-84a9a75c8362 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:54.646696 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87af261-8d0a-495a-92cf-84a9a75c8362 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:54.648157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 241/481] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:54.663264 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38996911-7d00-4bf7-a3d6-d78ec3cac9ca None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:54.663733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38996911-7d00-4bf7-a3d6-d78ec3cac9ca None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:54.663805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38996911-7d00-4bf7-a3d6-d78ec3cac9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:54.686773 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-38996911-7d00-4bf7-a3d6-d78ec3cac9ca None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:54.687974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-38996911-7d00-4bf7-a3d6-d78ec3cac9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:54.778830 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 241/482] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:54.907937 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd7498-a3af-4bc6-b3d5-4c385ca3f2ec None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:54.908222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd7498-a3af-4bc6-b3d5-4c385ca3f2ec None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:54.908402 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd7498-a3af-4bc6-b3d5-4c385ca3f2ec None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:54.910069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 242/483] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:54.915550 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54d7ab-50b8-4527-b0a2-4491181836b7 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:54.915841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54d7ab-50b8-4527-b0a2-4491181836b7 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:54.916111 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54d7ab-50b8-4527-b0a2-4491181836b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:54.944206 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-6c54d7ab-50b8-4527-b0a2-4491181836b7 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:54.945406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-6c54d7ab-50b8-4527-b0a2-4491181836b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:54.977003 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:55.043072 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 242/484] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:31:55.086753 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd7498-a3af-4bc6-b3d5-4c385ca3f2ec None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:55.118074 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:55.203837 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd7498-a3af-4bc6-b3d5-4c385ca3f2ec None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:55.241457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353cdcb-2e71-4321-96d0-22383b3de1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:55.241457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353cdcb-2e71-4321-96d0-22383b3de1d1 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:55.241457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353cdcb-2e71-4321-96d0-22383b3de1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:55.241817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353cdcb-2e71-4321-96d0-22383b3de1d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:55.252417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353cdcb-2e71-4321-96d0-22383b3de1d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:55.258033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-7353cdcb-2e71-4321-96d0-22383b3de1d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:31:55.258033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:55.258033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:55.258033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:55.258033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:55.258033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:55.258033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:55.258033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:55.258033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:55.258033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:55.258033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:55.258033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:55.258033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:55.258033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:55.258033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:55.258033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:55.258934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:55.258934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:55.258934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:55.258934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:55.258934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:55.258934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:55.258934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:55.258934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:55.258934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:55.258934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:55.258934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:55.258934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:55.258934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:55.258934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:55.258934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:55.258934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:55.259789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:55.259789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:55.259789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:55.259789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:55.259789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:55.259789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:55.259789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:55.259789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:55.259789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:55.259789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:55.259789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:31:55.259789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:55.259789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 243/485] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:31:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:55.269233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54d7ab-50b8-4527-b0a2-4491181836b7 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:55.389220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353cdcb-2e71-4321-96d0-22383b3de1d1 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:55.436952 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54d7ab-50b8-4527-b0a2-4491181836b7 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:55.499588 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4b7a0-8c12-4abd-918d-c1e30cc9cefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:55.500112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4b7a0-8c12-4abd-918d-c1e30cc9cefb None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:55.500393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4b7a0-8c12-4abd-918d-c1e30cc9cefb None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:55.500667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4b7a0-8c12-4abd-918d-c1e30cc9cefb None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:55.501334 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4b7a0-8c12-4abd-918d-c1e30cc9cefb None admin] RBAC: Adding query filter params (name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:55.501665 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4b7a0-8c12-4abd-918d-c1e30cc9cefb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:55.503608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4b7a0-8c12-4abd-918d-c1e30cc9cefb None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:55.518103 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 243/486] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 09:31:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:55.525561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4b7a0-8c12-4abd-918d-c1e30cc9cefb None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:55.548866 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:55.561456 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:55.579231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353cdcb-2e71-4321-96d0-22383b3de1d1 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:55.643941 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87158fa3-ca77-40df-b8f8-a73701e47bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:55.644572 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87158fa3-ca77-40df-b8f8-a73701e47bac None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:55.644848 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87158fa3-ca77-40df-b8f8-a73701e47bac None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:55.645121 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87158fa3-ca77-40df-b8f8-a73701e47bac None admin] PATH_INFO: `/v3/roles/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:55.666308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87158fa3-ca77-40df-b8f8-a73701e47bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:55.671083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-87158fa3-ca77-40df-b8f8-a73701e47bac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:31:55.671083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:55.671083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:55.671083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:55.671083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:55.671083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:55.671083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:55.671083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:55.671083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:55.671083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:55.671083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:55.671083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:55.671083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:55.671083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:55.671083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:55.671083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:55.671968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:55.671968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:55.671968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:55.671968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:55.671968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:55.671968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:55.671968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:55.671968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:55.671968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:55.671968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:55.671968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:55.671968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:55.671968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:55.671968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:55.671968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:55.671968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:55.672736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:55.672736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:55.672736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:55.672736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:55.672736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:55.672736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:55.672736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:55.672736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:55.672736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:55.672736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:55.672736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:31:55.672736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:55.674107 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 244/487] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:31:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:31:55.680996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87158fa3-ca77-40df-b8f8-a73701e47bac None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:55.715378 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4b7a0-8c12-4abd-918d-c1e30cc9cefb None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:55.778983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a7670-0914-4e10-878c-716ae2e7bae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:55.779533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a7670-0914-4e10-878c-716ae2e7bae7 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:55.779810 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a7670-0914-4e10-878c-716ae2e7bae7 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:55.780088 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a7670-0914-4e10-878c-716ae2e7bae7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:55.795534 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a7670-0914-4e10-878c-716ae2e7bae7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:55.796985 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a7670-0914-4e10-878c-716ae2e7bae7 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:55.827865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-318a7670-0914-4e10-878c-716ae2e7bae7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:31:55.827865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:55.827865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:55.827865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:55.827865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:55.827865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:55.827865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:55.827865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:55.827865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:55.827865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:55.827865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:55.827865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:55.827865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:31:55.827865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:31:55.827865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:31:55.827865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:31:55.828799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:55.828799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:55.828799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:55.828799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:55.828799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:55.828799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:55.828799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:55.828799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:55.828799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:55.828799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:55.828799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:55.828799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:55.828799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:55.828799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:55.828799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:55.828799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:55.828799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:31:55.829643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:31:55.829643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:31:55.829643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:55.833628 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 244/488] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:55.837356 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a7670-0914-4e10-878c-716ae2e7bae7 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:55.868997 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87158fa3-ca77-40df-b8f8-a73701e47bac None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:55.908267 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc15c93-1d60-481c-a760-7a8c24f8cc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:55.908899 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc15c93-1d60-481c-a760-7a8c24f8cc49 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:55.909188 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc15c93-1d60-481c-a760-7a8c24f8cc49 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:55.909723 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc15c93-1d60-481c-a760-7a8c24f8cc49 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:55.910612 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc15c93-1d60-481c-a760-7a8c24f8cc49 None admin] RBAC: Adding query filter params (name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:55.910961 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc15c93-1d60-481c-a760-7a8c24f8cc49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:55.912354 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc15c93-1d60-481c-a760-7a8c24f8cc49 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:55.922884 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 245/489] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 09:31:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:55.924172 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fdf12-26a3-4f99-a9bf-62270f48c369 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:55.924513 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fdf12-26a3-4f99-a9bf-62270f48c369 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:55.924836 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fdf12-26a3-4f99-a9bf-62270f48c369 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:55.926508 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 246/490] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:55.930414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fdf12-26a3-4f99-a9bf-62270f48c369 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:55.935877 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:55.942529 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:55.979348 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a7670-0914-4e10-878c-716ae2e7bae7 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:56.027242 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6206493-c7e4-4a70-82c4-cda90524214d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:56.028324 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6206493-c7e4-4a70-82c4-cda90524214d None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:56.029676 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6206493-c7e4-4a70-82c4-cda90524214d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:56.029923 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6206493-c7e4-4a70-82c4-cda90524214d None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:56.030583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6206493-c7e4-4a70-82c4-cda90524214d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:56.030886 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6206493-c7e4-4a70-82c4-cda90524214d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:56.033797 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6206493-c7e4-4a70-82c4-cda90524214d None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:56.050672 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 245/491] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:31:56.052753 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05177ff6-7fc9-4cca-ab30-bd8255b4bc7a None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:56.053497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05177ff6-7fc9-4cca-ab30-bd8255b4bc7a None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:56.053945 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05177ff6-7fc9-4cca-ab30-bd8255b4bc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:56.066511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fdf12-26a3-4f99-a9bf-62270f48c369 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:56.078812 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-05177ff6-7fc9-4cca-ab30-bd8255b4bc7a None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:56.080547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-05177ff6-7fc9-4cca-ab30-bd8255b4bc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:56.104658 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2363c4-4f38-43e6-ac64-710bd00843b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:56.105327 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2363c4-4f38-43e6-ac64-710bd00843b9 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:56.105590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2363c4-4f38-43e6-ac64-710bd00843b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:56.105862 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2363c4-4f38-43e6-ac64-710bd00843b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:56.117317 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2363c4-4f38-43e6-ac64-710bd00843b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:56.118831 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2363c4-4f38-43e6-ac64-710bd00843b9 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:56.134403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-cc2363c4-4f38-43e6-ac64-710bd00843b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:31:56.134403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:56.134403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:56.134403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:56.134403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:56.134403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:56.134403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:56.134403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:56.134403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:56.134403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:56.134403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:56.134403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:56.134403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:31:56.134403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:31:56.134403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:31:56.134403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:31:56.135494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:56.135494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:56.135494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:56.135494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:56.135494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:56.135494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:56.135494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:56.135494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:56.135494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:56.135494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:56.135494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:56.135494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:56.135494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:56.135494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:56.135494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:56.135494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:56.135494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:31:56.140924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:31:56.140924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:31:56.140924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:56.140924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 247/492] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:56.140924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2363c4-4f38-43e6-ac64-710bd00843b9 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:56.163890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 246/493] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:56.165357 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cf28f-2ee5-4910-a7f7-a9f7bbe279d5 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:56.165672 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cf28f-2ee5-4910-a7f7-a9f7bbe279d5 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:56.165948 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cf28f-2ee5-4910-a7f7-a9f7bbe279d5 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:56.167326 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 247/494] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:56.170202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cf28f-2ee5-4910-a7f7-a9f7bbe279d5 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:56.209110 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:56.254131 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:56.266051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2363c4-4f38-43e6-ac64-710bd00843b9 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:56.296242 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cf28f-2ee5-4910-a7f7-a9f7bbe279d5 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:56.307776 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb668fa3-639b-4c4e-81fd-3ba53c558e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:56.308692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb668fa3-639b-4c4e-81fd-3ba53c558e63 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:56.308960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb668fa3-639b-4c4e-81fd-3ba53c558e63 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:56.309233 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb668fa3-639b-4c4e-81fd-3ba53c558e63 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:56.319022 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb668fa3-639b-4c4e-81fd-3ba53c558e63 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:56.321104 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb668fa3-639b-4c4e-81fd-3ba53c558e63 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:56.330457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52baef-6fdb-44f3-80cd-a6edcbabe7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:56.331347 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52baef-6fdb-44f3-80cd-a6edcbabe7f9 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:56.331463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52baef-6fdb-44f3-80cd-a6edcbabe7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:56.331703 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52baef-6fdb-44f3-80cd-a6edcbabe7f9 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:56.332342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52baef-6fdb-44f3-80cd-a6edcbabe7f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:56.332640 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52baef-6fdb-44f3-80cd-a6edcbabe7f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:56.334017 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52baef-6fdb-44f3-80cd-a6edcbabe7f9 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:56.336590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-fb668fa3-639b-4c4e-81fd-3ba53c558e63 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:31:56.336590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:56.336590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:56.336590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:56.336590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:56.336590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:56.336590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:56.336590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:56.336590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:56.336590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:56.336590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:56.336590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:56.336590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:31:56.336590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:31:56.336590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:31:56.336590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:31:56.337447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:56.337447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:56.337447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:31:56.337447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:31:56.337447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:31:56.337447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:31:56.337447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:56.337447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:56.337447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:56.337447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:56.337447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:56.337447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:56.337447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:56.337447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:56.337447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:56.337447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:56.337447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:56.337447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:56.338366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:56.338366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:56.338366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:31:56.338366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:31:56.338366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:31:56.338366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:31:56.338366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:31:56.338366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:31:56.338366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:31:56.338366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:56.342218 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 248/495] 10.222.0.58 () {56 vars in 1093 bytes} [Wed Aug 24 09:31:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:56.342803 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae0b87-fb63-4727-8d8f-6abc47206602 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:56.343076 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae0b87-fb63-4727-8d8f-6abc47206602 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:56.343351 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae0b87-fb63-4727-8d8f-6abc47206602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:56.350970 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 248/496] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:56.352180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e58c2-e1ea-40d1-9076-9acb37e37470 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:56.352463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e58c2-e1ea-40d1-9076-9acb37e37470 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:56.352795 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e58c2-e1ea-40d1-9076-9acb37e37470 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:56.358595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 249/497] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:31:56.358595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e58c2-e1ea-40d1-9076-9acb37e37470 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:56.366822 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-08ae0b87-fb63-4727-8d8f-6abc47206602 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:56.368017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-08ae0b87-fb63-4727-8d8f-6abc47206602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:56.434893 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 249/498] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:56.436133 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae0b87-fb63-4727-8d8f-6abc47206602 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:56.489240 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e58c2-e1ea-40d1-9076-9acb37e37470 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:56.495775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:56.514848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:56.533038 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4588e4c-75a6-4f1c-9599-0dc16aefad02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:56.534513 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4588e4c-75a6-4f1c-9599-0dc16aefad02 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:56.534853 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4588e4c-75a6-4f1c-9599-0dc16aefad02 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:56.535294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4588e4c-75a6-4f1c-9599-0dc16aefad02 None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:56.536164 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4588e4c-75a6-4f1c-9599-0dc16aefad02 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:56.536468 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4588e4c-75a6-4f1c-9599-0dc16aefad02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:56.537928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4588e4c-75a6-4f1c-9599-0dc16aefad02 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:56.560238 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae0b87-fb63-4727-8d8f-6abc47206602 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:56.575501 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 250/499] 10.222.0.58 () {56 vars in 1133 bytes} [Wed Aug 24 09:31:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:56.576710 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b44f6-59bd-4329-8ab1-524e7bcddab2 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:56.576989 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b44f6-59bd-4329-8ab1-524e7bcddab2 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:56.577256 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b44f6-59bd-4329-8ab1-524e7bcddab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:56.595945 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-4e0b44f6-59bd-4329-8ab1-524e7bcddab2 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:31:56.597206 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-4e0b44f6-59bd-4329-8ab1-524e7bcddab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:31:56.605121 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0ae39-c275-49b1-afc3-6e693fbc3615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:56.605885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0ae39-c275-49b1-afc3-6e693fbc3615 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:56.606271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0ae39-c275-49b1-afc3-6e693fbc3615 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:56.606613 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0ae39-c275-49b1-afc3-6e693fbc3615 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:56.620260 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0ae39-c275-49b1-afc3-6e693fbc3615 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:56.621834 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0ae39-c275-49b1-afc3-6e693fbc3615 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:56.638440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-38f0ae39-c275-49b1-afc3-6e693fbc3615 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:31:56.638440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:56.638440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:56.638440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:56.638440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:56.638440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:56.638440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:56.638440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:56.638440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:56.638440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:56.638440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:56.638440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:56.638440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:31:56.638440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:31:56.638440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:31:56.638440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:31:56.639641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:56.639641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:56.639641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:31:56.639641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:31:56.639641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:31:56.639641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:31:56.639641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:56.639641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:56.639641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:56.639641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:56.639641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:56.639641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:56.639641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:56.639641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:56.639641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:56.639641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:56.639641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:56.639641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:56.640512 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:56.640512 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:56.640512 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:31:56.640512 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:31:56.640512 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:31:56.640512 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:31:56.640512 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:31:56.640512 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:31:56.640512 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:31:56.640512 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:56.644559 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 250/500] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:56.644559 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0ae39-c275-49b1-afc3-6e693fbc3615 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:56.681501 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 251/501] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:56.681501 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b44f6-59bd-4329-8ab1-524e7bcddab2 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:56.808300 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b44f6-59bd-4329-8ab1-524e7bcddab2 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:56.810058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0ae39-c275-49b1-afc3-6e693fbc3615 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:56.819140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:56.826830 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:56.853870 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb3cb9-5eb1-4378-8eb2-2f1230042aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:56.854508 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb3cb9-5eb1-4378-8eb2-2f1230042aa1 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:56.854788 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb3cb9-5eb1-4378-8eb2-2f1230042aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:56.855065 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb3cb9-5eb1-4378-8eb2-2f1230042aa1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:56.862058 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a2613-30ba-4370-90f9-933043b07dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:56.862889 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a2613-30ba-4370-90f9-933043b07dcf None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:56.863336 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a2613-30ba-4370-90f9-933043b07dcf None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:56.863948 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a2613-30ba-4370-90f9-933043b07dcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:56.868856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb3cb9-5eb1-4378-8eb2-2f1230042aa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:56.873535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-21eb3cb9-5eb1-4378-8eb2-2f1230042aa1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:31:56.873535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:56.873535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:56.873535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:56.873535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:56.873535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:56.873535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:56.873535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:56.873535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:56.873535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:56.873535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:56.873535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:56.873535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:56.873535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:56.873535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:56.873535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:56.874603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:56.874603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:56.874603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:56.874603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:56.874603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:56.874603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:56.874603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:56.874603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:56.874603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:56.874603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:56.874603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:56.874603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:56.874603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:56.874603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:56.874603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:56.874603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:56.876919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:56.876919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:56.876919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:56.876919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:56.876919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:56.876919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:56.876919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:56.876919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:56.876919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:56.876919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:56.876919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:31:56.876919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:56.876919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 251/502] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:31:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:56.876919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb3cb9-5eb1-4378-8eb2-2f1230042aa1 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:56.966945 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a2613-30ba-4370-90f9-933043b07dcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:56.968408 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a2613-30ba-4370-90f9-933043b07dcf None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:57.000966 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb3cb9-5eb1-4378-8eb2-2f1230042aa1 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:57.043142 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468926f6-6cf3-4205-92b1-5001b9d58991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:57.043761 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468926f6-6cf3-4205-92b1-5001b9d58991 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:57.044036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468926f6-6cf3-4205-92b1-5001b9d58991 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:57.044362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468926f6-6cf3-4205-92b1-5001b9d58991 None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:57.045097 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468926f6-6cf3-4205-92b1-5001b9d58991 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:57.045514 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468926f6-6cf3-4205-92b1-5001b9d58991 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:57.047507 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468926f6-6cf3-4205-92b1-5001b9d58991 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:57.082124 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 252/503] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:57.083097 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a2613-30ba-4370-90f9-933043b07dcf None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:57.093317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:57.098086 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 252/504] 10.222.0.58 () {56 vars in 1137 bytes} [Wed Aug 24 09:31:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:57.099023 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468926f6-6cf3-4205-92b1-5001b9d58991 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:57.124957 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:57.210056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a2613-30ba-4370-90f9-933043b07dcf None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:57.219092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468926f6-6cf3-4205-92b1-5001b9d58991 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:57.256557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6bfc5-54d9-43c5-aebc-38f72a93a4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:57.257253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6bfc5-54d9-43c5-aebc-38f72a93a4af None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:57.257572 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6bfc5-54d9-43c5-aebc-38f72a93a4af None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:57.257843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6bfc5-54d9-43c5-aebc-38f72a93a4af None admin] PATH_INFO: `/v3/roles/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:57.263217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5f9fc-3e1f-4604-b933-7d40d86ec0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:57.263971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5f9fc-3e1f-4604-b933-7d40d86ec0b3 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:57.264241 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5f9fc-3e1f-4604-b933-7d40d86ec0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:57.264511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5f9fc-3e1f-4604-b933-7d40d86ec0b3 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:57.265616 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5f9fc-3e1f-4604-b933-7d40d86ec0b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:57.265967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5f9fc-3e1f-4604-b933-7d40d86ec0b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:57.267803 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5f9fc-3e1f-4604-b933-7d40d86ec0b3 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:57.272323 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6bfc5-54d9-43c5-aebc-38f72a93a4af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:31:57.277109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-f8d6bfc5-54d9-43c5-aebc-38f72a93a4af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:31:57.277109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:57.277109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:57.277109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:57.277109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:57.277109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:57.277109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:57.277109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:57.277109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:57.277109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:57.277109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:57.277109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:57.277109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:31:57.277109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:31:57.277109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:31:57.277109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:31:57.278298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:31:57.278298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:31:57.278298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:31:57.278298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:31:57.278298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:57.278298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:57.278298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:57.278298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:57.278298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:57.278298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:57.278298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:57.278298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:57.278298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:57.278298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:57.278298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:57.278298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:57.279265 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:57.279265 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:57.279265 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:57.279265 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:57.279265 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:31:57.279265 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:31:57.279265 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:31:57.279265 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:31:57.279265 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:31:57.279265 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:31:57.279265 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:31:57.279265 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:57.280138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 253/505] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:31:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:57.280391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 253/506] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 09:31:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:57.281296 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5f9fc-3e1f-4604-b933-7d40d86ec0b3 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:57.281456 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6bfc5-54d9-43c5-aebc-38f72a93a4af None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:57.360839 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:57.385961 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:57.402566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5f9fc-3e1f-4604-b933-7d40d86ec0b3 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:57.412045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6bfc5-54d9-43c5-aebc-38f72a93a4af None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:57.443610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ff018-305c-4a2d-87e1-771ce639d030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:57.444624 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ff018-305c-4a2d-87e1-771ce639d030 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:57.444910 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ff018-305c-4a2d-87e1-771ce639d030 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:57.445195 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ff018-305c-4a2d-87e1-771ce639d030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:57.452767 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc4a69-d477-4770-a0e8-8c4b3c20b8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:57.453404 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc4a69-d477-4770-a0e8-8c4b3c20b8dc None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:57.453728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc4a69-d477-4770-a0e8-8c4b3c20b8dc None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:57.454019 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc4a69-d477-4770-a0e8-8c4b3c20b8dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:57.457717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ff018-305c-4a2d-87e1-771ce639d030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:57.459188 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ff018-305c-4a2d-87e1-771ce639d030 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:57.464848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc4a69-d477-4770-a0e8-8c4b3c20b8dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:57.467289 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc4a69-d477-4770-a0e8-8c4b3c20b8dc None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:57.477360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-2b8ff018-305c-4a2d-87e1-771ce639d030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:31:57.477360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:57.477360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:57.477360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:57.477360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:57.477360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:57.477360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:57.477360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:57.477360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:57.477360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:57.477360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:57.477360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:57.477360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:31:57.477360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:31:57.477360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:31:57.477360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:31:57.478496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:57.478496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:57.478496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:57.478496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:57.478496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:57.478496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:57.478496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:57.478496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:57.478496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:57.478496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:57.478496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:57.478496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:57.478496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:57.478496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:57.478496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:57.478496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:57.478496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:31:57.479616 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:31:57.479616 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:31:57.479616 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:57.479616 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 254/507] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:31:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:57.479853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ff018-305c-4a2d-87e1-771ce639d030 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:57.489738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-3ebc4a69-d477-4770-a0e8-8c4b3c20b8dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:31:57.489738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:57.489738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:57.489738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:57.489738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:57.489738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:57.489738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:57.489738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:57.489738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:57.489738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:57.489738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:57.489738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:57.489738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:31:57.489738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:31:57.489738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:31:57.489738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:31:57.490841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:57.490841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:57.490841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:57.490841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:57.490841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:57.490841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:57.490841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:57.490841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:57.490841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:57.490841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:57.490841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:57.490841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:57.490841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:57.490841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:57.490841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:57.490841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:57.490841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:31:57.498460 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:31:57.498460 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:31:57.498460 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:57.498460 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 254/508] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:31:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:57.498460 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc4a69-d477-4770-a0e8-8c4b3c20b8dc None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:57.586379 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ff018-305c-4a2d-87e1-771ce639d030 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:57.602730 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc4a69-d477-4770-a0e8-8c4b3c20b8dc None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:57.621984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f2eba-51b6-4990-baa6-84bafc20ee6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:57.622675 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:57.622919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f2eba-51b6-4990-baa6-84bafc20ee6b None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:57.623387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f2eba-51b6-4990-baa6-84bafc20ee6b None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:57.623912 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f2eba-51b6-4990-baa6-84bafc20ee6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:57.638032 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9f772-5f06-46a1-acad-1002a8fae670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:57.638666 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9f772-5f06-46a1-acad-1002a8fae670 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:57.638951 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9f772-5f06-46a1-acad-1002a8fae670 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:57.639230 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9f772-5f06-46a1-acad-1002a8fae670 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:57.639635 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:57.639902 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9f772-5f06-46a1-acad-1002a8fae670 None admin] RBAC: Adding query filter params (name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:57.640215 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9f772-5f06-46a1-acad-1002a8fae670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:57.641882 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9f772-5f06-46a1-acad-1002a8fae670 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:57.650742 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 255/509] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 09:31:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:57.651546 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9f772-5f06-46a1-acad-1002a8fae670 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:57.704998 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f2eba-51b6-4990-baa6-84bafc20ee6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:57.706867 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f2eba-51b6-4990-baa6-84bafc20ee6b None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:57.758642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9f772-5f06-46a1-acad-1002a8fae670 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:57.791392 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce700b1-8168-467e-a8ff-84b27fa27983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:57.792021 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce700b1-8168-467e-a8ff-84b27fa27983 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:57.792296 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce700b1-8168-467e-a8ff-84b27fa27983 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:57.792567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce700b1-8168-467e-a8ff-84b27fa27983 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:57.803661 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce700b1-8168-467e-a8ff-84b27fa27983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:57.805103 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce700b1-8168-467e-a8ff-84b27fa27983 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:57.808433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 255/510] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:57.809302 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f2eba-51b6-4990-baa6-84bafc20ee6b None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:57.820267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-cce700b1-8168-467e-a8ff-84b27fa27983 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:31:57.820267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:57.820267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:57.820267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:57.820267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:57.820267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:57.820267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:57.820267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:57.820267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:57.820267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:57.820267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:57.820267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:57.820267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:31:57.820267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:31:57.820267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:31:57.820267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:31:57.821636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:57.821636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:57.821636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:57.821636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:57.821636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:57.821636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:57.821636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:57.821636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:57.821636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:57.821636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:57.821636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:57.821636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:57.821636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:57.821636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:57.821636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:57.821636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:57.821636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:31:57.822470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:31:57.822470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:31:57.822470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:57.822470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 256/511] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:31:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:57.822470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce700b1-8168-467e-a8ff-84b27fa27983 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:57.851303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:57.860592 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:57.915833 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f2eba-51b6-4990-baa6-84bafc20ee6b None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:57.928899 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce700b1-8168-467e-a8ff-84b27fa27983 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:57.951062 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebab167-123e-460e-b507-eb228e25be34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:57.951664 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebab167-123e-460e-b507-eb228e25be34 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:57.951942 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebab167-123e-460e-b507-eb228e25be34 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:57.952218 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebab167-123e-460e-b507-eb228e25be34 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:57.952859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebab167-123e-460e-b507-eb228e25be34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:57.953159 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebab167-123e-460e-b507-eb228e25be34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:57.954588 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebab167-123e-460e-b507-eb228e25be34 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:57.963999 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b38d4-9100-4612-87a1-810df387cada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:57.964964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b38d4-9100-4612-87a1-810df387cada None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:57.965302 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b38d4-9100-4612-87a1-810df387cada None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:57.965620 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b38d4-9100-4612-87a1-810df387cada None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:57.966283 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b38d4-9100-4612-87a1-810df387cada None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:57.966598 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b38d4-9100-4612-87a1-810df387cada None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:57.966734 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 256/512] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:57.967476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebab167-123e-460e-b507-eb228e25be34 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:57.968054 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b38d4-9100-4612-87a1-810df387cada None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:57.982883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 257/513] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:57.983706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b38d4-9100-4612-87a1-810df387cada None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:58.066865 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:58.070861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebab167-123e-460e-b507-eb228e25be34 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:58.080829 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:58.088725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b38d4-9100-4612-87a1-810df387cada None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:58.104512 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebc0f8-ad59-4b35-9135-6b626dd56f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:58.105139 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebc0f8-ad59-4b35-9135-6b626dd56f6e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:58.105410 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebc0f8-ad59-4b35-9135-6b626dd56f6e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:58.105710 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebc0f8-ad59-4b35-9135-6b626dd56f6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:58.116555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebc0f8-ad59-4b35-9135-6b626dd56f6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:58.118030 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebc0f8-ad59-4b35-9135-6b626dd56f6e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:58.124458 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08513c8-cd8b-444d-ab56-bb47a83ad884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:58.125078 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08513c8-cd8b-444d-ab56-bb47a83ad884 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:58.125359 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08513c8-cd8b-444d-ab56-bb47a83ad884 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:58.125670 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08513c8-cd8b-444d-ab56-bb47a83ad884 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:58.132236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-4eebc0f8-ad59-4b35-9135-6b626dd56f6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:31:58.132236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:58.132236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:58.132236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:58.132236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:58.132236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:58.132236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:58.132236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:58.132236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:58.132236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:58.132236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:58.132236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:58.132236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:31:58.132236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:31:58.132236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:31:58.132236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:31:58.133186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:58.133186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:58.133186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:58.133186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:58.133186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:58.133186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:58.133186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:58.133186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:58.133186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:58.133186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:58.133186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:58.133186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:58.133186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:58.133186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:58.133186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:58.133186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:58.133186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:31:58.134268 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:31:58.134268 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:31:58.134268 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:58.134268 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 257/514] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:31:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:58.134268 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebc0f8-ad59-4b35-9135-6b626dd56f6e None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:58.138720 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08513c8-cd8b-444d-ab56-bb47a83ad884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:58.140176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08513c8-cd8b-444d-ab56-bb47a83ad884 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:58.155286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-b08513c8-cd8b-444d-ab56-bb47a83ad884 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:31:58.155286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:58.155286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:58.155286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:58.155286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:58.155286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:58.155286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:58.155286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:58.155286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:58.155286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:58.155286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:58.155286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:58.155286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:31:58.155286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:31:58.155286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:31:58.155286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:31:58.156319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:58.156319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:58.156319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:58.156319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:58.156319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:58.156319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:58.156319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:58.156319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:58.156319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:58.156319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:58.156319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:58.156319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:58.156319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:58.156319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:58.156319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:58.156319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:58.156319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:31:58.157164 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:31:58.157164 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:31:58.157164 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:58.157164 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 258/515] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:31:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:58.157164 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08513c8-cd8b-444d-ab56-bb47a83ad884 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:58.244315 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebc0f8-ad59-4b35-9135-6b626dd56f6e None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:58.262339 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08513c8-cd8b-444d-ab56-bb47a83ad884 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:58.279416 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08380d-4d21-4819-a299-11b18664e1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:58.280028 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08380d-4d21-4819-a299-11b18664e1a2 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:58.280309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08380d-4d21-4819-a299-11b18664e1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:58.280585 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08380d-4d21-4819-a299-11b18664e1a2 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:58.281227 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08380d-4d21-4819-a299-11b18664e1a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:58.281561 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08380d-4d21-4819-a299-11b18664e1a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:58.282940 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08380d-4d21-4819-a299-11b18664e1a2 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:58.294456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 258/516] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:58.295222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08380d-4d21-4819-a299-11b18664e1a2 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:58.295525 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a76a25-fe3d-46cb-9422-5e3c3f95edd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:58.296157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a76a25-fe3d-46cb-9422-5e3c3f95edd9 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:58.296440 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a76a25-fe3d-46cb-9422-5e3c3f95edd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:58.296711 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a76a25-fe3d-46cb-9422-5e3c3f95edd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:58.303740 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a76a25-fe3d-46cb-9422-5e3c3f95edd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:58.305180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a76a25-fe3d-46cb-9422-5e3c3f95edd9 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:58.308244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:58.317901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-49a76a25-fe3d-46cb-9422-5e3c3f95edd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:31:58.317901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:58.317901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:58.317901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:58.317901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:58.317901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:58.317901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:58.317901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:58.317901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:58.317901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:58.317901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:58.317901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:58.317901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:31:58.317901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:31:58.317901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:31:58.318859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:31:58.318859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:58.318859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:58.318859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:58.318859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:58.318859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:58.318859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:58.318859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:58.318859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:58.318859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:58.318859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:58.318859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:58.318859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:58.318859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:58.318859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:58.318859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:58.318859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:58.319828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:31:58.319828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:31:58.319828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:31:58.319828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:31:58.319828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:31:58.319828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:31:58.319828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:31:58.319828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:58.319828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 259/517] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:31:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:58.321172 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a76a25-fe3d-46cb-9422-5e3c3f95edd9 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:58.329784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:58.397829 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08380d-4d21-4819-a299-11b18664e1a2 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:58.420554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a76a25-fe3d-46cb-9422-5e3c3f95edd9 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:58.431614 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85337d-cb8e-4c47-bbc1-3b6309645f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:58.432215 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85337d-cb8e-4c47-bbc1-3b6309645f8f None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:58.432494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85337d-cb8e-4c47-bbc1-3b6309645f8f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:58.432769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85337d-cb8e-4c47-bbc1-3b6309645f8f None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:58.433399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85337d-cb8e-4c47-bbc1-3b6309645f8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:58.434858 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85337d-cb8e-4c47-bbc1-3b6309645f8f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:58.455319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517bfda-9f21-4025-a1f3-5e9c8c73cc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:58.455907 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 259/518] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 09:31:58 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:31:58.456046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517bfda-9f21-4025-a1f3-5e9c8c73cc13 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:58.456328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517bfda-9f21-4025-a1f3-5e9c8c73cc13 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:58.456604 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517bfda-9f21-4025-a1f3-5e9c8c73cc13 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:58.456711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85337d-cb8e-4c47-bbc1-3b6309645f8f None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:58.457257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517bfda-9f21-4025-a1f3-5e9c8c73cc13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:58.457595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517bfda-9f21-4025-a1f3-5e9c8c73cc13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:58.458990 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517bfda-9f21-4025-a1f3-5e9c8c73cc13 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:58.480563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 260/519] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:58.481740 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517bfda-9f21-4025-a1f3-5e9c8c73cc13 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:58.537143 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:58.562891 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:58.582662 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85337d-cb8e-4c47-bbc1-3b6309645f8f None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:58.607069 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517bfda-9f21-4025-a1f3-5e9c8c73cc13 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:58.623002 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1258d7-d450-4a45-b2ab-17ea231d2b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:58.623746 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1258d7-d450-4a45-b2ab-17ea231d2b65 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:58.624120 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1258d7-d450-4a45-b2ab-17ea231d2b65 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:58.624497 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1258d7-d450-4a45-b2ab-17ea231d2b65 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:58.625215 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1258d7-d450-4a45-b2ab-17ea231d2b65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:58.625592 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1258d7-d450-4a45-b2ab-17ea231d2b65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:58.626964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1258d7-d450-4a45-b2ab-17ea231d2b65 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:58.640645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 260/520] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:58.642834 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1258d7-d450-4a45-b2ab-17ea231d2b65 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:58.651979 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bece8-5fb5-4cff-91cd-0e0617e49a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:58.652893 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bece8-5fb5-4cff-91cd-0e0617e49a5e None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:58.653310 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bece8-5fb5-4cff-91cd-0e0617e49a5e None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:58.653744 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bece8-5fb5-4cff-91cd-0e0617e49a5e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:58.662553 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7bece8-5fb5-4cff-91cd-0e0617e49a5e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:58.664266 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7bece8-5fb5-4cff-91cd-0e0617e49a5e None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:58.678341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-eb7bece8-5fb5-4cff-91cd-0e0617e49a5e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:31:58.678341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:58.678341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:58.678341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:58.678341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:58.678341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:58.678341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:58.678341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:58.678341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:58.678341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:58.678341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:58.678341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:58.678341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:31:58.678341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:31:58.678341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:31:58.678341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:31:58.679421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:58.679421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:58.679421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:31:58.679421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:31:58.679421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:31:58.679421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:31:58.679421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:58.679421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:58.679421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:58.679421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:58.679421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:58.679421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:58.679421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:58.679421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:58.679421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:58.679421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:58.679421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:58.679421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:58.680580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:58.680580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:58.680580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:31:58.680580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:31:58.680580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:31:58.680580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:31:58.680580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:31:58.680580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:31:58.680580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:31:58.680580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:58.680580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 261/521] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:31:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:58.680580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bece8-5fb5-4cff-91cd-0e0617e49a5e None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:58.768745 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1258d7-d450-4a45-b2ab-17ea231d2b65 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:58.792103 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bece8-5fb5-4cff-91cd-0e0617e49a5e None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:58.796678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:58.807209 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efc168-521b-4b09-a8be-6c6a01ea1dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:58.807897 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efc168-521b-4b09-a8be-6c6a01ea1dbb None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:58.808174 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efc168-521b-4b09-a8be-6c6a01ea1dbb None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:58.808447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efc168-521b-4b09-a8be-6c6a01ea1dbb None admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:58.809139 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efc168-521b-4b09-a8be-6c6a01ea1dbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:58.809441 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efc168-521b-4b09-a8be-6c6a01ea1dbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:58.811135 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efc168-521b-4b09-a8be-6c6a01ea1dbb None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:58.819657 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:58.829069 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc7f1a-bf0b-4421-a574-b45ac342aa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:58.829790 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc7f1a-bf0b-4421-a574-b45ac342aa7f None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:58.829995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc7f1a-bf0b-4421-a574-b45ac342aa7f None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:58.830265 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc7f1a-bf0b-4421-a574-b45ac342aa7f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:58.836176 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 261/522] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:31:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:58.836896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efc168-521b-4b09-a8be-6c6a01ea1dbb None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:58.838556 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc7f1a-bf0b-4421-a574-b45ac342aa7f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:58.839998 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc7f1a-bf0b-4421-a574-b45ac342aa7f None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:58.852225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-0fbc7f1a-bf0b-4421-a574-b45ac342aa7f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:31:58.852225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:58.852225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:58.852225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:58.852225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:58.852225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:58.852225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:58.852225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:58.852225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:58.852225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:58.852225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:58.852225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:58.852225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:31:58.852225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:31:58.852225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:31:58.852225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:31:58.853140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:58.853140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:58.853140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:31:58.853140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:31:58.853140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:31:58.853140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:31:58.853140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:58.853140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:58.853140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:58.853140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:58.853140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:58.853140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:58.853140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:58.853140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:58.853140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:58.853140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:58.853140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:58.853140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:58.854061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:58.854061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:58.854061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:31:58.854061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:31:58.854061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:31:58.854061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:31:58.854061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:31:58.854061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:31:58.854061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:31:58.854061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:31:58.854061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 262/523] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:31:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:58.854777 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc7f1a-bf0b-4421-a574-b45ac342aa7f None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:58.948986 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efc168-521b-4b09-a8be-6c6a01ea1dbb None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:58.972983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc7f1a-bf0b-4421-a574-b45ac342aa7f None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:58.996740 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc57c9-9bd6-4cb8-8b04-9488c92a1fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:58.997405 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc57c9-9bd6-4cb8-8b04-9488c92a1fdb None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:58.997735 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc57c9-9bd6-4cb8-8b04-9488c92a1fdb None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:58.998027 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc57c9-9bd6-4cb8-8b04-9488c92a1fdb None admin] PATH_INFO: `/v3/projects/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:59.006002 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc57c9-9bd6-4cb8-8b04-9488c92a1fdb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:59.007520 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc57c9-9bd6-4cb8-8b04-9488c92a1fdb None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:59.013526 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd328980-79fd-4ca5-9364-f102a0b0f298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:59.014138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd328980-79fd-4ca5-9364-f102a0b0f298 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:59.014417 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd328980-79fd-4ca5-9364-f102a0b0f298 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:59.014692 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd328980-79fd-4ca5-9364-f102a0b0f298 None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:59.015424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd328980-79fd-4ca5-9364-f102a0b0f298 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:59.015732 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd328980-79fd-4ca5-9364-f102a0b0f298 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:59.017158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd328980-79fd-4ca5-9364-f102a0b0f298 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:59.020960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-02dc57c9-9bd6-4cb8-8b04-9488c92a1fdb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:31:59.020960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:31:59.020960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:31:59.020960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:31:59.020960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:31:59.020960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:31:59.020960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:31:59.020960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:31:59.020960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:31:59.020960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:31:59.020960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:31:59.020960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:31:59.020960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:31:59.020960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:31:59.020960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:31:59.021999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:31:59.021999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:31:59.021999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:31:59.021999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:31:59.021999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:31:59.021999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:31:59.021999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:31:59.021999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:31:59.021999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:31:59.021999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:31:59.021999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:31:59.021999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:31:59.021999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:31:59.021999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:31:59.021999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:31:59.021999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:31:59.021999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:31:59.022817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:31:59.022817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:31:59.022817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:31:59.022817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:31:59.022817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:31:59.022817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:31:59.022817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:31:59.022817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:31:59.022817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 262/524] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:31:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:31:59.022817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc57c9-9bd6-4cb8-8b04-9488c92a1fdb None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:59.042077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 263/525] 10.222.0.58 () {56 vars in 1137 bytes} [Wed Aug 24 09:31:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:59.043231 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd328980-79fd-4ca5-9364-f102a0b0f298 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:59.081836 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:59.090983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:59.141876 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc57c9-9bd6-4cb8-8b04-9488c92a1fdb None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:59.148128 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd328980-79fd-4ca5-9364-f102a0b0f298 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:59.180693 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824afb2-4b7c-496a-ab4a-20f2394442e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:59.181344 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824afb2-4b7c-496a-ab4a-20f2394442e3 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:59.181655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824afb2-4b7c-496a-ab4a-20f2394442e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:59.181937 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824afb2-4b7c-496a-ab4a-20f2394442e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:59.182689 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824afb2-4b7c-496a-ab4a-20f2394442e3 None admin] RBAC: Adding query filter params (role.id=85dac7b70cf04091baaf69caabd27a8b, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=18be8c54c9644c5e9812eea09e60c11c) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:59.183007 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824afb2-4b7c-496a-ab4a-20f2394442e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:59.184055 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189a841-da65-440c-8528-3629c967155b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:59.184467 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824afb2-4b7c-496a-ab4a-20f2394442e3 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:59.184718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189a841-da65-440c-8528-3629c967155b None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:59.185001 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189a841-da65-440c-8528-3629c967155b None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:59.185294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189a841-da65-440c-8528-3629c967155b None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:59.186050 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189a841-da65-440c-8528-3629c967155b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:59.186361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189a841-da65-440c-8528-3629c967155b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:59.187781 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189a841-da65-440c-8528-3629c967155b None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:59.199006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 263/526] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:31:59 2022] GET /identity/v3/role_assignments?user.id=18be8c54c9644c5e9812eea09e60c11c&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=85dac7b70cf04091baaf69caabd27a8b => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:59.200329 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824afb2-4b7c-496a-ab4a-20f2394442e3 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:59.209080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 264/527] 10.222.0.58 () {56 vars in 1139 bytes} [Wed Aug 24 09:31:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:59.210071 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189a841-da65-440c-8528-3629c967155b None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:59.341304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189a841-da65-440c-8528-3629c967155b None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:59.341570 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824afb2-4b7c-496a-ab4a-20f2394442e3 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:59.342985 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:59.359037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:59.396601 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed590d-cdce-45c5-bf20-8b8e1e6761d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:59.397683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed590d-cdce-45c5-bf20-8b8e1e6761d7 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:59.397820 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b2223-f71f-42fa-ba57-489feadc1204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:59.398288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed590d-cdce-45c5-bf20-8b8e1e6761d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:59.398395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b2223-f71f-42fa-ba57-489feadc1204 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:59.398845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b2223-f71f-42fa-ba57-489feadc1204 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:59.398921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b2223-f71f-42fa-ba57-489feadc1204 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:59.399481 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed590d-cdce-45c5-bf20-8b8e1e6761d7 None admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:59.400421 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed590d-cdce-45c5-bf20-8b8e1e6761d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:59.400935 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed590d-cdce-45c5-bf20-8b8e1e6761d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:59.402846 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed590d-cdce-45c5-bf20-8b8e1e6761d7 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:59.416681 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 264/528] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:31:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:59.417357 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed590d-cdce-45c5-bf20-8b8e1e6761d7 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:59.485546 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b2223-f71f-42fa-ba57-489feadc1204 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:59.488191 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b2223-f71f-42fa-ba57-489feadc1204 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:59.526671 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed590d-cdce-45c5-bf20-8b8e1e6761d7 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:59.569937 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17cf8a-bc78-4a34-b1c1-654f1b2d2b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:59.570600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17cf8a-bc78-4a34-b1c1-654f1b2d2b2e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:59.570886 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17cf8a-bc78-4a34-b1c1-654f1b2d2b2e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:59.571155 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17cf8a-bc78-4a34-b1c1-654f1b2d2b2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:59.617587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 265/529] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:59.617587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b2223-f71f-42fa-ba57-489feadc1204 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:59.617587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:59.637374 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:59.677100 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17cf8a-bc78-4a34-b1c1-654f1b2d2b2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:59.678912 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17cf8a-bc78-4a34-b1c1-654f1b2d2b2e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:59.730273 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b2223-f71f-42fa-ba57-489feadc1204 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:59.769074 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f23b9-1f85-4824-ad15-96acdce46ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:31:59.770132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f23b9-1f85-4824-ad15-96acdce46ef6 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:31:59.770667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f23b9-1f85-4824-ad15-96acdce46ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:31:59.771142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f23b9-1f85-4824-ad15-96acdce46ef6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:31:59.772084 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f23b9-1f85-4824-ad15-96acdce46ef6 None admin] RBAC: Adding query filter params (role.id=85dac7b70cf04091baaf69caabd27a8b, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=51fe6dfa43d04cdeb0421d2613c8c2ca) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:31:59.772609 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f23b9-1f85-4824-ad15-96acdce46ef6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:31:59.774288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f23b9-1f85-4824-ad15-96acdce46ef6 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:31:59.780247 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 266/530] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:31:59 2022] GET /identity/v3/role_assignments?user.id=51fe6dfa43d04cdeb0421d2613c8c2ca&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=85dac7b70cf04091baaf69caabd27a8b => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:31:59.781269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f23b9-1f85-4824-ad15-96acdce46ef6 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:59.808298 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 265/531] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:31:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:59.814449 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17cf8a-bc78-4a34-b1c1-654f1b2d2b2e None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:31:59.873446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:59.911851 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:59.957632 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f23b9-1f85-4824-ad15-96acdce46ef6 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:31:59.958842 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17cf8a-bc78-4a34-b1c1-654f1b2d2b2e None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:00.000928 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213d1c6-a3c9-4d9d-be3e-f46f35247e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:00.001624 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213d1c6-a3c9-4d9d-be3e-f46f35247e8f None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:00.001923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213d1c6-a3c9-4d9d-be3e-f46f35247e8f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:00.002217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213d1c6-a3c9-4d9d-be3e-f46f35247e8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:00.016434 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213d1c6-a3c9-4d9d-be3e-f46f35247e8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:00.018159 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213d1c6-a3c9-4d9d-be3e-f46f35247e8f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:00.029231 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65216624-d9c2-4370-9f52-c85e1fcc316a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:00.030243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65216624-d9c2-4370-9f52-c85e1fcc316a None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:00.030734 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65216624-d9c2-4370-9f52-c85e1fcc316a None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:00.031210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65216624-d9c2-4370-9f52-c85e1fcc316a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:00.036303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-a213d1c6-a3c9-4d9d-be3e-f46f35247e8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:00.036303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:00.036303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:00.036303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:00.036303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:00.036303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:00.036303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:00.036303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:00.036303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:00.036303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:00.036303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:00.036303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:00.036303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:00.036303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:00.036303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:00.036303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:00.037257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:00.037257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:00.037257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:00.037257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:00.037257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:00.037257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:00.037257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:00.037257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:00.037257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:00.037257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:00.037257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:00.037257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:00.037257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:00.037257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:00.037257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:00.037257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:00.037257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:00.038135 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:00.038135 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:00.038135 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:00.038135 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 266/532] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:31:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:00.044079 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213d1c6-a3c9-4d9d-be3e-f46f35247e8f None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:00.056132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65216624-d9c2-4370-9f52-c85e1fcc316a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:00.058157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65216624-d9c2-4370-9f52-c85e1fcc316a None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:00.079202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-65216624-d9c2-4370-9f52-c85e1fcc316a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:00.079202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:00.079202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:00.079202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:00.079202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:00.079202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:00.079202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:00.079202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:00.079202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:00.079202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:00.079202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:00.079202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:00.079202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:00.079202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:00.079202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:00.079202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:00.080135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:00.080135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:00.080135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:00.080135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:00.080135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:00.080135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:00.080135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:00.080135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:00.080135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:00.080135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:00.080135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:00.080135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:00.080135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:00.080135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:00.080135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:00.080135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:00.080135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:00.081547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:00.081547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:00.081547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:00.083751 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 267/533] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:31:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:00.101064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65216624-d9c2-4370-9f52-c85e1fcc316a None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:00.209443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213d1c6-a3c9-4d9d-be3e-f46f35247e8f None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:00.256704 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:00.275612 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65216624-d9c2-4370-9f52-c85e1fcc316a None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:00.291808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefd7ee-d768-43b4-8145-b937fd76b1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:00.292427 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefd7ee-d768-43b4-8145-b937fd76b1c9 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:00.292702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefd7ee-d768-43b4-8145-b937fd76b1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:00.292972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefd7ee-d768-43b4-8145-b937fd76b1c9 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:00.293659 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefd7ee-d768-43b4-8145-b937fd76b1c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:00.293961 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefd7ee-d768-43b4-8145-b937fd76b1c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:00.295343 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefd7ee-d768-43b4-8145-b937fd76b1c9 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:00.320722 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:00.321841 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 267/534] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:00.330608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefd7ee-d768-43b4-8145-b937fd76b1c9 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:00.340687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad801f7-1e70-4e42-8829-a64727584435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:00.341298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad801f7-1e70-4e42-8829-a64727584435 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:00.341625 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad801f7-1e70-4e42-8829-a64727584435 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:00.341913 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad801f7-1e70-4e42-8829-a64727584435 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:00.342567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad801f7-1e70-4e42-8829-a64727584435 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:00.342871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad801f7-1e70-4e42-8829-a64727584435 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:00.344240 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad801f7-1e70-4e42-8829-a64727584435 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:00.358068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 268/535] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:00.364434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad801f7-1e70-4e42-8829-a64727584435 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:00.523102 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefd7ee-d768-43b4-8145-b937fd76b1c9 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:00.537876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad801f7-1e70-4e42-8829-a64727584435 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:00.578118 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f55da6-d043-4216-95db-bd2209d1da00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:00.579907 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f55da6-d043-4216-95db-bd2209d1da00 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:00.580339 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f55da6-d043-4216-95db-bd2209d1da00 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:00.581760 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f55da6-d043-4216-95db-bd2209d1da00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:00.584819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc454c-f2a8-4706-b771-2823ff597cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:00.585630 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc454c-f2a8-4706-b771-2823ff597cf8 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:00.586051 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc454c-f2a8-4706-b771-2823ff597cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:00.586481 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc454c-f2a8-4706-b771-2823ff597cf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:00.591767 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f55da6-d043-4216-95db-bd2209d1da00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:00.593518 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f55da6-d043-4216-95db-bd2209d1da00 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:00.594275 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc454c-f2a8-4706-b771-2823ff597cf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:00.595958 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc454c-f2a8-4706-b771-2823ff597cf8 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:00.606216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-d3f55da6-d043-4216-95db-bd2209d1da00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:00.606216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:00.606216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:00.606216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:00.606216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:00.606216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:00.606216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:00.606216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:00.606216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:00.606216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:00.606216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:00.606216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:00.606216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:00.606216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:00.606216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:00.607080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:00.607080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:00.607080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:00.607080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:00.607080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:00.607080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:00.607080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:00.607080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:00.607080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:00.607080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:00.607080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:00.607080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:00.607080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:00.607080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:00.607080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:00.607080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:00.607080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:00.608213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:00.608213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:00.608213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:00.608213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:00.608213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:00.608213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:00.608213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:00.608213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:00.608213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 268/536] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:00.609136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cee88-39b7-40fa-9f05-a73227a4de90 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:00.609399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cee88-39b7-40fa-9f05-a73227a4de90 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:00.609707 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cee88-39b7-40fa-9f05-a73227a4de90 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:00.611533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-0fbc454c-f2a8-4706-b771-2823ff597cf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:00.611533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:00.611533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:00.611533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:00.611533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:00.611533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:00.611533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:00.611533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:00.611533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:00.611533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:00.611533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:00.611533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:00.611533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:00.611533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:00.611533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:00.612369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:00.612369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:00.612369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:00.612369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:00.612369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:00.612369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:00.612369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:00.612369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:00.612369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:00.612369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:00.612369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:00.612369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:00.612369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:00.612369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:00.612369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:00.612369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:00.612369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:00.613168 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:00.613168 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:00.613168 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:00.613168 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:00.613168 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:00.613168 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:00.613168 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:00.613168 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:00.615106 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 269/537] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:00.615693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 269/538] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:00.615878 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cee88-39b7-40fa-9f05-a73227a4de90 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:00.621768 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a0432-7b43-4651-90a1-9c4bbb9116e8 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:00.622281 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a0432-7b43-4651-90a1-9c4bbb9116e8 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:00.622752 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a0432-7b43-4651-90a1-9c4bbb9116e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:00.642070 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-688a0432-7b43-4651-90a1-9c4bbb9116e8 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:00.644313 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-688a0432-7b43-4651-90a1-9c4bbb9116e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:00.670531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:00.678480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:00.722998 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 270/539] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:32:00.724633 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a0432-7b43-4651-90a1-9c4bbb9116e8 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:00.768711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cee88-39b7-40fa-9f05-a73227a4de90 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:00.830523 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27f7a1-b84e-4c56-9107-29295554b6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:00.831704 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27f7a1-b84e-4c56-9107-29295554b6bf None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:00.832351 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27f7a1-b84e-4c56-9107-29295554b6bf None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:00.832863 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27f7a1-b84e-4c56-9107-29295554b6bf None admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:00.833790 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27f7a1-b84e-4c56-9107-29295554b6bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:00.835049 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27f7a1-b84e-4c56-9107-29295554b6bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:00.838297 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27f7a1-b84e-4c56-9107-29295554b6bf None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:00.862531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 270/540] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:00.872703 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27f7a1-b84e-4c56-9107-29295554b6bf None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:00.909898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a0432-7b43-4651-90a1-9c4bbb9116e8 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:00.956942 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde3f3a-a87c-41fd-b2e8-9523f2b9507b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:00.957595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde3f3a-a87c-41fd-b2e8-9523f2b9507b None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:00.957876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde3f3a-a87c-41fd-b2e8-9523f2b9507b None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:00.958147 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde3f3a-a87c-41fd-b2e8-9523f2b9507b None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:00.958850 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde3f3a-a87c-41fd-b2e8-9523f2b9507b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:00.959157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde3f3a-a87c-41fd-b2e8-9523f2b9507b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:00.960719 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde3f3a-a87c-41fd-b2e8-9523f2b9507b None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:00.985845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 271/541] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:00.992316 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde3f3a-a87c-41fd-b2e8-9523f2b9507b None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:01.040383 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:01.072962 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27f7a1-b84e-4c56-9107-29295554b6bf None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:01.074585 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:01.111005 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb887180-8030-4a6e-8e0a-4398e50116c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:01.111717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb887180-8030-4a6e-8e0a-4398e50116c0 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:01.112641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb887180-8030-4a6e-8e0a-4398e50116c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:01.112995 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb887180-8030-4a6e-8e0a-4398e50116c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:01.113841 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb887180-8030-4a6e-8e0a-4398e50116c0 None admin] RBAC: Adding query filter params (role.id=85dac7b70cf04091baaf69caabd27a8b, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=7847dbf8f31146c5ab2136fbdb487783) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:01.114165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb887180-8030-4a6e-8e0a-4398e50116c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:01.116011 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb887180-8030-4a6e-8e0a-4398e50116c0 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:01.122205 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 271/542] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:32:00 2022] GET /identity/v3/role_assignments?user.id=7847dbf8f31146c5ab2136fbdb487783&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=85dac7b70cf04091baaf69caabd27a8b => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:01.123120 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb887180-8030-4a6e-8e0a-4398e50116c0 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:01.143921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde3f3a-a87c-41fd-b2e8-9523f2b9507b None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:01.190954 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3a8f8-3a07-4644-adc5-f9e5147bbc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:01.191685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3a8f8-3a07-4644-adc5-f9e5147bbc7d None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:01.191970 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3a8f8-3a07-4644-adc5-f9e5147bbc7d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:01.192249 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3a8f8-3a07-4644-adc5-f9e5147bbc7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:01.193008 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3a8f8-3a07-4644-adc5-f9e5147bbc7d None admin] RBAC: Adding query filter params (role.id=85dac7b70cf04091baaf69caabd27a8b, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=782bdef852d34b9ba3a957962f93994f) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:01.193322 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3a8f8-3a07-4644-adc5-f9e5147bbc7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:01.194846 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3a8f8-3a07-4644-adc5-f9e5147bbc7d None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:01.211168 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 272/543] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:32:00 2022] GET /identity/v3/role_assignments?user.id=782bdef852d34b9ba3a957962f93994f&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=85dac7b70cf04091baaf69caabd27a8b => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:01.313964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb887180-8030-4a6e-8e0a-4398e50116c0 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:01.351787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc59f76-464f-4f0e-8f5c-d97cc60c1e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:01.352427 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc59f76-464f-4f0e-8f5c-d97cc60c1e96 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:01.352708 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc59f76-464f-4f0e-8f5c-d97cc60c1e96 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:01.352982 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc59f76-464f-4f0e-8f5c-d97cc60c1e96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:01.371435 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc59f76-464f-4f0e-8f5c-d97cc60c1e96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:32:01.376770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-3fc59f76-464f-4f0e-8f5c-d97cc60c1e96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:01.376770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:01.376770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:01.376770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:01.376770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:01.376770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:01.376770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:01.376770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:01.376770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:01.376770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:01.376770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:01.376770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:01.376770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:32:01.376770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:32:01.376770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:32:01.376770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:32:01.378277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:32:01.378277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:32:01.378277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:32:01.378277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:32:01.378277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:01.378277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:01.378277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:01.378277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:01.378277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:01.378277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:01.378277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:01.378277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:01.378277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:01.378277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:01.378277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:01.378277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:01.379140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:01.379140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:01.379140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:01.379140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:01.379140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:32:01.379140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:32:01.379140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:32:01.379140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:32:01.379140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:32:01.379140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:32:01.379140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:01.379140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:01.379140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 272/544] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:32:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:01.385059 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3a8f8-3a07-4644-adc5-f9e5147bbc7d None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:01.405324 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e5f80-3f1e-45ec-a0c8-7cb498e43e56 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:01.405663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e5f80-3f1e-45ec-a0c8-7cb498e43e56 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:01.405925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e5f80-3f1e-45ec-a0c8-7cb498e43e56 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:01.407421 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 273/545] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:01.413555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c7480-2a7c-48dd-8f5a-ee916a98c68e None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:01.414150 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c7480-2a7c-48dd-8f5a-ee916a98c68e None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:01.414757 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c7480-2a7c-48dd-8f5a-ee916a98c68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:01.438281 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-c32c7480-2a7c-48dd-8f5a-ee916a98c68e None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:01.439886 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-c32c7480-2a7c-48dd-8f5a-ee916a98c68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:01.463618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:01.519693 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 274/546] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:32:01.560389 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:01.571898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3a8f8-3a07-4644-adc5-f9e5147bbc7d None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:01.630252 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e9c7f-abb2-47b4-acf9-8015af5ad25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:01.630782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e9c7f-abb2-47b4-acf9-8015af5ad25b None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:01.631062 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e9c7f-abb2-47b4-acf9-8015af5ad25b None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:01.631340 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e9c7f-abb2-47b4-acf9-8015af5ad25b None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:01.632008 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e9c7f-abb2-47b4-acf9-8015af5ad25b None admin] RBAC: Adding query filter params (name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:01.632306 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e9c7f-abb2-47b4-acf9-8015af5ad25b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:01.633689 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e9c7f-abb2-47b4-acf9-8015af5ad25b None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:01.642235 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 273/547] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 09:32:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:01.647885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c7480-2a7c-48dd-8f5a-ee916a98c68e None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:01.771112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c7480-2a7c-48dd-8f5a-ee916a98c68e None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:01.806960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e63b74-c672-4730-9c4a-d8be9a933b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:01.807594 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e63b74-c672-4730-9c4a-d8be9a933b9c None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:01.807872 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e63b74-c672-4730-9c4a-d8be9a933b9c None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:01.808147 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e63b74-c672-4730-9c4a-d8be9a933b9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:01.819086 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e63b74-c672-4730-9c4a-d8be9a933b9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:01.820617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e63b74-c672-4730-9c4a-d8be9a933b9c None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:01.835972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-49e63b74-c672-4730-9c4a-d8be9a933b9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:01.835972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:01.835972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:01.835972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:01.835972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:01.835972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:01.835972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:01.835972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:01.835972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:01.835972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:01.835972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:01.835972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:01.835972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:01.835972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:01.835972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:01.835972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:01.836902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:01.836902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:01.836902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:01.836902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:01.836902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:01.836902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:01.836902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:01.836902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:01.836902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:01.836902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:01.836902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:01.836902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:01.836902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:01.836902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:01.836902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:01.836902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:01.836902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:01.837758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:01.837758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:01.837758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:01.837758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 275/548] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:01.842821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e9c7f-abb2-47b4-acf9-8015af5ad25b None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:01.894914 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e63b74-c672-4730-9c4a-d8be9a933b9c None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:01.907372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:01.975902 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e9c7f-abb2-47b4-acf9-8015af5ad25b None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:02.016587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67367ec8-37b6-4e62-91e8-73f62ce6e2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:02.017570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67367ec8-37b6-4e62-91e8-73f62ce6e2c0 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:02.018063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67367ec8-37b6-4e62-91e8-73f62ce6e2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:02.019710 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67367ec8-37b6-4e62-91e8-73f62ce6e2c0 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:02.020863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67367ec8-37b6-4e62-91e8-73f62ce6e2c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:02.021402 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67367ec8-37b6-4e62-91e8-73f62ce6e2c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:02.023151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67367ec8-37b6-4e62-91e8-73f62ce6e2c0 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:02.039036 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 274/549] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:02.045457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67367ec8-37b6-4e62-91e8-73f62ce6e2c0 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:02.075531 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:02.099190 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e63b74-c672-4730-9c4a-d8be9a933b9c None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:02.174243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c42d9e-97da-47dc-a1e7-e079a0e92fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:02.175337 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c42d9e-97da-47dc-a1e7-e079a0e92fac None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:02.175608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c42d9e-97da-47dc-a1e7-e079a0e92fac None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:02.175878 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c42d9e-97da-47dc-a1e7-e079a0e92fac None admin] PATH_INFO: `/v3/roles/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:02.194929 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c42d9e-97da-47dc-a1e7-e079a0e92fac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:32:02.200137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67367ec8-37b6-4e62-91e8-73f62ce6e2c0 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:02.201265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-30c42d9e-97da-47dc-a1e7-e079a0e92fac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:02.201265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:02.201265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:02.201265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:02.201265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:02.201265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:02.201265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:02.201265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:02.201265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:02.201265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:02.201265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:02.201265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:02.201265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:32:02.201265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:32:02.201265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:32:02.201265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:32:02.202715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:32:02.202715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:32:02.202715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:32:02.202715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:32:02.202715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:02.202715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:02.202715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:02.202715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:02.202715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:02.202715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:02.202715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:02.202715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:02.202715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:02.202715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:02.202715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:02.202715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:02.204122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:02.204122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:02.204122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:02.204122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:02.204122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:32:02.204122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:32:02.204122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:32:02.204122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:32:02.204122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:32:02.204122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:32:02.204122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:02.204122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:02.207896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 276/550] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:32:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:32:02.210144 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d365516-04c9-453d-b5c7-4c440fd5a726 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:02.210430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d365516-04c9-453d-b5c7-4c440fd5a726 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:02.210708 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d365516-04c9-453d-b5c7-4c440fd5a726 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:02.212229 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 277/551] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:02.212936 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d365516-04c9-453d-b5c7-4c440fd5a726 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:02.263227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4f55e-8f1b-48b9-bf0a-eab42e58b5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:02.264924 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4f55e-8f1b-48b9-bf0a-eab42e58b5a5 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:02.265440 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4f55e-8f1b-48b9-bf0a-eab42e58b5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:02.266273 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4f55e-8f1b-48b9-bf0a-eab42e58b5a5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:02.277269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4f55e-8f1b-48b9-bf0a-eab42e58b5a5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:02.279625 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4f55e-8f1b-48b9-bf0a-eab42e58b5a5 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:02.296049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-d1f4f55e-8f1b-48b9-bf0a-eab42e58b5a5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:32:02.296049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:02.296049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:02.296049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:02.296049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:02.296049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:02.296049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:02.296049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:02.296049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:02.296049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:02.296049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:02.296049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:02.296049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:02.296049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:02.296049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:02.296049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:02.297056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:02.297056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:02.297056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:02.297056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:02.297056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:02.297056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:02.297056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:02.297056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:02.297056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:02.297056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:02.297056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:02.297056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:02.297056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:02.297056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:02.297056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:02.297056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:02.297056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:02.297056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:02.298101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:02.298101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:02.298101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:02.298101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:02.298101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:02.298101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:02.298101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:02.298101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:02.298101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:32:02.298101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:02.301854 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 275/552] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:32:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:02.303334 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef34f3-011d-42aa-9358-6ac718817224 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:02.303982 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef34f3-011d-42aa-9358-6ac718817224 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:02.304458 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef34f3-011d-42aa-9358-6ac718817224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:02.317707 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:02.329700 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-d7ef34f3-011d-42aa-9358-6ac718817224 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:02.331079 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-d7ef34f3-011d-42aa-9358-6ac718817224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:02.369304 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d365516-04c9-453d-b5c7-4c440fd5a726 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:02.412601 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 276/553] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:32:02.413327 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef34f3-011d-42aa-9358-6ac718817224 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:02.414037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a5d0f-4e37-452a-a2e7-b5bb6de7b2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:02.414946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a5d0f-4e37-452a-a2e7-b5bb6de7b2ab None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:02.415475 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a5d0f-4e37-452a-a2e7-b5bb6de7b2ab None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:02.416229 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a5d0f-4e37-452a-a2e7-b5bb6de7b2ab None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:02.417673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:02.418844 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a5d0f-4e37-452a-a2e7-b5bb6de7b2ab None admin] RBAC: Adding query filter params (name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:02.419352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a5d0f-4e37-452a-a2e7-b5bb6de7b2ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:02.420943 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a5d0f-4e37-452a-a2e7-b5bb6de7b2ab None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:02.432241 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 278/554] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 09:32:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:02.439201 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a5d0f-4e37-452a-a2e7-b5bb6de7b2ab None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:02.563214 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a5d0f-4e37-452a-a2e7-b5bb6de7b2ab None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:02.598068 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:02.607862 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f26a28-956c-4ec1-82c9-9ead022d016e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:02.608742 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f26a28-956c-4ec1-82c9-9ead022d016e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:02.609223 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f26a28-956c-4ec1-82c9-9ead022d016e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:02.609750 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f26a28-956c-4ec1-82c9-9ead022d016e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:02.635170 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f26a28-956c-4ec1-82c9-9ead022d016e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:02.639729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f26a28-956c-4ec1-82c9-9ead022d016e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:02.667923 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef34f3-011d-42aa-9358-6ac718817224 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:02.669828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-87f26a28-956c-4ec1-82c9-9ead022d016e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:02.669828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:02.669828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:02.669828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:02.669828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:02.669828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:02.669828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:02.669828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:02.669828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:02.669828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:02.669828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:02.669828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:02.669828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:02.669828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:02.669828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:02.669828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:02.670784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:02.670784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:02.670784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:02.670784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:02.670784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:02.670784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:02.670784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:02.670784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:02.670784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:02.670784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:02.670784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:02.670784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:02.670784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:02.670784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:02.670784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:02.670784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:02.670784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:02.671639 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:02.671639 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:02.671639 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:02.674551 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 279/555] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:32:02.682236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f26a28-956c-4ec1-82c9-9ead022d016e None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:02.741374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6772a6-dfc9-410c-b417-6d67646e0110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:02.741932 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6772a6-dfc9-410c-b417-6d67646e0110 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:02.742212 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6772a6-dfc9-410c-b417-6d67646e0110 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:02.742486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6772a6-dfc9-410c-b417-6d67646e0110 None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:02.743281 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6772a6-dfc9-410c-b417-6d67646e0110 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:02.743588 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6772a6-dfc9-410c-b417-6d67646e0110 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:02.746050 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6772a6-dfc9-410c-b417-6d67646e0110 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:02.765829 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 277/556] 10.222.0.58 () {56 vars in 1135 bytes} [Wed Aug 24 09:32:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:02.771727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6772a6-dfc9-410c-b417-6d67646e0110 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:02.817622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f26a28-956c-4ec1-82c9-9ead022d016e None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:02.835056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:02.857317 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f38c8-1926-4862-957f-ad6a87b77d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:02.858580 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f38c8-1926-4862-957f-ad6a87b77d25 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:02.859060 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f38c8-1926-4862-957f-ad6a87b77d25 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:02.859562 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f38c8-1926-4862-957f-ad6a87b77d25 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:02.860559 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f38c8-1926-4862-957f-ad6a87b77d25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:02.861170 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f38c8-1926-4862-957f-ad6a87b77d25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:02.862832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f38c8-1926-4862-957f-ad6a87b77d25 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:02.881128 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6772a6-dfc9-410c-b417-6d67646e0110 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:02.881577 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 280/557] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:02.882719 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f38c8-1926-4862-957f-ad6a87b77d25 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:02.915030 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfa7c3-ef6d-488e-9a5e-24591c66b6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:02.915714 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfa7c3-ef6d-488e-9a5e-24591c66b6e1 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:02.915999 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfa7c3-ef6d-488e-9a5e-24591c66b6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:02.916272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfa7c3-ef6d-488e-9a5e-24591c66b6e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:02.930358 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfa7c3-ef6d-488e-9a5e-24591c66b6e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:32:02.931817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:02.936005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-f2cfa7c3-ef6d-488e-9a5e-24591c66b6e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:02.936005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:02.936005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:02.936005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:02.936005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:02.936005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:02.936005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:02.936005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:02.936005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:02.936005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:02.936005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:02.936005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:02.936005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:32:02.936005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:32:02.936005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:32:02.936005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:32:02.937374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:32:02.937374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:32:02.937374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:32:02.937374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:32:02.937374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:02.937374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:02.937374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:02.937374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:02.937374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:02.937374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:02.937374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:02.937374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:02.937374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:02.937374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:02.937374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:02.937374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:02.938786 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:02.938786 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:02.938786 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:02.938786 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:02.938786 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:32:02.938786 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:32:02.938786 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:32:02.938786 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:32:02.938786 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:32:02.938786 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:32:02.938786 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:02.938786 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:02.941542 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 278/558] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:32:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:02.942639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfa7c3-ef6d-488e-9a5e-24591c66b6e1 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:03.005210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f38c8-1926-4862-957f-ad6a87b77d25 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:03.044889 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb4258-405a-4f66-a9d3-1cfd20120b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:03.045928 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb4258-405a-4f66-a9d3-1cfd20120b49 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:03.046532 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb4258-405a-4f66-a9d3-1cfd20120b49 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:03.047041 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb4258-405a-4f66-a9d3-1cfd20120b49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:03.077950 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfa7c3-ef6d-488e-9a5e-24591c66b6e1 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:03.103479 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:03.118150 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1d87c-53d0-465a-bcde-4422b0c8ed0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:03.119172 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1d87c-53d0-465a-bcde-4422b0c8ed0c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:03.119656 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1d87c-53d0-465a-bcde-4422b0c8ed0c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:03.120169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1d87c-53d0-465a-bcde-4422b0c8ed0c None admin] PATH_INFO: `/v3/users/nova` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:03.129750 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1d87c-53d0-465a-bcde-4422b0c8ed0c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:03.131717 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1d87c-53d0-465a-bcde-4422b0c8ed0c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:03.139309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb4258-405a-4f66-a9d3-1cfd20120b49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:03.141030 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb4258-405a-4f66-a9d3-1cfd20120b49 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:03.146466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-47c1d87c-53d0-465a-bcde-4422b0c8ed0c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:32:03.146466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:03.146466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:03.146466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:03.146466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:03.146466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:03.146466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:03.146466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:03.146466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:03.146466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:03.146466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:03.146466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:03.146466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:03.146466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:03.146466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:03.146466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:03.147480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:03.147480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:03.147480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:03.147480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:03.147480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:03.147480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:03.147480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:03.147480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:03.147480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:03.147480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:03.147480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:03.147480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:03.147480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:03.147480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:03.147480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:03.147480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:03.147480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:03.147480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:03.148416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:03.148416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:03.148416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:03.148416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:03.148416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:03.148416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:03.148416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:03.148416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:03.148416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:32:03.148416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:03.155535 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 279/559] 10.222.0.58 () {56 vars in 1093 bytes} [Wed Aug 24 09:32:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:03.156751 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1d87c-53d0-465a-bcde-4422b0c8ed0c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:03.187056 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:03.269726 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 281/560] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:32:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:03.271031 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb4258-405a-4f66-a9d3-1cfd20120b49 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:03.296686 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1d87c-53d0-465a-bcde-4422b0c8ed0c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:03.335342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee1a9e-7671-4171-a4e3-20763b09607c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:03.336262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee1a9e-7671-4171-a4e3-20763b09607c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:03.336560 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee1a9e-7671-4171-a4e3-20763b09607c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:03.336908 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee1a9e-7671-4171-a4e3-20763b09607c None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:03.337596 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee1a9e-7671-4171-a4e3-20763b09607c None admin] RBAC: Adding query filter params (name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:03.337889 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee1a9e-7671-4171-a4e3-20763b09607c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:03.339255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee1a9e-7671-4171-a4e3-20763b09607c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:03.348477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 280/561] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 09:32:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:03.353364 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee1a9e-7671-4171-a4e3-20763b09607c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:03.397501 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:03.400513 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb4258-405a-4f66-a9d3-1cfd20120b49 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:03.437824 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017be41-b26c-49c9-8bf5-fbeb266058d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:03.438429 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017be41-b26c-49c9-8bf5-fbeb266058d7 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:03.438702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017be41-b26c-49c9-8bf5-fbeb266058d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:03.438969 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017be41-b26c-49c9-8bf5-fbeb266058d7 None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:03.440263 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017be41-b26c-49c9-8bf5-fbeb266058d7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:03.440571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017be41-b26c-49c9-8bf5-fbeb266058d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:03.442189 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017be41-b26c-49c9-8bf5-fbeb266058d7 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:03.457387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:03.466260 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 282/562] 10.222.0.58 () {56 vars in 1133 bytes} [Wed Aug 24 09:32:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:03.467385 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d7c94-ecf3-45ba-a0b3-8d9381f102e0 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:03.467668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d7c94-ecf3-45ba-a0b3-8d9381f102e0 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:03.467941 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d7c94-ecf3-45ba-a0b3-8d9381f102e0 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:03.469147 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 283/563] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:03.469312 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee1a9e-7671-4171-a4e3-20763b09607c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:03.469858 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d7c94-ecf3-45ba-a0b3-8d9381f102e0 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:03.504771 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216347d2-d005-42ba-afd4-9337a1e4a886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:03.505389 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216347d2-d005-42ba-afd4-9337a1e4a886 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:03.505725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216347d2-d005-42ba-afd4-9337a1e4a886 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:03.506001 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216347d2-d005-42ba-afd4-9337a1e4a886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:03.516594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216347d2-d005-42ba-afd4-9337a1e4a886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:03.518076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216347d2-d005-42ba-afd4-9337a1e4a886 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:03.531997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-216347d2-d005-42ba-afd4-9337a1e4a886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:03.531997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:03.531997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:03.531997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:03.531997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:03.531997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:03.531997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:03.531997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:03.531997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:03.531997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:03.531997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:03.531997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:03.531997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:03.531997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:03.531997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:03.531997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:03.533149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:03.533149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:03.533149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:03.533149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:03.533149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:03.533149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:03.533149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:03.533149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:03.533149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:03.533149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:03.533149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:03.533149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:03.533149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:03.533149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:03.533149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:03.533149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:03.533149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:03.534800 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:03.534800 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:03.534800 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:03.534800 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 281/564] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:03.535446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ec34f-c495-4bb2-8ede-2c0733fff407 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:03.535828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ec34f-c495-4bb2-8ede-2c0733fff407 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:03.536114 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ec34f-c495-4bb2-8ede-2c0733fff407 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:03.537356 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 282/565] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:03.538171 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ec34f-c495-4bb2-8ede-2c0733fff407 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:03.577884 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d7c94-ecf3-45ba-a0b3-8d9381f102e0 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:03.611838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc46f3-8b5a-4462-b1a3-5a678935076c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:03.612479 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc46f3-8b5a-4462-b1a3-5a678935076c None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:03.612757 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc46f3-8b5a-4462-b1a3-5a678935076c None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:03.613029 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc46f3-8b5a-4462-b1a3-5a678935076c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:03.623321 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc46f3-8b5a-4462-b1a3-5a678935076c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:03.624754 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc46f3-8b5a-4462-b1a3-5a678935076c None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:03.632929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:03.639905 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ec34f-c495-4bb2-8ede-2c0733fff407 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:03.640372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-65cc46f3-8b5a-4462-b1a3-5a678935076c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:03.640372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:03.640372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:03.640372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:03.640372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:03.640372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:03.640372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:03.640372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:03.640372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:03.640372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:03.640372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:03.640372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:03.640372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:03.640372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:03.640372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:03.640372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:03.641386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:03.641386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:03.641386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:03.641386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:03.641386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:03.641386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:03.641386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:03.641386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:03.641386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:03.641386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:03.641386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:03.641386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:03.641386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:03.641386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:03.641386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:03.641386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:03.641386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:03.642301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:03.642301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:03.642301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:03.642301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 284/566] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:03.642752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f57024-13b9-4c89-b9f7-ca134e8d3831 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:03.643023 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f57024-13b9-4c89-b9f7-ca134e8d3831 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:03.644004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f57024-13b9-4c89-b9f7-ca134e8d3831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:03.661432 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-35f57024-13b9-4c89-b9f7-ca134e8d3831 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:03.662656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-35f57024-13b9-4c89-b9f7-ca134e8d3831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:03.676375 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622f77e-941b-4172-bec1-dd50f4a0e0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:03.677000 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622f77e-941b-4172-bec1-dd50f4a0e0c2 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:03.677273 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622f77e-941b-4172-bec1-dd50f4a0e0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:03.677577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622f77e-941b-4172-bec1-dd50f4a0e0c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:03.688070 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622f77e-941b-4172-bec1-dd50f4a0e0c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:03.689527 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622f77e-941b-4172-bec1-dd50f4a0e0c2 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:03.704142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-8622f77e-941b-4172-bec1-dd50f4a0e0c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:03.704142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:03.704142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:03.704142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:03.704142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:03.704142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:03.704142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:03.704142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:03.704142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:03.704142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:03.704142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:03.704142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:03.704142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:03.704142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:03.704142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:03.704142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:03.705119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:03.705119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:03.705119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:03.705119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:03.705119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:03.705119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:03.705119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:03.705119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:03.705119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:03.705119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:03.705119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:03.705119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:03.705119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:03.705119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:03.705119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:03.705119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:03.705119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:03.706071 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:03.706071 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:03.706071 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:03.706071 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 283/567] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:03.706071 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622f77e-941b-4172-bec1-dd50f4a0e0c2 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:03.715516 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:03.738820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 285/568] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:32:03.740094 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04671de-64c4-4bf9-92f6-d7a3e2acf59b None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:03.740379 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04671de-64c4-4bf9-92f6-d7a3e2acf59b None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:03.740655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04671de-64c4-4bf9-92f6-d7a3e2acf59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:03.758260 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-f04671de-64c4-4bf9-92f6-d7a3e2acf59b None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:03.759614 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f04671de-64c4-4bf9-92f6-d7a3e2acf59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:03.819279 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622f77e-941b-4172-bec1-dd50f4a0e0c2 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:03.830986 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 286/569] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:32:03.832024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04671de-64c4-4bf9-92f6-d7a3e2acf59b None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:03.863960 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e428560-8e91-4ae3-b983-f53fa8996d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:03.864651 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e428560-8e91-4ae3-b983-f53fa8996d48 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:03.865245 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e428560-8e91-4ae3-b983-f53fa8996d48 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:03.865625 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e428560-8e91-4ae3-b983-f53fa8996d48 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:03.866748 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e428560-8e91-4ae3-b983-f53fa8996d48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:03.867130 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e428560-8e91-4ae3-b983-f53fa8996d48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:03.868861 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e428560-8e91-4ae3-b983-f53fa8996d48 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:03.889870 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 284/570] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:03.890849 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e428560-8e91-4ae3-b983-f53fa8996d48 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:03.904665 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:03.951966 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04671de-64c4-4bf9-92f6-d7a3e2acf59b None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:03.967372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:03.997950 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbca4c3-8c09-4d73-bfa4-b8fd01064f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:03.998660 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbca4c3-8c09-4d73-bfa4-b8fd01064f09 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:03.999005 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbca4c3-8c09-4d73-bfa4-b8fd01064f09 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:03.999351 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbca4c3-8c09-4d73-bfa4-b8fd01064f09 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:04.000227 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbca4c3-8c09-4d73-bfa4-b8fd01064f09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:04.000596 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbca4c3-8c09-4d73-bfa4-b8fd01064f09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:04.002802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbca4c3-8c09-4d73-bfa4-b8fd01064f09 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:04.016424 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 287/571] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:04.017166 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbca4c3-8c09-4d73-bfa4-b8fd01064f09 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:04.024892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e428560-8e91-4ae3-b983-f53fa8996d48 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:04.062616 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58656a5-f1db-4598-97ab-ec5707e8f538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:04.063524 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58656a5-f1db-4598-97ab-ec5707e8f538 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:04.063829 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58656a5-f1db-4598-97ab-ec5707e8f538 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:04.064070 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58656a5-f1db-4598-97ab-ec5707e8f538 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:04.064714 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58656a5-f1db-4598-97ab-ec5707e8f538 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:04.065630 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58656a5-f1db-4598-97ab-ec5707e8f538 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:04.067062 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58656a5-f1db-4598-97ab-ec5707e8f538 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:04.078555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 285/572] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:04.079281 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58656a5-f1db-4598-97ab-ec5707e8f538 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:04.125969 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbca4c3-8c09-4d73-bfa4-b8fd01064f09 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:04.151712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:04.161261 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3354b-1a11-4973-9f98-ab34b55cbb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:04.161947 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3354b-1a11-4973-9f98-ab34b55cbb2b None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:04.162230 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3354b-1a11-4973-9f98-ab34b55cbb2b None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:04.162505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3354b-1a11-4973-9f98-ab34b55cbb2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:04.169186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3354b-1a11-4973-9f98-ab34b55cbb2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:04.170647 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3354b-1a11-4973-9f98-ab34b55cbb2b None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:04.181853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-8fc3354b-1a11-4973-9f98-ab34b55cbb2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:04.181853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:04.181853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:04.181853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:04.181853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:04.181853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:04.181853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:04.181853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:04.181853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:04.181853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:04.181853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:04.181853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:04.181853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:04.181853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:04.181853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:04.182752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:04.182752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:04.182752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:04.182752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:04.182752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:04.182752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:04.182752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:04.182752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:04.182752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:04.182752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:04.182752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:04.182752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:04.182752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:04.182752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:04.182752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:04.182752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:04.182752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:04.188795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:04.188795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:04.188795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:04.188795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:04.188795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:04.188795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:04.188795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:04.188795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:04.188795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 288/573] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:04.188795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3354b-1a11-4973-9f98-ab34b55cbb2b None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:04.189449 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58656a5-f1db-4598-97ab-ec5707e8f538 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:04.215113 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:04.220427 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43549e-cf01-46fd-959b-0735a25bc7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:04.221047 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43549e-cf01-46fd-959b-0735a25bc7c9 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:04.221359 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43549e-cf01-46fd-959b-0735a25bc7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:04.221672 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43549e-cf01-46fd-959b-0735a25bc7c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:04.232009 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43549e-cf01-46fd-959b-0735a25bc7c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:32:04.237509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-2c43549e-cf01-46fd-959b-0735a25bc7c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:04.237509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:04.237509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:04.237509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:04.237509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:04.237509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:04.237509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:04.237509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:04.237509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:04.237509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:04.237509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:04.237509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:04.237509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:32:04.237509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:32:04.237509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:32:04.237509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:32:04.238608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:32:04.238608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:32:04.238608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:32:04.238608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:32:04.238608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:04.238608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:04.238608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:04.238608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:04.238608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:04.238608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:04.238608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:04.238608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:04.238608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:04.238608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:04.238608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:04.238608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:04.239563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:04.239563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:04.239563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:04.239563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:04.239563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:32:04.239563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:32:04.239563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:32:04.239563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:32:04.239563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:32:04.239563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:32:04.239563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:04.239563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:04.239563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 286/574] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:32:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:04.240249 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43549e-cf01-46fd-959b-0735a25bc7c9 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:04.290852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3354b-1a11-4973-9f98-ab34b55cbb2b None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:04.323789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d68b50-1686-44cd-ac61-4d8c05bb2d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:04.324410 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d68b50-1686-44cd-ac61-4d8c05bb2d44 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:04.324683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d68b50-1686-44cd-ac61-4d8c05bb2d44 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:04.324952 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d68b50-1686-44cd-ac61-4d8c05bb2d44 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:04.332941 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d68b50-1686-44cd-ac61-4d8c05bb2d44 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:04.334399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d68b50-1686-44cd-ac61-4d8c05bb2d44 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:04.345483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-13d68b50-1686-44cd-ac61-4d8c05bb2d44 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:32:04.345483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:04.345483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:04.345483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:04.345483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:04.345483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:04.345483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:04.345483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:04.345483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:04.345483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:04.345483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:04.345483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:04.345483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:04.345483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:04.345483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:04.345483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:04.346391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:04.346391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:04.346391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:04.346391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:04.346391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:04.346391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:04.346391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:04.346391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:04.346391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:04.346391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:04.346391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:04.346391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:04.346391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:04.346391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:04.346391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:04.346391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:04.346391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:04.346391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:04.347455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:04.347455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:04.347455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:04.347455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:04.347455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:04.347455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:04.347455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:04.347455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:04.347455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:32:04.347455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:04.347978 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43549e-cf01-46fd-959b-0735a25bc7c9 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:04.348051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 289/575] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:32:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:04.348051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d68b50-1686-44cd-ac61-4d8c05bb2d44 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:04.376537 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:04.385831 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f30475-3523-4b78-9bb4-3457fec72823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:04.386448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f30475-3523-4b78-9bb4-3457fec72823 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:04.386735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f30475-3523-4b78-9bb4-3457fec72823 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:04.387002 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f30475-3523-4b78-9bb4-3457fec72823 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:04.394149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f30475-3523-4b78-9bb4-3457fec72823 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:04.395589 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f30475-3523-4b78-9bb4-3457fec72823 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:04.406563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-08f30475-3523-4b78-9bb4-3457fec72823 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:04.406563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:04.406563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:04.406563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:04.406563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:04.406563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:04.406563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:04.406563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:04.406563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:04.406563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:04.406563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:04.406563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:04.406563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:04.406563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:04.406563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:04.407611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:04.407611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:04.407611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:04.407611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:04.407611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:04.407611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:04.407611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:04.407611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:04.407611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:04.407611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:04.407611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:04.407611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:04.407611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:04.407611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:04.407611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:04.407611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:04.407611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:04.408701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:04.408701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:04.408701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:04.408701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:04.408701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:04.408701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:04.408701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:04.408701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:04.408701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 287/576] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:04.408701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f30475-3523-4b78-9bb4-3457fec72823 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:04.448111 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:04.457842 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d68b50-1686-44cd-ac61-4d8c05bb2d44 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:04.491554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cec15-70d5-4569-be15-52191be20967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:04.492176 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cec15-70d5-4569-be15-52191be20967 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:04.492457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cec15-70d5-4569-be15-52191be20967 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:04.492729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cec15-70d5-4569-be15-52191be20967 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:04.503136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cec15-70d5-4569-be15-52191be20967 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:32:04.508220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-7e7cec15-70d5-4569-be15-52191be20967 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:04.508220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:04.508220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:04.508220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:04.508220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:04.508220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:04.508220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:04.508220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:04.508220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:04.508220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:04.508220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:04.508220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:04.508220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:32:04.508220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:32:04.508220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:32:04.508220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:32:04.509149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:32:04.509149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:32:04.509149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:32:04.509149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:32:04.509149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:04.509149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:04.509149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:04.509149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:04.509149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:04.509149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:04.509149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:04.509149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:04.509149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:04.509149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:04.509149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:04.509149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:04.510002 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:04.510002 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:04.510002 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:04.510002 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:04.510002 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:32:04.510002 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:32:04.510002 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:32:04.510002 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:32:04.510002 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:32:04.510002 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:32:04.510002 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:04.510002 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:04.510002 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 290/577] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:32:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:04.511023 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cec15-70d5-4569-be15-52191be20967 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:04.511102 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f30475-3523-4b78-9bb4-3457fec72823 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:04.545137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301acbb-9c53-4797-b116-6ebeda32436c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:04.545815 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301acbb-9c53-4797-b116-6ebeda32436c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:04.546114 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301acbb-9c53-4797-b116-6ebeda32436c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:04.546403 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301acbb-9c53-4797-b116-6ebeda32436c None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:04.547119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301acbb-9c53-4797-b116-6ebeda32436c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:04.547438 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301acbb-9c53-4797-b116-6ebeda32436c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:04.548884 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301acbb-9c53-4797-b116-6ebeda32436c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:04.561504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 288/578] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:04.562108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301acbb-9c53-4797-b116-6ebeda32436c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:04.610659 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cec15-70d5-4569-be15-52191be20967 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:04.614466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:04.644454 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa528b6-59c3-459c-b40f-ed0aa2ae211b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:04.645054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa528b6-59c3-459c-b40f-ed0aa2ae211b None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:04.645332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa528b6-59c3-459c-b40f-ed0aa2ae211b None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:04.645637 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa528b6-59c3-459c-b40f-ed0aa2ae211b None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:04.646300 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa528b6-59c3-459c-b40f-ed0aa2ae211b None admin] RBAC: Adding query filter params (name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:04.646600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa528b6-59c3-459c-b40f-ed0aa2ae211b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:04.647953 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa528b6-59c3-459c-b40f-ed0aa2ae211b None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:04.656574 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 291/579] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 09:32:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:04.657370 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa528b6-59c3-459c-b40f-ed0aa2ae211b None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:04.665591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301acbb-9c53-4797-b116-6ebeda32436c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:04.674990 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:04.699991 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb630b-a3fc-469b-9ab5-5ee8e78e672d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:04.700587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb630b-a3fc-469b-9ab5-5ee8e78e672d None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:04.700866 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb630b-a3fc-469b-9ab5-5ee8e78e672d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:04.701138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb630b-a3fc-469b-9ab5-5ee8e78e672d None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:04.701895 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb630b-a3fc-469b-9ab5-5ee8e78e672d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:04.702201 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb630b-a3fc-469b-9ab5-5ee8e78e672d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:04.703630 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb630b-a3fc-469b-9ab5-5ee8e78e672d None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:04.721233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 289/580] 10.222.0.58 () {56 vars in 1137 bytes} [Wed Aug 24 09:32:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:04.721876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb630b-a3fc-469b-9ab5-5ee8e78e672d None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:04.765710 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa528b6-59c3-459c-b40f-ed0aa2ae211b None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:04.798678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ead47-7e72-4bfb-965d-acb3db02ef13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:04.799275 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ead47-7e72-4bfb-965d-acb3db02ef13 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:04.800099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ead47-7e72-4bfb-965d-acb3db02ef13 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:04.800372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ead47-7e72-4bfb-965d-acb3db02ef13 None admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:04.801055 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ead47-7e72-4bfb-965d-acb3db02ef13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:04.801352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ead47-7e72-4bfb-965d-acb3db02ef13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:04.802807 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ead47-7e72-4bfb-965d-acb3db02ef13 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:04.814710 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 292/581] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:04.815610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ead47-7e72-4bfb-965d-acb3db02ef13 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:04.828818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb630b-a3fc-469b-9ab5-5ee8e78e672d None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:04.836402 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:04.864639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4ec72-b954-4924-ba26-00b2338fd23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:04.865168 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4ec72-b954-4924-ba26-00b2338fd23e None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:04.865446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4ec72-b954-4924-ba26-00b2338fd23e None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:04.865744 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4ec72-b954-4924-ba26-00b2338fd23e None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:04.866398 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4ec72-b954-4924-ba26-00b2338fd23e None admin] RBAC: Adding query filter params (name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:04.866696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4ec72-b954-4924-ba26-00b2338fd23e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:04.868055 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4ec72-b954-4924-ba26-00b2338fd23e None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:04.875953 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 290/582] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 09:32:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:04.876748 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4ec72-b954-4924-ba26-00b2338fd23e None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:04.896013 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:04.920492 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ead47-7e72-4bfb-965d-acb3db02ef13 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:04.955401 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cec14d-22ce-42fe-a0c5-95a6feb01dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:04.956222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cec14d-22ce-42fe-a0c5-95a6feb01dae None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:04.956516 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cec14d-22ce-42fe-a0c5-95a6feb01dae None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:04.956790 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cec14d-22ce-42fe-a0c5-95a6feb01dae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:04.957541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cec14d-22ce-42fe-a0c5-95a6feb01dae None admin] RBAC: Adding query filter params (role.id=85dac7b70cf04091baaf69caabd27a8b, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=ff2db35b94c84ec7bba96117d23baf6b) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:04.957850 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cec14d-22ce-42fe-a0c5-95a6feb01dae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:04.959269 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cec14d-22ce-42fe-a0c5-95a6feb01dae None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:04.964661 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 293/583] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:32:04 2022] GET /identity/v3/role_assignments?user.id=ff2db35b94c84ec7bba96117d23baf6b&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=85dac7b70cf04091baaf69caabd27a8b => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:04.965635 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cec14d-22ce-42fe-a0c5-95a6feb01dae None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:04.980562 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4ec72-b954-4924-ba26-00b2338fd23e None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:05.025852 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c61abe-9365-42bb-8259-0c10b5060251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:05.026497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c61abe-9365-42bb-8259-0c10b5060251 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:05.026771 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c61abe-9365-42bb-8259-0c10b5060251 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:05.027040 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c61abe-9365-42bb-8259-0c10b5060251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:05.040125 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c61abe-9365-42bb-8259-0c10b5060251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:05.041646 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c61abe-9365-42bb-8259-0c10b5060251 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:05.060477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-e0c61abe-9365-42bb-8259-0c10b5060251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:05.060477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:05.060477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:05.060477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:05.060477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:05.060477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:05.060477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:05.060477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:05.060477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:05.060477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:05.060477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:05.060477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:05.060477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:05.060477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:05.060477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:05.060477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:05.061605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:05.061605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:05.061605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:05.061605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:05.061605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:05.061605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:05.061605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:05.061605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:05.061605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:05.061605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:05.061605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:05.061605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:05.061605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:05.061605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:05.061605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:05.061605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:05.061605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:05.062651 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:05.062651 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:05.062651 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:05.067246 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 291/584] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:05.068182 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c61abe-9365-42bb-8259-0c10b5060251 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:05.092885 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:05.104416 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cec14d-22ce-42fe-a0c5-95a6feb01dae None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:05.145919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb9792-2b63-45e9-8296-936f91e3c8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:05.146513 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb9792-2b63-45e9-8296-936f91e3c8e3 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:05.146808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb9792-2b63-45e9-8296-936f91e3c8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:05.147106 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb9792-2b63-45e9-8296-936f91e3c8e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:05.157156 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:05.162864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb9792-2b63-45e9-8296-936f91e3c8e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:05.164828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb9792-2b63-45e9-8296-936f91e3c8e3 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:05.184417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-4adb9792-2b63-45e9-8296-936f91e3c8e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:05.184417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:05.184417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:05.184417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:05.184417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:05.184417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:05.184417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:05.184417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:05.184417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:05.184417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:05.184417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:05.184417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:05.184417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:05.184417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:05.184417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:05.184417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:05.185510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:05.185510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:05.185510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:05.185510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:05.185510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:05.185510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:05.185510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:05.185510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:05.185510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:05.185510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:05.185510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:05.185510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:05.185510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:05.185510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:05.185510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:05.185510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:05.185510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:05.186389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:05.186389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:05.186389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:05.186389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 294/585] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:05.186389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb9792-2b63-45e9-8296-936f91e3c8e3 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:05.201070 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c61abe-9365-42bb-8259-0c10b5060251 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:05.255947 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b51efc-022a-4d9c-9e09-a8b3da0a66e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:05.256610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b51efc-022a-4d9c-9e09-a8b3da0a66e4 None admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:05.256892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b51efc-022a-4d9c-9e09-a8b3da0a66e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:05.257168 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b51efc-022a-4d9c-9e09-a8b3da0a66e4 None admin] PATH_INFO: `/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/18be8c54c9644c5e9812eea09e60c11c/roles/85dac7b70cf04091baaf69caabd27a8b` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:05.272492 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b51efc-022a-4d9c-9e09-a8b3da0a66e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c95aafd70e547d29c7647e6027faf2f, user_id=18be8c54c9644c5e9812eea09e60c11c, role_id=85dac7b70cf04091baaf69caabd27a8b)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:05.274934 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b51efc-022a-4d9c-9e09-a8b3da0a66e4 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:05.291314 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 292/586] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:32:05 2022] PUT /identity/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/18be8c54c9644c5e9812eea09e60c11c/roles/85dac7b70cf04091baaf69caabd27a8b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:32:05.292461 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b51efc-022a-4d9c-9e09-a8b3da0a66e4 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:05.330194 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb9792-2b63-45e9-8296-936f91e3c8e3 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:05.375167 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff1843-3952-4c26-99a9-65477c1985d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:05.376391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff1843-3952-4c26-99a9-65477c1985d5 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:05.376973 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff1843-3952-4c26-99a9-65477c1985d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:05.377439 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff1843-3952-4c26-99a9-65477c1985d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:05.391765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff1843-3952-4c26-99a9-65477c1985d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:05.393831 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff1843-3952-4c26-99a9-65477c1985d5 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:05.395189 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:05.416309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-85ff1843-3952-4c26-99a9-65477c1985d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:05.416309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:05.416309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:05.416309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:05.416309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:05.416309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:05.416309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:05.416309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:05.416309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:05.416309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:05.416309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:05.416309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:05.416309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:05.416309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:05.416309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:05.416309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:05.417307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:05.417307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:05.417307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:05.417307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:05.417307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:05.417307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:05.417307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:05.417307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:05.417307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:05.417307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:05.417307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:05.417307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:05.417307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:05.417307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:05.417307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:05.417307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:05.417307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:05.418486 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:05.418486 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:05.418486 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:05.420625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 295/587] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:05.421782 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff1843-3952-4c26-99a9-65477c1985d5 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:05.453585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b51efc-022a-4d9c-9e09-a8b3da0a66e4 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:05.483095 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:05.507304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3198a-3755-428b-8054-b2c86128290c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:05.508185 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3198a-3755-428b-8054-b2c86128290c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:05.508899 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3198a-3755-428b-8054-b2c86128290c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:05.509450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3198a-3755-428b-8054-b2c86128290c None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:05.510137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3198a-3755-428b-8054-b2c86128290c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:05.510444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3198a-3755-428b-8054-b2c86128290c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:05.512079 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3198a-3755-428b-8054-b2c86128290c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:05.527509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 293/588] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:05.528368 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3198a-3755-428b-8054-b2c86128290c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:05.568638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff1843-3952-4c26-99a9-65477c1985d5 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:05.616932 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd00e3-2fb1-4cb6-86eb-797b025f5691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:05.617870 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd00e3-2fb1-4cb6-86eb-797b025f5691 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:05.618216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd00e3-2fb1-4cb6-86eb-797b025f5691 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:05.618494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd00e3-2fb1-4cb6-86eb-797b025f5691 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:05.619162 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd00e3-2fb1-4cb6-86eb-797b025f5691 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:05.619506 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd00e3-2fb1-4cb6-86eb-797b025f5691 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:05.621009 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd00e3-2fb1-4cb6-86eb-797b025f5691 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:05.636943 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 296/589] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:05.638208 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd00e3-2fb1-4cb6-86eb-797b025f5691 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:05.675007 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3198a-3755-428b-8054-b2c86128290c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:05.707456 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:05.713689 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1ce60-93d7-4ff8-885e-31f03cf74a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:05.714290 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1ce60-93d7-4ff8-885e-31f03cf74a46 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:05.714655 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1ce60-93d7-4ff8-885e-31f03cf74a46 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:05.714862 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1ce60-93d7-4ff8-885e-31f03cf74a46 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:05.715679 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1ce60-93d7-4ff8-885e-31f03cf74a46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:05.716138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1ce60-93d7-4ff8-885e-31f03cf74a46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:05.717413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1ce60-93d7-4ff8-885e-31f03cf74a46 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:05.737138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 294/590] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:05.738461 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1ce60-93d7-4ff8-885e-31f03cf74a46 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:05.767108 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd00e3-2fb1-4cb6-86eb-797b025f5691 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:05.770634 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:05.816834 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484b944-6302-4bdf-8ddf-93a841566d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:05.818200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484b944-6302-4bdf-8ddf-93a841566d8a None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:05.821767 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484b944-6302-4bdf-8ddf-93a841566d8a None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:05.822221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484b944-6302-4bdf-8ddf-93a841566d8a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:05.833657 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484b944-6302-4bdf-8ddf-93a841566d8a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:05.835741 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484b944-6302-4bdf-8ddf-93a841566d8a None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:05.850009 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1ce60-93d7-4ff8-885e-31f03cf74a46 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:05.852217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-0484b944-6302-4bdf-8ddf-93a841566d8a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:32:05.852217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:05.852217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:05.852217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:05.852217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:05.852217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:05.852217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:05.852217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:05.852217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:05.852217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:05.852217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:05.852217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:05.852217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:05.852217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:05.852217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:05.852217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:05.853320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:05.853320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:05.853320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:05.853320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:05.853320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:05.853320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:05.853320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:05.853320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:05.853320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:05.853320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:05.853320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:05.853320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:05.853320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:05.853320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:05.853320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:05.853320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:05.853320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:05.853320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:05.854537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:05.854537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:05.854537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:05.854537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:05.854537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:05.854537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:05.854537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:05.854537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:05.854537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:32:05.854537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:05.862095 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 297/591] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:32:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:05.863054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484b944-6302-4bdf-8ddf-93a841566d8a None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:05.892345 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df31b75-c152-442a-bf3a-1a1a5b120986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:05.893867 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df31b75-c152-442a-bf3a-1a1a5b120986 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:05.894513 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df31b75-c152-442a-bf3a-1a1a5b120986 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:05.894889 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df31b75-c152-442a-bf3a-1a1a5b120986 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:05.902108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df31b75-c152-442a-bf3a-1a1a5b120986 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:05.903704 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df31b75-c152-442a-bf3a-1a1a5b120986 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:05.915237 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-3df31b75-c152-442a-bf3a-1a1a5b120986 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:05.915237 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:05.915237 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:05.915237 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:05.915237 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:05.915237 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:05.915237 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:05.915237 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:05.915237 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:05.915237 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:05.915237 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:05.915237 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:05.915237 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:05.915237 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:05.915237 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:05.920170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:05.920170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:05.920170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:05.920170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:05.920170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:05.920170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:05.920170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:05.920170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:05.920170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:05.920170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:05.920170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:05.920170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:05.920170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:05.920170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:05.920170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:05.920170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:05.920170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:05.922742 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:05.922742 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:05.922742 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:05.922742 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:05.922742 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:05.922742 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:05.922742 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:05.922742 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:05.922742 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 295/592] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:05.922742 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df31b75-c152-442a-bf3a-1a1a5b120986 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:05.977033 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:06.009672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484b944-6302-4bdf-8ddf-93a841566d8a None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:06.044620 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df31b75-c152-442a-bf3a-1a1a5b120986 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:06.046099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4914681-0315-4bff-af63-00925a0faf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:06.046933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4914681-0315-4bff-af63-00925a0faf6a None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:06.047305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4914681-0315-4bff-af63-00925a0faf6a None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:06.048293 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4914681-0315-4bff-af63-00925a0faf6a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:06.056999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4914681-0315-4bff-af63-00925a0faf6a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:06.058774 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4914681-0315-4bff-af63-00925a0faf6a None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:06.071431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-c4914681-0315-4bff-af63-00925a0faf6a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:32:06.071431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:06.071431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:06.071431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:06.071431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:06.071431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:06.071431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:06.071431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:06.071431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:06.071431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:06.071431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:06.071431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:06.071431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:06.071431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:06.071431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:06.071431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:06.072555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:06.072555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:06.072555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:06.072555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:06.072555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:06.072555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:06.072555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:06.072555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:06.072555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:06.072555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:06.072555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:06.072555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:06.072555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:06.072555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:06.072555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:06.072555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:06.072555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:06.072555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:06.073691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:06.073691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:06.073691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:06.073691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:06.073691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:06.073691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:06.073691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:06.073691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:06.073691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:32:06.073691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:06.080104 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 298/593] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:32:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:06.081092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4914681-0315-4bff-af63-00925a0faf6a None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:06.089187 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3fdc0-02bb-45f0-8cd5-85e0548907a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:06.090046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3fdc0-02bb-45f0-8cd5-85e0548907a9 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:06.090507 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3fdc0-02bb-45f0-8cd5-85e0548907a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:06.090971 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3fdc0-02bb-45f0-8cd5-85e0548907a9 None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:06.092447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3fdc0-02bb-45f0-8cd5-85e0548907a9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:06.092935 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3fdc0-02bb-45f0-8cd5-85e0548907a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:06.095879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3fdc0-02bb-45f0-8cd5-85e0548907a9 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:06.108978 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:06.129587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 296/594] 10.222.0.58 () {56 vars in 1137 bytes} [Wed Aug 24 09:32:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:06.131372 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3fdc0-02bb-45f0-8cd5-85e0548907a9 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:06.220109 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4914681-0315-4bff-af63-00925a0faf6a None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:06.257790 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3fdc0-02bb-45f0-8cd5-85e0548907a9 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:06.267814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e53c63-a249-431b-9ddd-23adf6daf960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:06.268599 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e53c63-a249-431b-9ddd-23adf6daf960 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:06.268969 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e53c63-a249-431b-9ddd-23adf6daf960 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:06.269331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e53c63-a249-431b-9ddd-23adf6daf960 None admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:06.270123 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:06.270240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e53c63-a249-431b-9ddd-23adf6daf960 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:06.270614 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e53c63-a249-431b-9ddd-23adf6daf960 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:06.272696 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e53c63-a249-431b-9ddd-23adf6daf960 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:06.286982 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 299/595] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:06.287967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e53c63-a249-431b-9ddd-23adf6daf960 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:06.310006 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76869871-e41d-4bd0-b08a-2a3eee54696c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:06.310895 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76869871-e41d-4bd0-b08a-2a3eee54696c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:06.311338 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76869871-e41d-4bd0-b08a-2a3eee54696c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:06.311758 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76869871-e41d-4bd0-b08a-2a3eee54696c None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:06.312648 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76869871-e41d-4bd0-b08a-2a3eee54696c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:06.313110 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76869871-e41d-4bd0-b08a-2a3eee54696c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:06.314565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76869871-e41d-4bd0-b08a-2a3eee54696c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:06.341850 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 297/596] 10.222.0.58 () {56 vars in 1139 bytes} [Wed Aug 24 09:32:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:06.343098 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76869871-e41d-4bd0-b08a-2a3eee54696c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:06.400681 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:06.430802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e53c63-a249-431b-9ddd-23adf6daf960 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:06.459034 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76869871-e41d-4bd0-b08a-2a3eee54696c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:06.477873 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a9abc-0898-40cb-bb4f-24237a12c6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:06.478495 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a9abc-0898-40cb-bb4f-24237a12c6df None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:06.478773 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a9abc-0898-40cb-bb4f-24237a12c6df None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:06.479315 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a9abc-0898-40cb-bb4f-24237a12c6df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:06.491176 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a9abc-0898-40cb-bb4f-24237a12c6df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:06.492657 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84a9abc-0898-40cb-bb4f-24237a12c6df None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:06.498145 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70aa10-abcd-4202-bffb-9e9e77adf34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:06.499090 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70aa10-abcd-4202-bffb-9e9e77adf34f None admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:06.499566 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70aa10-abcd-4202-bffb-9e9e77adf34f None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:06.500033 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70aa10-abcd-4202-bffb-9e9e77adf34f None admin] PATH_INFO: `/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/51fe6dfa43d04cdeb0421d2613c8c2ca/roles/85dac7b70cf04091baaf69caabd27a8b` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:06.509450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-e84a9abc-0898-40cb-bb4f-24237a12c6df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:06.509450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:06.509450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:06.509450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:06.509450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:06.509450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:06.509450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:06.509450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:06.509450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:06.509450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:06.509450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:06.509450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:06.509450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:06.509450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:06.509450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:06.509450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:06.510426 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:06.510426 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:06.510426 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:06.510426 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:06.510426 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:06.510426 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:06.510426 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:06.510426 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:06.510426 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:06.510426 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:06.510426 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:06.510426 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:06.510426 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:06.510426 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:06.510426 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:06.510426 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:06.510426 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:06.511341 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:06.511341 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:06.511341 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:06.511341 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 300/597] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:06.511341 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a9abc-0898-40cb-bb4f-24237a12c6df None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:06.520848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70aa10-abcd-4202-bffb-9e9e77adf34f None admin] RBAC: Authorizing `identity:create_grant(project_id=1c95aafd70e547d29c7647e6027faf2f, user_id=51fe6dfa43d04cdeb0421d2613c8c2ca, role_id=85dac7b70cf04091baaf69caabd27a8b)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:06.522666 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70aa10-abcd-4202-bffb-9e9e77adf34f None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:06.538098 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 298/598] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:32:06 2022] PUT /identity/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/51fe6dfa43d04cdeb0421d2613c8c2ca/roles/85dac7b70cf04091baaf69caabd27a8b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:32:06.539571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70aa10-abcd-4202-bffb-9e9e77adf34f None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:06.562251 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:06.633286 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a9abc-0898-40cb-bb4f-24237a12c6df None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:06.664133 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70aa10-abcd-4202-bffb-9e9e77adf34f None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:06.671955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e72ca9-3728-43af-a196-85268d46334f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:06.672586 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e72ca9-3728-43af-a196-85268d46334f None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:06.672863 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e72ca9-3728-43af-a196-85268d46334f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:06.673132 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e72ca9-3728-43af-a196-85268d46334f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:06.675909 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:06.686695 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e72ca9-3728-43af-a196-85268d46334f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:06.688648 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e72ca9-3728-43af-a196-85268d46334f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:06.706306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-a3e72ca9-3728-43af-a196-85268d46334f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:06.706306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:06.706306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:06.706306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:06.706306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:06.706306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:06.706306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:06.706306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:06.706306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:06.706306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:06.706306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:06.706306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:06.706306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:06.706306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:06.706306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:06.706306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:06.707301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:06.707301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:06.707301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:06.707301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:06.707301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:06.707301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:06.707301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:06.707301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:06.707301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:06.707301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:06.707301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:06.707301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:06.707301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:06.707301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:06.707301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:06.707301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:06.707301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:06.708165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:06.708165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:06.708165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:06.708165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 301/599] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:06.710685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e22d4-36d3-42ed-af8c-c3356219f4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:06.711574 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e22d4-36d3-42ed-af8c-c3356219f4d5 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:06.712325 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e22d4-36d3-42ed-af8c-c3356219f4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:06.712866 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e22d4-36d3-42ed-af8c-c3356219f4d5 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:06.713161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e72ca9-3728-43af-a196-85268d46334f None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:06.714060 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e22d4-36d3-42ed-af8c-c3356219f4d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:06.714560 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e22d4-36d3-42ed-af8c-c3356219f4d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:06.716286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e22d4-36d3-42ed-af8c-c3356219f4d5 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:06.731372 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 299/600] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:06.743375 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e22d4-36d3-42ed-af8c-c3356219f4d5 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:06.839917 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:06.852776 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e72ca9-3728-43af-a196-85268d46334f None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:06.866600 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e22d4-36d3-42ed-af8c-c3356219f4d5 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:06.892743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ad62a-bfda-443c-a47c-17dcc1519c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:06.893878 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ad62a-bfda-443c-a47c-17dcc1519c0f None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:06.894440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ad62a-bfda-443c-a47c-17dcc1519c0f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:06.894915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ad62a-bfda-443c-a47c-17dcc1519c0f None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:06.895882 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ad62a-bfda-443c-a47c-17dcc1519c0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:06.896485 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ad62a-bfda-443c-a47c-17dcc1519c0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:06.898069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ad62a-bfda-443c-a47c-17dcc1519c0f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:06.904504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11801a-3547-4e68-b2b3-d5b3f3668fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:06.905137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11801a-3547-4e68-b2b3-d5b3f3668fcc None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:06.905412 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11801a-3547-4e68-b2b3-d5b3f3668fcc None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:06.905711 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11801a-3547-4e68-b2b3-d5b3f3668fcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:06.913056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11801a-3547-4e68-b2b3-d5b3f3668fcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:06.913371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 302/601] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:06.915451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11801a-3547-4e68-b2b3-d5b3f3668fcc None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:06.919448 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ad62a-bfda-443c-a47c-17dcc1519c0f None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:06.928253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-dc11801a-3547-4e68-b2b3-d5b3f3668fcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:06.928253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:06.928253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:06.928253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:06.928253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:06.928253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:06.928253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:06.928253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:06.928253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:06.928253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:06.928253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:06.928253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:06.928253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:06.928253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:06.928253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:06.929151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:06.929151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:06.929151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:06.929151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:06.929151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:06.929151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:06.929151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:06.929151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:06.929151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:06.929151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:06.929151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:06.929151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:06.929151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:06.929151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:06.929151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:06.929151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:06.929151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:06.930064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:06.930064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:06.930064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:06.930064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:06.930064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:06.930064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:06.930064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:06.930064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:06.930064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 300/602] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:32:06.935335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11801a-3547-4e68-b2b3-d5b3f3668fcc None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:06.976428 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:07.037416 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ad62a-bfda-443c-a47c-17dcc1519c0f None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:07.049021 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11801a-3547-4e68-b2b3-d5b3f3668fcc None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:07.074811 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f6ed2-7078-4415-a1e9-f802446e7878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:07.075434 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f6ed2-7078-4415-a1e9-f802446e7878 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:07.075713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f6ed2-7078-4415-a1e9-f802446e7878 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:07.075986 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f6ed2-7078-4415-a1e9-f802446e7878 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:07.083745 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f6ed2-7078-4415-a1e9-f802446e7878 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:07.085212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f6ed2-7078-4415-a1e9-f802446e7878 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:07.088250 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b5150-8b53-4a1f-971b-ed554be49fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:07.089087 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b5150-8b53-4a1f-971b-ed554be49fc1 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:07.089589 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b5150-8b53-4a1f-971b-ed554be49fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:07.090060 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b5150-8b53-4a1f-971b-ed554be49fc1 None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:07.090954 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b5150-8b53-4a1f-971b-ed554be49fc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:07.091490 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b5150-8b53-4a1f-971b-ed554be49fc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:07.093096 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b5150-8b53-4a1f-971b-ed554be49fc1 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:07.096914 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:07.098346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-1f9f6ed2-7078-4415-a1e9-f802446e7878 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:07.098346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:07.098346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:07.098346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:07.098346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:07.098346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:07.098346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:07.098346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:07.098346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:07.098346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:07.098346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:07.098346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:07.098346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:07.098346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:07.098346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:07.099186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:07.099186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:07.099186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:07.099186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:07.099186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:07.099186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:07.099186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:07.099186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:07.099186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:07.099186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:07.099186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:07.099186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:07.099186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:07.099186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:07.099186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:07.099186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:07.099186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:07.100028 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:07.100028 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:07.100028 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:07.100028 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:07.100028 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:07.100028 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:07.100028 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:07.100028 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:07.102596 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 303/603] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:07.108583 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f6ed2-7078-4415-a1e9-f802446e7878 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:07.109031 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 301/604] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:07.116073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b5150-8b53-4a1f-971b-ed554be49fc1 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:07.219789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f6ed2-7078-4415-a1e9-f802446e7878 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:07.230028 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b5150-8b53-4a1f-971b-ed554be49fc1 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:07.233769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:07.269661 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a84797-7e05-4b20-a2ea-c876b88fe202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:07.270519 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a84797-7e05-4b20-a2ea-c876b88fe202 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:07.270897 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a84797-7e05-4b20-a2ea-c876b88fe202 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:07.271265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a84797-7e05-4b20-a2ea-c876b88fe202 None admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:07.272068 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a84797-7e05-4b20-a2ea-c876b88fe202 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:07.272545 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a84797-7e05-4b20-a2ea-c876b88fe202 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:07.273137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce8c1c-4ce5-4049-8c39-611aee7fa7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:07.273988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce8c1c-4ce5-4049-8c39-611aee7fa7f9 None admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:07.274289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a84797-7e05-4b20-a2ea-c876b88fe202 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:07.274597 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce8c1c-4ce5-4049-8c39-611aee7fa7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:07.275034 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce8c1c-4ce5-4049-8c39-611aee7fa7f9 None admin] PATH_INFO: `/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/782bdef852d34b9ba3a957962f93994f/roles/85dac7b70cf04091baaf69caabd27a8b` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:07.293003 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 304/605] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:07.294476 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce8c1c-4ce5-4049-8c39-611aee7fa7f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c95aafd70e547d29c7647e6027faf2f, user_id=782bdef852d34b9ba3a957962f93994f, role_id=85dac7b70cf04091baaf69caabd27a8b)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:07.294654 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52149c05-2d86-4164-b444-aa29fcf7e4fa None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:07.295038 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52149c05-2d86-4164-b444-aa29fcf7e4fa None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:07.295408 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52149c05-2d86-4164-b444-aa29fcf7e4fa None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:07.296738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce8c1c-4ce5-4049-8c39-611aee7fa7f9 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:07.297203 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 305/606] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:07.298007 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52149c05-2d86-4164-b444-aa29fcf7e4fa None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:07.314482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 302/607] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:32:07 2022] PUT /identity/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/782bdef852d34b9ba3a957962f93994f/roles/85dac7b70cf04091baaf69caabd27a8b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:32:07.323445 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8440ee-b44e-4d3f-a99f-34559ebe9af2 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:07.324068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8440ee-b44e-4d3f-a99f-34559ebe9af2 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:07.324521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8440ee-b44e-4d3f-a99f-34559ebe9af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:07.356828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-7c8440ee-b44e-4d3f-a99f-34559ebe9af2 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:07.359144 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7c8440ee-b44e-4d3f-a99f-34559ebe9af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:07.411246 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:07.440627 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52149c05-2d86-4164-b444-aa29fcf7e4fa None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:07.441324 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 303/608] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:32:07.443709 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dfd40-79db-4ee1-b74c-2ec471514ec1 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:07.444091 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dfd40-79db-4ee1-b74c-2ec471514ec1 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:07.444432 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dfd40-79db-4ee1-b74c-2ec471514ec1 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:07.446381 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 304/609] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:07.460155 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe3fcf-a19f-4e3b-8dfb-0c9dbf43e0f7 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:07.460623 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe3fcf-a19f-4e3b-8dfb-0c9dbf43e0f7 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:07.461135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe3fcf-a19f-4e3b-8dfb-0c9dbf43e0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:07.487885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9633077-19eb-4f12-8c8e-c28a512aa5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:07.488971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9633077-19eb-4f12-8c8e-c28a512aa5cf None admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:07.489451 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9633077-19eb-4f12-8c8e-c28a512aa5cf None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:07.489993 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9633077-19eb-4f12-8c8e-c28a512aa5cf None admin] PATH_INFO: `/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/7847dbf8f31146c5ab2136fbdb487783/roles/85dac7b70cf04091baaf69caabd27a8b` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:07.506494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9633077-19eb-4f12-8c8e-c28a512aa5cf None admin] RBAC: Authorizing `identity:create_grant(project_id=1c95aafd70e547d29c7647e6027faf2f, user_id=7847dbf8f31146c5ab2136fbdb487783, role_id=85dac7b70cf04091baaf69caabd27a8b)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:07.508380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9633077-19eb-4f12-8c8e-c28a512aa5cf None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:07.510393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-4bbe3fcf-a19f-4e3b-8dfb-0c9dbf43e0f7 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:07.511686 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-4bbe3fcf-a19f-4e3b-8dfb-0c9dbf43e0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:07.547198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 306/610] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:32:07 2022] PUT /identity/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/7847dbf8f31146c5ab2136fbdb487783/roles/85dac7b70cf04091baaf69caabd27a8b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:32:07.605242 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 305/611] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:32:07.758117 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9633077-19eb-4f12-8c8e-c28a512aa5cf None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:07.777774 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:07.870207 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9633077-19eb-4f12-8c8e-c28a512aa5cf None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:07.914961 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee71114-5da4-48b1-87d7-9f157c99679b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:07.915598 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee71114-5da4-48b1-87d7-9f157c99679b None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:07.915880 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee71114-5da4-48b1-87d7-9f157c99679b None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:07.916156 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee71114-5da4-48b1-87d7-9f157c99679b None admin] PATH_INFO: `/v3/roles/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:07.932323 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee71114-5da4-48b1-87d7-9f157c99679b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:32:07.940024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-fee71114-5da4-48b1-87d7-9f157c99679b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:07.940024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:07.940024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:07.940024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:07.940024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:07.940024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:07.940024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:07.940024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:07.940024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:07.940024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:07.940024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:07.940024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:07.940024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:32:07.940024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:32:07.940024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:32:07.940024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:32:07.940984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:32:07.940984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:32:07.940984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:32:07.940984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:32:07.940984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:07.940984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:07.940984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:07.940984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:07.940984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:07.940984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:07.940984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:07.940984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:07.940984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:07.940984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:07.940984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:07.940984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:07.941861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:07.941861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:07.941861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:07.941861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:07.941861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:32:07.941861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:32:07.941861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:32:07.941861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:32:07.941861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:32:07.941861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:32:07.941861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:07.941861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:07.942500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe3fcf-a19f-4e3b-8dfb-0c9dbf43e0f7 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:07.942581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 307/612] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:32:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:07.945882 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee71114-5da4-48b1-87d7-9f157c99679b None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:08.039668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:08.086219 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee71114-5da4-48b1-87d7-9f157c99679b None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:08.136120 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe3fcf-a19f-4e3b-8dfb-0c9dbf43e0f7 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:08.144464 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:08.175529 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccab8c4-6fdf-4489-ae46-9a8e67900b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:08.176431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccab8c4-6fdf-4489-ae46-9a8e67900b33 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:08.176900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccab8c4-6fdf-4489-ae46-9a8e67900b33 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:08.177321 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccab8c4-6fdf-4489-ae46-9a8e67900b33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:08.178825 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cef87-ff71-4f59-824f-b9be860c89f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:08.179633 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cef87-ff71-4f59-824f-b9be860c89f4 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:08.180006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cef87-ff71-4f59-824f-b9be860c89f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:08.180372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cef87-ff71-4f59-824f-b9be860c89f4 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:08.181135 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cef87-ff71-4f59-824f-b9be860c89f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:08.181575 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cef87-ff71-4f59-824f-b9be860c89f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:08.183040 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cef87-ff71-4f59-824f-b9be860c89f4 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:08.198728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccab8c4-6fdf-4489-ae46-9a8e67900b33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:32:08.202647 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 308/613] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 09:32:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:08.203965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-eccab8c4-6fdf-4489-ae46-9a8e67900b33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:08.203965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:08.203965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:08.203965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:08.203965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:08.203965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:08.203965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:08.203965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:08.203965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:08.203965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:08.203965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:08.203965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:08.203965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:32:08.203965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:32:08.203965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:32:08.203965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:32:08.204921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:32:08.204921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:32:08.204921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:32:08.204921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:32:08.204921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:08.204921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:08.204921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:08.204921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:08.204921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:08.204921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:08.204921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:08.204921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:08.204921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:08.204921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:08.204921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:08.204921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:08.206060 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:08.206060 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:08.206060 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:08.206060 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:08.206060 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:32:08.206060 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:32:08.206060 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:32:08.206060 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:32:08.206060 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:32:08.206060 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:32:08.206060 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:08.206060 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:08.208169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cef87-ff71-4f59-824f-b9be860c89f4 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:08.208563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 306/614] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:32:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:08.214540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccab8c4-6fdf-4489-ae46-9a8e67900b33 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:08.327571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccab8c4-6fdf-4489-ae46-9a8e67900b33 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:08.365907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41244d8-060f-4e58-b2cc-d2e7e7af6fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:08.366853 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41244d8-060f-4e58-b2cc-d2e7e7af6fd7 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:08.367339 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41244d8-060f-4e58-b2cc-d2e7e7af6fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:08.367816 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41244d8-060f-4e58-b2cc-d2e7e7af6fd7 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:08.368774 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41244d8-060f-4e58-b2cc-d2e7e7af6fd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:08.369296 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41244d8-060f-4e58-b2cc-d2e7e7af6fd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:08.370951 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41244d8-060f-4e58-b2cc-d2e7e7af6fd7 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:08.380882 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 307/615] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 09:32:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:08.391609 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41244d8-060f-4e58-b2cc-d2e7e7af6fd7 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:08.422110 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:08.447606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cef87-ff71-4f59-824f-b9be860c89f4 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:08.505020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41244d8-060f-4e58-b2cc-d2e7e7af6fd7 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:08.541047 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccf368-799e-4437-9010-ffeb0113b30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:08.541717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccf368-799e-4437-9010-ffeb0113b30b None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:08.541998 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccf368-799e-4437-9010-ffeb0113b30b None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:08.542269 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccf368-799e-4437-9010-ffeb0113b30b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:08.546301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68437817-7117-42fc-9134-1970d20c44db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:08.547701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68437817-7117-42fc-9134-1970d20c44db None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:08.548914 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68437817-7117-42fc-9134-1970d20c44db None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:08.550249 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68437817-7117-42fc-9134-1970d20c44db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:08.569244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccf368-799e-4437-9010-ffeb0113b30b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:08.571985 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68437817-7117-42fc-9134-1970d20c44db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:08.573313 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccf368-799e-4437-9010-ffeb0113b30b None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:08.574955 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68437817-7117-42fc-9134-1970d20c44db None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:08.585678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:08.602397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-81ccf368-799e-4437-9010-ffeb0113b30b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:08.602397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:08.602397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:08.602397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:08.602397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:08.602397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:08.602397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:08.602397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:08.602397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:08.602397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:08.602397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:08.602397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:08.602397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:08.602397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:08.602397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:08.602397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:08.603331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:08.603331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:08.603331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:08.603331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:08.603331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:08.603331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:08.603331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:08.603331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:08.603331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:08.603331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:08.603331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:08.603331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:08.603331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:08.603331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:08.603331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:08.603331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:08.603331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:08.604200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:08.604200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:08.604200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:08.604200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 309/616] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:08.606344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-68437817-7117-42fc-9134-1970d20c44db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:08.606344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:08.606344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:08.606344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:08.606344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:08.606344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:08.606344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:08.606344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:08.606344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:08.606344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:08.606344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:08.606344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:08.606344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:08.606344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:08.606344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:08.606344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:08.607241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:08.607241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:08.607241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:08.607241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:08.607241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:08.607241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:08.607241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:08.607241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:08.607241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:08.607241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:08.607241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:08.607241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:08.607241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:08.607241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:08.607241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:08.607241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:08.607241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:08.608382 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:08.608382 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:08.608382 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:08.608382 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 308/617] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:32:08.613735 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccf368-799e-4437-9010-ffeb0113b30b None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:08.614857 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68437817-7117-42fc-9134-1970d20c44db None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:08.773859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:08.798196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccf368-799e-4437-9010-ffeb0113b30b None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:08.814068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68437817-7117-42fc-9134-1970d20c44db None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:08.845399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006e256-0160-4d1d-892e-a23110df3c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:08.846805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006e256-0160-4d1d-892e-a23110df3c94 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:08.847291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006e256-0160-4d1d-892e-a23110df3c94 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:08.847790 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006e256-0160-4d1d-892e-a23110df3c94 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:08.848630 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006e256-0160-4d1d-892e-a23110df3c94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:08.849131 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006e256-0160-4d1d-892e-a23110df3c94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:08.850920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006e256-0160-4d1d-892e-a23110df3c94 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:08.864867 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 310/618] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:08.870327 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006e256-0160-4d1d-892e-a23110df3c94 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:08.923548 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6cfa3-6d45-4e7e-87e4-eacac63080fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:08.924186 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6cfa3-6d45-4e7e-87e4-eacac63080fd None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:08.925016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6cfa3-6d45-4e7e-87e4-eacac63080fd None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:08.925327 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6cfa3-6d45-4e7e-87e4-eacac63080fd None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:08.926149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6cfa3-6d45-4e7e-87e4-eacac63080fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:08.926459 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6cfa3-6d45-4e7e-87e4-eacac63080fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:08.927837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6cfa3-6d45-4e7e-87e4-eacac63080fd None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:08.937835 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:08.963684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 309/619] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:08.974700 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6cfa3-6d45-4e7e-87e4-eacac63080fd None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:08.994797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006e256-0160-4d1d-892e-a23110df3c94 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:09.032086 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc2b1c-de94-43ee-a4fa-611efd588640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:09.033324 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc2b1c-de94-43ee-a4fa-611efd588640 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:09.033913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc2b1c-de94-43ee-a4fa-611efd588640 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:09.034500 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc2b1c-de94-43ee-a4fa-611efd588640 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:09.046791 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc2b1c-de94-43ee-a4fa-611efd588640 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:09.048241 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc2b1c-de94-43ee-a4fa-611efd588640 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:09.061476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-a0fc2b1c-de94-43ee-a4fa-611efd588640 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:32:09.061476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:09.061476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:09.061476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:09.061476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:09.061476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:09.061476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:09.061476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:09.061476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:09.061476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:09.061476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:09.061476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:09.061476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:09.061476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:09.061476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:09.061476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:09.062569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:09.062569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:09.062569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:09.062569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:09.062569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:09.062569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:09.062569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:09.062569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:09.062569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:09.062569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:09.062569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:09.062569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:09.062569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:09.062569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:09.062569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:09.062569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:09.062569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:09.062569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:09.063502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:09.063502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:09.063502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:09.063502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:09.063502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:09.063502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:09.063502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:09.063502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:09.063502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:32:09.063502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:09.065602 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 311/620] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:32:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:32:09.070923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc2b1c-de94-43ee-a4fa-611efd588640 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:09.214530 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6cfa3-6d45-4e7e-87e4-eacac63080fd None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:09.237700 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc2b1c-de94-43ee-a4fa-611efd588640 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:09.250040 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:09.269028 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff7d86-c379-43b4-bd66-457113cc68c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:09.270232 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff7d86-c379-43b4-bd66-457113cc68c4 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:09.271009 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff7d86-c379-43b4-bd66-457113cc68c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:09.271786 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff7d86-c379-43b4-bd66-457113cc68c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:09.283551 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff7d86-c379-43b4-bd66-457113cc68c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:09.286448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff7d86-c379-43b4-bd66-457113cc68c4 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:09.286730 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315f37e-4c7e-479f-934c-1cc06ea2a178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:09.287425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315f37e-4c7e-479f-934c-1cc06ea2a178 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:09.287717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315f37e-4c7e-479f-934c-1cc06ea2a178 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:09.288008 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315f37e-4c7e-479f-934c-1cc06ea2a178 None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:09.288782 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315f37e-4c7e-479f-934c-1cc06ea2a178 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:09.289103 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315f37e-4c7e-479f-934c-1cc06ea2a178 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:09.290638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315f37e-4c7e-479f-934c-1cc06ea2a178 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:09.291114 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:09.302487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-bfff7d86-c379-43b4-bd66-457113cc68c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:32:09.302487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:09.302487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:09.302487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:09.302487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:09.302487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:09.302487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:09.302487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:09.302487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:09.302487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:09.302487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:09.302487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:09.302487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:09.302487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:09.302487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:09.302487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:09.303469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:09.303469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:09.303469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:09.303469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:09.303469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:09.303469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:09.303469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:09.303469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:09.303469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:09.303469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:09.303469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:09.303469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:09.303469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:09.303469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:09.303469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:09.303469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:09.303469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:09.303469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:09.304386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:09.304386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:09.304386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:09.304386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:09.304386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:09.304386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:09.304386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:09.304386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:09.304386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:32:09.304386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:09.311330 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 310/621] 10.222.0.58 () {56 vars in 1093 bytes} [Wed Aug 24 09:32:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:09.312396 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 312/622] 10.222.0.58 () {56 vars in 1135 bytes} [Wed Aug 24 09:32:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:09.313201 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c623f3-c1bb-44ce-8ef2-5df7fb996da7 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:09.313312 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315f37e-4c7e-479f-934c-1cc06ea2a178 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:09.313918 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c623f3-c1bb-44ce-8ef2-5df7fb996da7 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:09.314423 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c623f3-c1bb-44ce-8ef2-5df7fb996da7 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:09.317096 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 311/623] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:09.318183 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c623f3-c1bb-44ce-8ef2-5df7fb996da7 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:09.425142 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315f37e-4c7e-479f-934c-1cc06ea2a178 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:09.430195 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c623f3-c1bb-44ce-8ef2-5df7fb996da7 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:09.463527 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ca336-74e4-4259-9fd3-b652531735ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:09.464201 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ca336-74e4-4259-9fd3-b652531735ae None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:09.464408 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ca336-74e4-4259-9fd3-b652531735ae None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:09.464681 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ca336-74e4-4259-9fd3-b652531735ae None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:09.465618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ca336-74e4-4259-9fd3-b652531735ae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:09.465894 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ca336-74e4-4259-9fd3-b652531735ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:09.467263 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ca336-74e4-4259-9fd3-b652531735ae None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:09.473284 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3af95-a21a-469b-9dd4-ebe904a86b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:09.475012 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3af95-a21a-469b-9dd4-ebe904a86b58 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:09.475594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3af95-a21a-469b-9dd4-ebe904a86b58 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:09.476128 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3af95-a21a-469b-9dd4-ebe904a86b58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:09.488519 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3af95-a21a-469b-9dd4-ebe904a86b58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:09.490311 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3af95-a21a-469b-9dd4-ebe904a86b58 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:09.496617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 313/624] 10.222.0.58 () {56 vars in 1133 bytes} [Wed Aug 24 09:32:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:09.496617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aabd8-2dde-4656-95b8-e18abfc1b455 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:09.496617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aabd8-2dde-4656-95b8-e18abfc1b455 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:09.496617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aabd8-2dde-4656-95b8-e18abfc1b455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:09.512486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-3ce3af95-a21a-469b-9dd4-ebe904a86b58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:09.512486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:09.512486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:09.512486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:09.512486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:09.512486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:09.512486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:09.512486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:09.512486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:09.512486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:09.512486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:09.512486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:09.512486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:09.512486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:09.512486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:09.512486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:09.513594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:09.513594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:09.513594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:09.513594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:09.513594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:09.513594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:09.513594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:09.513594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:09.513594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:09.513594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:09.513594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:09.513594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:09.513594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:09.513594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:09.513594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:09.513594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:09.513594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:09.514496 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:09.514496 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:09.514496 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:09.515312 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-e85aabd8-2dde-4656-95b8-e18abfc1b455 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:09.516693 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-e85aabd8-2dde-4656-95b8-e18abfc1b455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:09.517121 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 312/625] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:09.518722 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3af95-a21a-469b-9dd4-ebe904a86b58 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:09.540268 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:09.576811 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:09.595397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 314/626] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:32:09.596833 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85aabd8-2dde-4656-95b8-e18abfc1b455 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:09.633339 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3af95-a21a-469b-9dd4-ebe904a86b58 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:09.718206 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6119ae4-dace-4f30-b3fb-698f92bc969f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:09.718832 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6119ae4-dace-4f30-b3fb-698f92bc969f None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:09.719125 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6119ae4-dace-4f30-b3fb-698f92bc969f None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:09.721526 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6119ae4-dace-4f30-b3fb-698f92bc969f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:09.725453 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85aabd8-2dde-4656-95b8-e18abfc1b455 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:09.766908 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86221c-559a-4396-b7a9-a945b27086ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:09.767589 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86221c-559a-4396-b7a9-a945b27086ce None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:09.767884 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86221c-559a-4396-b7a9-a945b27086ce None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:09.768213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86221c-559a-4396-b7a9-a945b27086ce None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:09.768860 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86221c-559a-4396-b7a9-a945b27086ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:09.769156 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86221c-559a-4396-b7a9-a945b27086ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:09.770825 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86221c-559a-4396-b7a9-a945b27086ce None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:09.787316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 315/627] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:09.788689 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8a4f0-ca5f-4f33-96c3-45d20381f6d3 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:09.788979 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8a4f0-ca5f-4f33-96c3-45d20381f6d3 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:09.789256 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8a4f0-ca5f-4f33-96c3-45d20381f6d3 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:09.793660 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 316/628] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:09.794749 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a272c4e-dbb2-4423-b772-757acd4464ce None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:09.795037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a272c4e-dbb2-4423-b772-757acd4464ce None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:09.795437 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a272c4e-dbb2-4423-b772-757acd4464ce None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:09.796668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 317/629] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:09.797360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a272c4e-dbb2-4423-b772-757acd4464ce None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:09.819490 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:09.847339 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6119ae4-dace-4f30-b3fb-698f92bc969f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:09.848819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6119ae4-dace-4f30-b3fb-698f92bc969f None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:09.929714 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:09.940625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a272c4e-dbb2-4423-b772-757acd4464ce None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:09.977398 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f830c7-4379-4162-a325-b6053d7df538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:09.978059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f830c7-4379-4162-a325-b6053d7df538 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:09.978340 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f830c7-4379-4162-a325-b6053d7df538 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:09.978620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f830c7-4379-4162-a325-b6053d7df538 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:09.981996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 313/630] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:32:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:09.983767 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be91d00-84f2-4e91-bc0f-32560b49f52a None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:09.984051 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be91d00-84f2-4e91-bc0f-32560b49f52a None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:09.984319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be91d00-84f2-4e91-bc0f-32560b49f52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:09.985830 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f830c7-4379-4162-a325-b6053d7df538 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:09.988031 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f830c7-4379-4162-a325-b6053d7df538 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:09.999411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-e9f830c7-4379-4162-a325-b6053d7df538 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:09.999411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:09.999411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:09.999411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:09.999411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:09.999411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:09.999411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:09.999411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:09.999411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:09.999411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:09.999411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:09.999411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:09.999411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:09.999411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:09.999411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:10.000509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:10.000509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:10.000509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:10.000509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:10.000509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:10.000509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:10.000509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:10.000509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:10.000509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:10.000509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:10.000509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:10.000509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:10.000509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:10.000509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:10.000509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:10.000509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:10.000509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:10.001606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:10.001606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:10.001606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:10.001606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:10.001606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:10.001606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:10.001606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:10.001606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:10.001606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 318/631] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:10.002209 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266413d3-2bbd-4057-941c-4c542cbe2a67 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:10.002209 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266413d3-2bbd-4057-941c-4c542cbe2a67 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:10.002549 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266413d3-2bbd-4057-941c-4c542cbe2a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:10.009921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-9be91d00-84f2-4e91-bc0f-32560b49f52a None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:10.011083 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-9be91d00-84f2-4e91-bc0f-32560b49f52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:10.020754 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-266413d3-2bbd-4057-941c-4c542cbe2a67 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:10.021990 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-266413d3-2bbd-4057-941c-4c542cbe2a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:10.089619 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 314/632] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:32:10.089619 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be91d00-84f2-4e91-bc0f-32560b49f52a None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:10.095601 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 319/633] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:32:10.098631 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266413d3-2bbd-4057-941c-4c542cbe2a67 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:10.120660 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:10.207520 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:10.231704 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be91d00-84f2-4e91-bc0f-32560b49f52a None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:10.278899 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e98f1-cce3-4588-a692-ad9e6a4fe1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:10.279537 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e98f1-cce3-4588-a692-ad9e6a4fe1f4 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:10.279819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e98f1-cce3-4588-a692-ad9e6a4fe1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:10.280097 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e98f1-cce3-4588-a692-ad9e6a4fe1f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:10.291395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266413d3-2bbd-4057-941c-4c542cbe2a67 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:10.292768 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e98f1-cce3-4588-a692-ad9e6a4fe1f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:32:10.300844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-ce2e98f1-cce3-4588-a692-ad9e6a4fe1f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:10.300844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:10.300844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:10.300844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:10.300844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:10.300844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:10.300844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:10.300844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:10.300844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:10.300844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:10.300844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:10.300844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:10.300844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:32:10.300844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:32:10.300844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:32:10.300844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:32:10.301828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:32:10.301828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:32:10.301828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:32:10.301828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:32:10.301828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:10.301828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:10.301828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:10.301828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:10.301828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:10.301828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:10.301828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:10.301828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:10.301828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:10.301828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:10.301828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:10.301828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:10.302667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:10.302667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:10.302667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:10.302667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:10.302667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:32:10.302667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:32:10.302667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:32:10.302667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:32:10.302667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:32:10.302667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:32:10.302667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:10.302667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:10.302667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 315/634] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:32:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:10.303401 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e98f1-cce3-4588-a692-ad9e6a4fe1f4 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:10.359883 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a958a7-e32f-45b9-ad1c-bdc34a74fca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:10.360888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a958a7-e32f-45b9-ad1c-bdc34a74fca3 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:10.361392 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a958a7-e32f-45b9-ad1c-bdc34a74fca3 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:10.361942 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a958a7-e32f-45b9-ad1c-bdc34a74fca3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:10.380622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a958a7-e32f-45b9-ad1c-bdc34a74fca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:10.382123 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a958a7-e32f-45b9-ad1c-bdc34a74fca3 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:10.397112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-d7a958a7-e32f-45b9-ad1c-bdc34a74fca3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:10.397112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:10.397112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:10.397112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:10.397112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:10.397112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:10.397112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:10.397112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:10.397112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:10.397112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:10.397112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:10.397112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:10.397112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:10.397112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:10.397112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:10.397112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:10.398387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:10.398387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:10.398387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:10.398387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:10.398387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:10.398387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:10.398387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:10.398387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:10.398387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:10.398387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:10.398387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:10.398387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:10.398387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:10.398387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:10.398387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:10.398387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:10.398387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:10.399469 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:10.399469 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:10.399469 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:10.401627 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 320/635] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:10.402501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a958a7-e32f-45b9-ad1c-bdc34a74fca3 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:10.432566 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e98f1-cce3-4588-a692-ad9e6a4fe1f4 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:10.473572 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a4999-683b-4297-ad5d-3c10a0df0c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:10.473777 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:10.474662 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a4999-683b-4297-ad5d-3c10a0df0c09 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:10.474838 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a4999-683b-4297-ad5d-3c10a0df0c09 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:10.475503 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a4999-683b-4297-ad5d-3c10a0df0c09 None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:10.476334 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a4999-683b-4297-ad5d-3c10a0df0c09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:10.476602 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a4999-683b-4297-ad5d-3c10a0df0c09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:10.478290 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a4999-683b-4297-ad5d-3c10a0df0c09 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:10.495670 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 316/636] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:10.496515 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a4999-683b-4297-ad5d-3c10a0df0c09 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:10.500067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:10.524142 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a958a7-e32f-45b9-ad1c-bdc34a74fca3 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:10.562424 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f39529-858c-41fb-9bc1-e6d68649ea6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:10.563122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f39529-858c-41fb-9bc1-e6d68649ea6b None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:10.563476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f39529-858c-41fb-9bc1-e6d68649ea6b None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:10.563823 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f39529-858c-41fb-9bc1-e6d68649ea6b None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:10.564565 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f39529-858c-41fb-9bc1-e6d68649ea6b None admin] RBAC: Adding query filter params (name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:10.564914 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f39529-858c-41fb-9bc1-e6d68649ea6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:10.566761 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f39529-858c-41fb-9bc1-e6d68649ea6b None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:10.579708 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 321/637] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 09:32:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:10.579708 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f39529-858c-41fb-9bc1-e6d68649ea6b None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:10.614472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a4999-683b-4297-ad5d-3c10a0df0c09 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:10.651998 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff605a6-46d0-4d06-b5b5-321836a84af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:10.652664 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff605a6-46d0-4d06-b5b5-321836a84af7 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:10.652945 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff605a6-46d0-4d06-b5b5-321836a84af7 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:10.653347 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff605a6-46d0-4d06-b5b5-321836a84af7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:10.671311 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff605a6-46d0-4d06-b5b5-321836a84af7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:32:10.680718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-0ff605a6-46d0-4d06-b5b5-321836a84af7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:10.680718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:10.680718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:10.680718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:10.680718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:10.680718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:10.680718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:10.680718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:10.680718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:10.680718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:10.680718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:10.680718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:10.680718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:32:10.680718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:32:10.680718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:32:10.680718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:32:10.681996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:32:10.681996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:32:10.681996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:32:10.681996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:32:10.681996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:10.681996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:10.681996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:10.681996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:10.681996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:10.681996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:10.681996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:10.681996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:10.681996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:10.681996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:10.681996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:10.681996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:10.683342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:10.683342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:10.683342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:10.683342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:10.683342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:32:10.683342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:32:10.683342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:32:10.683342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:32:10.683342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:32:10.683342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:32:10.683342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:10.683342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:10.686974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 317/638] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:32:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:10.687852 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff605a6-46d0-4d06-b5b5-321836a84af7 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:10.691322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f39529-858c-41fb-9bc1-e6d68649ea6b None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:10.715269 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:10.743303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155146f-173f-4f72-921f-e7c60c2cd9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:10.743931 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155146f-173f-4f72-921f-e7c60c2cd9c1 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:10.744206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155146f-173f-4f72-921f-e7c60c2cd9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:10.744477 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155146f-173f-4f72-921f-e7c60c2cd9c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:10.759065 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155146f-173f-4f72-921f-e7c60c2cd9c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:32:10.764378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-f155146f-173f-4f72-921f-e7c60c2cd9c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:10.764378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:10.764378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:10.764378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:10.764378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:10.764378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:10.764378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:10.764378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:10.764378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:10.764378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:10.764378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:10.764378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:10.764378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:32:10.764378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:32:10.764378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:32:10.764378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:32:10.765369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:32:10.765369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:32:10.765369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:32:10.765369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:32:10.765369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:10.765369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:10.765369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:10.765369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:10.765369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:10.765369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:10.765369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:10.765369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:10.765369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:10.765369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:10.765369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:10.765369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:10.766291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:10.766291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:10.766291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:10.766291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:10.766291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:32:10.766291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:32:10.766291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:32:10.766291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:32:10.766291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:32:10.766291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:32:10.766291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:10.766291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:10.771333 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 322/639] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:32:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:10.772255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155146f-173f-4f72-921f-e7c60c2cd9c1 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:10.787032 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:10.842125 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff605a6-46d0-4d06-b5b5-321836a84af7 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:10.878835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3963d50-669d-495d-b309-1c2ca18e4dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:10.879356 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3963d50-669d-495d-b309-1c2ca18e4dbb None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:10.879632 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3963d50-669d-495d-b309-1c2ca18e4dbb None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:10.879900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3963d50-669d-495d-b309-1c2ca18e4dbb None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:10.880545 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3963d50-669d-495d-b309-1c2ca18e4dbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:10.880842 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3963d50-669d-495d-b309-1c2ca18e4dbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:10.882247 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3963d50-669d-495d-b309-1c2ca18e4dbb None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:10.894783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 318/640] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:10.895603 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3963d50-669d-495d-b309-1c2ca18e4dbb None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:10.903369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155146f-173f-4f72-921f-e7c60c2cd9c1 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:10.938572 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e835e0c-a004-4bc1-b827-a7b1ba5a5ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:10.939386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e835e0c-a004-4bc1-b827-a7b1ba5a5ed0 None admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:10.939513 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e835e0c-a004-4bc1-b827-a7b1ba5a5ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:10.939788 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e835e0c-a004-4bc1-b827-a7b1ba5a5ed0 None admin] PATH_INFO: `/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/ff2db35b94c84ec7bba96117d23baf6b/roles/85dac7b70cf04091baaf69caabd27a8b` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:10.956490 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e835e0c-a004-4bc1-b827-a7b1ba5a5ed0 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c95aafd70e547d29c7647e6027faf2f, user_id=ff2db35b94c84ec7bba96117d23baf6b, role_id=85dac7b70cf04091baaf69caabd27a8b)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:10.958029 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e835e0c-a004-4bc1-b827-a7b1ba5a5ed0 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:10.971913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 323/641] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:32:10 2022] PUT /identity/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/ff2db35b94c84ec7bba96117d23baf6b/roles/85dac7b70cf04091baaf69caabd27a8b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:32:10.973182 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e835e0c-a004-4bc1-b827-a7b1ba5a5ed0 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:11.019353 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3963d50-669d-495d-b309-1c2ca18e4dbb None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:11.024236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:11.056754 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:11.078042 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d37c3-70f0-4687-8214-c09121b05d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:11.078977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d37c3-70f0-4687-8214-c09121b05d23 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:11.079255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d37c3-70f0-4687-8214-c09121b05d23 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:11.079526 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d37c3-70f0-4687-8214-c09121b05d23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:11.091252 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d37c3-70f0-4687-8214-c09121b05d23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:11.092747 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d37c3-70f0-4687-8214-c09121b05d23 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:11.109966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-163d37c3-70f0-4687-8214-c09121b05d23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:11.109966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:11.109966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:11.109966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:11.109966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:11.109966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:11.109966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:11.109966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:11.109966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:11.109966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:11.109966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:11.109966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:11.109966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:11.109966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:11.109966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:11.109966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:11.111014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:11.111014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:11.111014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:11.111014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:11.111014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:11.111014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:11.111014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:11.111014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:11.111014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:11.111014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:11.111014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:11.111014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:11.111014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:11.111014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:11.111014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:11.111014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:11.111014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:11.111976 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:11.111976 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:11.111976 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:11.111976 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 319/642] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:11.112296 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d37c3-70f0-4687-8214-c09121b05d23 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:11.128352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e835e0c-a004-4bc1-b827-a7b1ba5a5ed0 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:11.169693 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc296c-17e1-4684-a407-4e1f788a97db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:11.170730 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc296c-17e1-4684-a407-4e1f788a97db None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:11.171230 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc296c-17e1-4684-a407-4e1f788a97db None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:11.171612 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc296c-17e1-4684-a407-4e1f788a97db None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:11.172376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc296c-17e1-4684-a407-4e1f788a97db None admin] RBAC: Adding query filter params (name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:11.172774 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc296c-17e1-4684-a407-4e1f788a97db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:11.175065 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc296c-17e1-4684-a407-4e1f788a97db None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:11.185371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 324/643] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 09:32:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:11.190367 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc296c-17e1-4684-a407-4e1f788a97db None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:11.262947 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d37c3-70f0-4687-8214-c09121b05d23 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:11.307440 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47045e71-cddf-452c-af36-3c67b514855c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:11.308034 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47045e71-cddf-452c-af36-3c67b514855c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:11.308313 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47045e71-cddf-452c-af36-3c67b514855c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:11.308597 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47045e71-cddf-452c-af36-3c67b514855c None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:11.309232 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47045e71-cddf-452c-af36-3c67b514855c None admin] RBAC: Adding query filter params (name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:11.309565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47045e71-cddf-452c-af36-3c67b514855c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:11.311202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47045e71-cddf-452c-af36-3c67b514855c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:11.311327 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:11.325457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 320/644] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 09:32:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:11.325457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47045e71-cddf-452c-af36-3c67b514855c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:11.332035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc296c-17e1-4684-a407-4e1f788a97db None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:11.369893 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:11.378987 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16116651-7fea-4efb-acb4-6016fee0d840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:11.379929 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16116651-7fea-4efb-acb4-6016fee0d840 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:11.380354 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16116651-7fea-4efb-acb4-6016fee0d840 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:11.380770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16116651-7fea-4efb-acb4-6016fee0d840 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:11.388712 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16116651-7fea-4efb-acb4-6016fee0d840 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:11.390641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16116651-7fea-4efb-acb4-6016fee0d840 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:11.403701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-16116651-7fea-4efb-acb4-6016fee0d840 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:11.403701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:11.403701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:11.403701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:11.403701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:11.403701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:11.403701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:11.403701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:11.403701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:11.403701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:11.403701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:11.403701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:11.403701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:11.403701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:11.403701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:11.404817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:11.404817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:11.404817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:11.404817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:11.404817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:11.404817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:11.404817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:11.404817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:11.404817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:11.404817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:11.404817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:11.404817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:11.404817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:11.404817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:11.404817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:11.404817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:11.404817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:11.406050 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:11.406050 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:11.406050 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:11.406050 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:11.406050 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:11.406050 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:11.406050 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:11.406050 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:11.407997 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 325/645] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:11.409436 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16116651-7fea-4efb-acb4-6016fee0d840 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:11.464997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47045e71-cddf-452c-af36-3c67b514855c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:11.524153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7303fa2-62cb-4acb-bdc0-87394a3a49c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:11.525185 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7303fa2-62cb-4acb-bdc0-87394a3a49c9 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:11.525592 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7303fa2-62cb-4acb-bdc0-87394a3a49c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:11.526315 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7303fa2-62cb-4acb-bdc0-87394a3a49c9 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:11.527036 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7303fa2-62cb-4acb-bdc0-87394a3a49c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:11.527408 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7303fa2-62cb-4acb-bdc0-87394a3a49c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:11.529299 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7303fa2-62cb-4acb-bdc0-87394a3a49c9 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:11.543246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16116651-7fea-4efb-acb4-6016fee0d840 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:11.550961 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 321/646] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:11.550961 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7303fa2-62cb-4acb-bdc0-87394a3a49c9 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:11.606968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697441d-69ae-46d8-9a69-c09efebc4101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:11.608554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697441d-69ae-46d8-9a69-c09efebc4101 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:11.609092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697441d-69ae-46d8-9a69-c09efebc4101 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:11.609689 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697441d-69ae-46d8-9a69-c09efebc4101 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:11.626778 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697441d-69ae-46d8-9a69-c09efebc4101 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:11.629725 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697441d-69ae-46d8-9a69-c09efebc4101 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:11.650732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-8697441d-69ae-46d8-9a69-c09efebc4101 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:11.650732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:11.650732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:11.650732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:11.650732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:11.650732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:11.650732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:11.650732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:11.650732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:11.650732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:11.650732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:11.650732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:11.650732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:11.650732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:11.650732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:11.650732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:11.651709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:11.651709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:11.651709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:11.651709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:11.651709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:11.651709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:11.651709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:11.651709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:11.651709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:11.651709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:11.651709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:11.651709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:11.651709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:11.651709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:11.651709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:11.651709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:11.651709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:11.652570 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:11.652570 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:11.652570 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:11.652570 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 326/647] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:11.653563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697441d-69ae-46d8-9a69-c09efebc4101 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:11.657296 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:11.667217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:11.673673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7303fa2-62cb-4acb-bdc0-87394a3a49c9 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:11.715194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c299a-2871-4155-b68f-bee788265417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:11.716263 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c299a-2871-4155-b68f-bee788265417 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:11.716706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c299a-2871-4155-b68f-bee788265417 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:11.717572 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c299a-2871-4155-b68f-bee788265417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:11.733317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c299a-2871-4155-b68f-bee788265417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:11.735747 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c299a-2871-4155-b68f-bee788265417 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:11.760203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-e70c299a-2871-4155-b68f-bee788265417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:11.760203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:11.760203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:11.760203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:11.760203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:11.760203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:11.760203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:11.760203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:11.760203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:11.760203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:11.760203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:11.760203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:11.760203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:11.760203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:11.760203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:11.760203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:11.761294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:11.761294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:11.761294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:11.761294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:11.761294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:11.761294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:11.761294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:11.761294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:11.761294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:11.761294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:11.761294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:11.761294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:11.761294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:11.761294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:11.761294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:11.761294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:11.761294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:11.762452 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:11.762452 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:11.762452 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:11.764641 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 322/648] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:11.765998 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c299a-2871-4155-b68f-bee788265417 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:11.779163 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697441d-69ae-46d8-9a69-c09efebc4101 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:11.832147 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48f846-8e9d-487f-8eda-24dfbea46523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:11.833078 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48f846-8e9d-487f-8eda-24dfbea46523 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:11.833450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48f846-8e9d-487f-8eda-24dfbea46523 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:11.834322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48f846-8e9d-487f-8eda-24dfbea46523 None admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:11.835009 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48f846-8e9d-487f-8eda-24dfbea46523 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:11.835729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48f846-8e9d-487f-8eda-24dfbea46523 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:11.837300 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48f846-8e9d-487f-8eda-24dfbea46523 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:11.859198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 327/649] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:11.860131 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48f846-8e9d-487f-8eda-24dfbea46523 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:11.907409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c299a-2871-4155-b68f-bee788265417 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:11.945364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:11.965079 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372eee1-1774-4c86-96b5-1583f05b5fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:11.965864 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372eee1-1774-4c86-96b5-1583f05b5fd4 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:11.966099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372eee1-1774-4c86-96b5-1583f05b5fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:11.966374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372eee1-1774-4c86-96b5-1583f05b5fd4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:11.975963 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372eee1-1774-4c86-96b5-1583f05b5fd4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:11.977438 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372eee1-1774-4c86-96b5-1583f05b5fd4 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:11.990727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-3372eee1-1774-4c86-96b5-1583f05b5fd4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:32:11.990727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:11.990727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:11.990727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:11.990727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:11.990727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:11.990727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:11.990727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:11.990727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:11.990727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:11.990727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:11.990727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:11.990727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:11.990727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:11.990727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:11.990727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:11.991925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:11.991925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:11.991925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:11.991925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:11.991925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:11.991925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:11.991925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:11.991925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:11.991925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:11.991925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:11.991925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:11.991925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:11.991925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:11.991925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:11.991925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:11.991925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:11.991925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:11.991925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:11.992887 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:11.992887 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:11.992887 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:11.992887 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:11.992887 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:11.992887 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:11.992887 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:11.992887 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:11.992887 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 09:32:11.992887 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:11.992887 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 323/650] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:32:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:11.993549 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372eee1-1774-4c86-96b5-1583f05b5fd4 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:12.005952 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:12.009135 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48f846-8e9d-487f-8eda-24dfbea46523 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:12.059142 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a5a35-bc25-417b-8381-69614f539135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:12.059919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a5a35-bc25-417b-8381-69614f539135 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:12.060300 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a5a35-bc25-417b-8381-69614f539135 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:12.060671 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a5a35-bc25-417b-8381-69614f539135 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:12.061431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a5a35-bc25-417b-8381-69614f539135 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:12.061889 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a5a35-bc25-417b-8381-69614f539135 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:12.063357 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a5a35-bc25-417b-8381-69614f539135 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:12.076569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 328/651] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:12.077603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a5a35-bc25-417b-8381-69614f539135 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:12.133269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372eee1-1774-4c86-96b5-1583f05b5fd4 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:12.182713 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf43955-e29d-486c-a77a-5507eed3ed22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:12.184107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf43955-e29d-486c-a77a-5507eed3ed22 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:12.184538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf43955-e29d-486c-a77a-5507eed3ed22 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:12.184821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf43955-e29d-486c-a77a-5507eed3ed22 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:12.186306 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf43955-e29d-486c-a77a-5507eed3ed22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:12.186618 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf43955-e29d-486c-a77a-5507eed3ed22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:12.187982 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf43955-e29d-486c-a77a-5507eed3ed22 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:12.207879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 324/652] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:12.208874 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf43955-e29d-486c-a77a-5507eed3ed22 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:12.228140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a5a35-bc25-417b-8381-69614f539135 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:12.263438 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:12.281255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861569d0-3c18-48e6-a04d-04e37de69ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:12.281917 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861569d0-3c18-48e6-a04d-04e37de69ee4 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:12.282199 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861569d0-3c18-48e6-a04d-04e37de69ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:12.282566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861569d0-3c18-48e6-a04d-04e37de69ee4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:12.283427 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861569d0-3c18-48e6-a04d-04e37de69ee4 None admin] RBAC: Adding query filter params (role.id=85dac7b70cf04091baaf69caabd27a8b, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=18be8c54c9644c5e9812eea09e60c11c) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:12.284443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861569d0-3c18-48e6-a04d-04e37de69ee4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:12.285924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861569d0-3c18-48e6-a04d-04e37de69ee4 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:12.306076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:12.306595 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 329/653] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:32:12 2022] GET /identity/v3/role_assignments?user.id=18be8c54c9644c5e9812eea09e60c11c&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=85dac7b70cf04091baaf69caabd27a8b => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:12.307234 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861569d0-3c18-48e6-a04d-04e37de69ee4 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:12.348963 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf43955-e29d-486c-a77a-5507eed3ed22 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:12.395554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a1832-edcf-45b4-8e0b-8f7313556034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:12.396706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a1832-edcf-45b4-8e0b-8f7313556034 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:12.396706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a1832-edcf-45b4-8e0b-8f7313556034 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:12.397297 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a1832-edcf-45b4-8e0b-8f7313556034 None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:12.398555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a1832-edcf-45b4-8e0b-8f7313556034 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:12.398555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a1832-edcf-45b4-8e0b-8f7313556034 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:12.400146 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a1832-edcf-45b4-8e0b-8f7313556034 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:12.429362 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 325/654] 10.222.0.58 () {56 vars in 1137 bytes} [Wed Aug 24 09:32:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:12.431362 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a1832-edcf-45b4-8e0b-8f7313556034 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:12.481489 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861569d0-3c18-48e6-a04d-04e37de69ee4 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:12.526161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa7c72-88e8-4aef-adaa-375738925999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:12.527052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa7c72-88e8-4aef-adaa-375738925999 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:12.527249 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa7c72-88e8-4aef-adaa-375738925999 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:12.527455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa7c72-88e8-4aef-adaa-375738925999 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:12.544919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa7c72-88e8-4aef-adaa-375738925999 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:12.546210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fa7c72-88e8-4aef-adaa-375738925999 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:12.569130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-01fa7c72-88e8-4aef-adaa-375738925999 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:32:12.569130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:12.569130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:12.569130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:12.569130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:12.569130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:12.569130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:12.569130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:12.569130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:12.569130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:12.569130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:12.569130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:12.569130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:12.569130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:12.569130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:12.569130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:12.570231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:12.570231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:12.570231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:12.570231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:12.570231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:12.570231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:12.570231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:12.570231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:12.570231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:12.570231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:12.570231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:12.570231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:12.570231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:12.570231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:12.570231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:12.570231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:12.570231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:12.570231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:12.571360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:12.571360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:12.571360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:12.571360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:12.571360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:12.571360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:12.571360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:12.571360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:12.571360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:32:12.571360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:12.573935 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 330/655] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:32:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:12.576707 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa7c72-88e8-4aef-adaa-375738925999 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:12.579671 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a1832-edcf-45b4-8e0b-8f7313556034 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:12.631565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:12.648153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04caad8-f378-4332-a33f-495eb02561de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:12.649034 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04caad8-f378-4332-a33f-495eb02561de None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:12.649540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04caad8-f378-4332-a33f-495eb02561de None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:12.649960 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04caad8-f378-4332-a33f-495eb02561de None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:12.661915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:12.669146 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04caad8-f378-4332-a33f-495eb02561de None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:12.671533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04caad8-f378-4332-a33f-495eb02561de None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:12.693876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-f04caad8-f378-4332-a33f-495eb02561de None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:32:12.693876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:12.693876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:12.693876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:12.693876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:12.693876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:12.693876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:12.693876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:12.693876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:12.693876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:12.693876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:12.693876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:12.693876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:12.693876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:12.693876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:12.693876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:12.694863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:12.694863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:12.694863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:12.694863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:12.694863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:12.694863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:12.694863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:12.694863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:12.694863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:12.694863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:12.694863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:12.694863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:12.694863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:12.694863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:12.694863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:12.694863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:12.694863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:12.694863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:12.695782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:12.695782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:12.695782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:12.695782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:12.695782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:12.695782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:12.695782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:12.695782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:12.695782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 09:32:12.695782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:12.698441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 326/656] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:32:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:12.703605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04caad8-f378-4332-a33f-495eb02561de None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:12.740485 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa7c72-88e8-4aef-adaa-375738925999 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:12.793436 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1131f-5db7-45f3-94a9-b50d4d401211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:12.795607 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1131f-5db7-45f3-94a9-b50d4d401211 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:12.796965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1131f-5db7-45f3-94a9-b50d4d401211 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:12.797568 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1131f-5db7-45f3-94a9-b50d4d401211 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:12.887763 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04caad8-f378-4332-a33f-495eb02561de None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:12.946550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1131f-5db7-45f3-94a9-b50d4d401211 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:12.949379 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1131f-5db7-45f3-94a9-b50d4d401211 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:12.977284 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdedc09-0a30-4a1c-8cd2-dfa8cdceca1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:12.978930 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdedc09-0a30-4a1c-8cd2-dfa8cdceca1e None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:12.979209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdedc09-0a30-4a1c-8cd2-dfa8cdceca1e None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:12.979482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdedc09-0a30-4a1c-8cd2-dfa8cdceca1e None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:12.980212 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdedc09-0a30-4a1c-8cd2-dfa8cdceca1e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:12.980516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdedc09-0a30-4a1c-8cd2-dfa8cdceca1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:12.981977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdedc09-0a30-4a1c-8cd2-dfa8cdceca1e None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:13.003209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 327/657] 10.222.0.58 () {56 vars in 1137 bytes} [Wed Aug 24 09:32:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:13.004109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdedc09-0a30-4a1c-8cd2-dfa8cdceca1e None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:13.018231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:13.066630 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:13.093420 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 331/658] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:32:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:13.093420 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d314e5c-2667-4acb-a6c6-e150dce4dee5 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:13.093420 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d314e5c-2667-4acb-a6c6-e150dce4dee5 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:13.093420 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d314e5c-2667-4acb-a6c6-e150dce4dee5 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:13.093420 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 332/659] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:13.093420 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d314e5c-2667-4acb-a6c6-e150dce4dee5 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:13.149129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdedc09-0a30-4a1c-8cd2-dfa8cdceca1e None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:13.194888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8fd81-8a9c-4260-9d56-dfe63528d09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:13.195500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8fd81-8a9c-4260-9d56-dfe63528d09c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:13.195775 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8fd81-8a9c-4260-9d56-dfe63528d09c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:13.196046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8fd81-8a9c-4260-9d56-dfe63528d09c None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:13.196775 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8fd81-8a9c-4260-9d56-dfe63528d09c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:13.197077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8fd81-8a9c-4260-9d56-dfe63528d09c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:13.198520 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8fd81-8a9c-4260-9d56-dfe63528d09c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:13.227262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 328/660] 10.222.0.58 () {56 vars in 1139 bytes} [Wed Aug 24 09:32:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:13.228198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8fd81-8a9c-4260-9d56-dfe63528d09c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:13.235120 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d314e5c-2667-4acb-a6c6-e150dce4dee5 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:13.289705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f788af-daaf-4f4d-85b3-50891c1512b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:13.290605 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f788af-daaf-4f4d-85b3-50891c1512b1 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:13.291217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f788af-daaf-4f4d-85b3-50891c1512b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:13.292013 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f788af-daaf-4f4d-85b3-50891c1512b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:13.315921 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:13.367810 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8fd81-8a9c-4260-9d56-dfe63528d09c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:13.370085 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:13.383857 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f788af-daaf-4f4d-85b3-50891c1512b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:13.385315 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f788af-daaf-4f4d-85b3-50891c1512b1 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:13.411315 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f9aa7-2312-44ca-a5c3-ad98dd091f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:13.412521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f9aa7-2312-44ca-a5c3-ad98dd091f1d None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:13.412813 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f9aa7-2312-44ca-a5c3-ad98dd091f1d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:13.413086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f9aa7-2312-44ca-a5c3-ad98dd091f1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:13.426285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f9aa7-2312-44ca-a5c3-ad98dd091f1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:13.427746 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f9aa7-2312-44ca-a5c3-ad98dd091f1d None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:13.445285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-da6f9aa7-2312-44ca-a5c3-ad98dd091f1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:13.445285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:13.445285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:13.445285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:13.445285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:13.445285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:13.445285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:13.445285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:13.445285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:13.445285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:13.445285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:13.445285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:13.445285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:13.445285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:13.445285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:13.445285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:13.446276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:13.446276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:13.446276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:13.446276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:13.446276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:13.446276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:13.446276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:13.446276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:13.446276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:13.446276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:13.446276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:13.446276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:13.446276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:13.446276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:13.446276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:13.446276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:13.446276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:13.447149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:13.447149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:13.447149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:13.451634 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 329/661] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:13.452969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60955cd3-c46f-421b-b738-e9647bc8c451 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:13.453260 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60955cd3-c46f-421b-b738-e9647bc8c451 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:13.453570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60955cd3-c46f-421b-b738-e9647bc8c451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:13.475950 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-60955cd3-c46f-421b-b738-e9647bc8c451 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:13.476989 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-60955cd3-c46f-421b-b738-e9647bc8c451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:13.509608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 333/662] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:32:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:13.510606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f788af-daaf-4f4d-85b3-50891c1512b1 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:13.560411 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 330/663] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:32:13.561828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60955cd3-c46f-421b-b738-e9647bc8c451 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:13.568049 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:13.655680 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f788af-daaf-4f4d-85b3-50891c1512b1 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:13.710169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9f537-e50c-41a2-8b99-c6e3d655975c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:13.712783 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9f537-e50c-41a2-8b99-c6e3d655975c None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:13.713371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9f537-e50c-41a2-8b99-c6e3d655975c None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:13.714308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9f537-e50c-41a2-8b99-c6e3d655975c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:13.718607 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:13.748880 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60955cd3-c46f-421b-b738-e9647bc8c451 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:13.801493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9f537-e50c-41a2-8b99-c6e3d655975c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:13.803270 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9f537-e50c-41a2-8b99-c6e3d655975c None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:13.812466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e4c2c-928c-4cd2-9529-1e373d405c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:13.813143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e4c2c-928c-4cd2-9529-1e373d405c95 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:13.813556 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e4c2c-928c-4cd2-9529-1e373d405c95 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:13.813969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e4c2c-928c-4cd2-9529-1e373d405c95 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:13.814715 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e4c2c-928c-4cd2-9529-1e373d405c95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:13.815905 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e4c2c-928c-4cd2-9529-1e373d405c95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:13.819202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e4c2c-928c-4cd2-9529-1e373d405c95 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:13.839954 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 331/664] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:13.843146 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e4c2c-928c-4cd2-9529-1e373d405c95 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:13.870163 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:13.944573 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 334/665] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:32:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:13.946673 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9f537-e50c-41a2-8b99-c6e3d655975c None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:13.981185 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e4c2c-928c-4cd2-9529-1e373d405c95 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:14.028834 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe3022-d456-4703-80bb-2a03279f065d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:14.029706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe3022-d456-4703-80bb-2a03279f065d None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:14.029985 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe3022-d456-4703-80bb-2a03279f065d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:14.030256 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe3022-d456-4703-80bb-2a03279f065d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:14.043881 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe3022-d456-4703-80bb-2a03279f065d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:14.045957 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe3022-d456-4703-80bb-2a03279f065d None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:14.049132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:14.065929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-0afe3022-d456-4703-80bb-2a03279f065d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:14.065929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:14.065929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:14.065929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:14.065929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:14.065929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:14.065929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:14.065929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:14.065929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:14.065929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:14.065929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:14.065929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:14.065929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:14.065929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:14.065929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:14.065929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:14.066901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:14.066901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:14.066901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:14.066901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:14.066901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:14.066901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:14.066901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:14.066901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:14.066901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:14.066901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:14.066901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:14.066901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:14.066901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:14.066901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:14.066901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:14.066901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:14.066901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:14.067773 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:14.067773 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:14.067773 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:14.074125 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 332/666] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:14.074270 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9f537-e50c-41a2-8b99-c6e3d655975c None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:14.074352 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe3022-d456-4703-80bb-2a03279f065d None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:14.127776 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab5afb-9be2-4b83-bdeb-041d0e22c5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:14.128427 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab5afb-9be2-4b83-bdeb-041d0e22c5bd None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:14.128696 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab5afb-9be2-4b83-bdeb-041d0e22c5bd None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:14.128989 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab5afb-9be2-4b83-bdeb-041d0e22c5bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:14.137367 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab5afb-9be2-4b83-bdeb-041d0e22c5bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:14.139115 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab5afb-9be2-4b83-bdeb-041d0e22c5bd None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:14.151758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-e4ab5afb-9be2-4b83-bdeb-041d0e22c5bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:14.151758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:14.151758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:14.151758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:14.151758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:14.151758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:14.151758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:14.151758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:14.151758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:14.151758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:14.151758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:14.151758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:14.151758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:14.151758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:14.151758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:14.152683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:14.152683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:14.152683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:14.152683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:14.152683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:14.152683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:14.152683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:14.152683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:14.152683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:14.152683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:14.152683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:14.152683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:14.152683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:14.152683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:14.152683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:14.152683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:14.152683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:14.154019 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:14.154019 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:14.154019 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:14.154019 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:14.154019 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:14.154019 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:14.154019 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:14.154019 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:14.154019 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 335/667] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:14.154019 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab5afb-9be2-4b83-bdeb-041d0e22c5bd None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:14.167234 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:14.216159 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe3022-d456-4703-80bb-2a03279f065d None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:14.261090 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95899e1-1b9a-44b9-8411-63065962fdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:14.261941 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95899e1-1b9a-44b9-8411-63065962fdc5 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:14.262135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95899e1-1b9a-44b9-8411-63065962fdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:14.262343 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95899e1-1b9a-44b9-8411-63065962fdc5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:14.278317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95899e1-1b9a-44b9-8411-63065962fdc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:32:14.287444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-b95899e1-1b9a-44b9-8411-63065962fdc5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:14.287444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:14.287444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:14.287444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:14.287444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:14.287444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:14.287444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:14.287444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:14.287444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:14.287444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:14.287444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:14.287444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:14.287444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:32:14.287444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:32:14.287444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:32:14.287444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:32:14.288405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:32:14.288405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:32:14.288405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:32:14.288405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:32:14.288405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:14.288405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:14.288405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:14.288405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:14.288405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:14.288405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:14.288405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:14.288405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:14.288405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:14.288405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:14.288405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:14.288405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:14.289227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:14.289227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:14.289227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:14.289227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:14.289227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:32:14.289227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:32:14.289227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:32:14.289227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:32:14.289227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:32:14.289227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:32:14.289227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:14.289227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:14.289227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 333/668] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:32:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:14.289997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95899e1-1b9a-44b9-8411-63065962fdc5 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:14.292756 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab5afb-9be2-4b83-bdeb-041d0e22c5bd None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:14.334650 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765874a-eec4-4113-84b9-ff9900208061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:14.335318 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765874a-eec4-4113-84b9-ff9900208061 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:14.335691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765874a-eec4-4113-84b9-ff9900208061 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:14.336030 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765874a-eec4-4113-84b9-ff9900208061 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:14.349936 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765874a-eec4-4113-84b9-ff9900208061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:14.352152 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765874a-eec4-4113-84b9-ff9900208061 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:14.367072 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:14.370460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-0765874a-eec4-4113-84b9-ff9900208061 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:14.370460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:14.370460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:14.370460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:14.370460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:14.370460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:14.370460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:14.370460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:14.370460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:14.370460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:14.370460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:14.370460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:14.370460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:14.370460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:14.370460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:14.370460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:14.371364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:14.371364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:14.371364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:14.371364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:14.371364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:14.371364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:14.371364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:14.371364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:14.371364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:14.371364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:14.371364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:14.371364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:14.371364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:14.371364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:14.371364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:14.371364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:14.371364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:14.372237 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:14.372237 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:14.372237 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:14.372237 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 336/669] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:14.373013 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765874a-eec4-4113-84b9-ff9900208061 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:14.428661 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95899e1-1b9a-44b9-8411-63065962fdc5 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:14.451805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:14.467369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fe1c0-56ee-4479-94f0-459210f8f784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:14.468071 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fe1c0-56ee-4479-94f0-459210f8f784 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:14.468355 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fe1c0-56ee-4479-94f0-459210f8f784 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:14.468627 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fe1c0-56ee-4479-94f0-459210f8f784 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:14.469269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fe1c0-56ee-4479-94f0-459210f8f784 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:14.469703 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fe1c0-56ee-4479-94f0-459210f8f784 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:14.471691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36fe1c0-56ee-4479-94f0-459210f8f784 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:14.490120 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 334/670] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:14.490120 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fe1c0-56ee-4479-94f0-459210f8f784 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:14.503206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765874a-eec4-4113-84b9-ff9900208061 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:14.543022 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9c4ed-8404-4ffa-aa1d-6a22fe9fada0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:14.543845 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9c4ed-8404-4ffa-aa1d-6a22fe9fada0 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:14.544183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9c4ed-8404-4ffa-aa1d-6a22fe9fada0 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:14.544545 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9c4ed-8404-4ffa-aa1d-6a22fe9fada0 None admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:14.545266 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9c4ed-8404-4ffa-aa1d-6a22fe9fada0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:14.546009 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9c4ed-8404-4ffa-aa1d-6a22fe9fada0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:14.547167 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9c4ed-8404-4ffa-aa1d-6a22fe9fada0 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:14.560136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 337/671] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:14.560784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9c4ed-8404-4ffa-aa1d-6a22fe9fada0 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:14.605414 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fe1c0-56ee-4479-94f0-459210f8f784 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:14.625166 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:14.647928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63484f-ba1a-4251-8a57-f55a5658a47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:14.648533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63484f-ba1a-4251-8a57-f55a5658a47e None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:14.648807 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63484f-ba1a-4251-8a57-f55a5658a47e None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:14.649084 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63484f-ba1a-4251-8a57-f55a5658a47e None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:14.650054 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63484f-ba1a-4251-8a57-f55a5658a47e None admin] RBAC: Adding query filter params (name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:14.650173 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63484f-ba1a-4251-8a57-f55a5658a47e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:14.651446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63484f-ba1a-4251-8a57-f55a5658a47e None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:14.659972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 335/672] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 09:32:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:14.659972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc6700-629c-4e7d-9c50-e5b94c72e1ba None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:14.659972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc6700-629c-4e7d-9c50-e5b94c72e1ba None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:14.659972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc6700-629c-4e7d-9c50-e5b94c72e1ba None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:14.659972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 336/673] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:14.659972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc6700-629c-4e7d-9c50-e5b94c72e1ba None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:14.676819 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9c4ed-8404-4ffa-aa1d-6a22fe9fada0 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:14.702479 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:14.721112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76896f-ae3f-4abd-af01-13f9b39999f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:14.721895 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76896f-ae3f-4abd-af01-13f9b39999f0 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:14.722230 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76896f-ae3f-4abd-af01-13f9b39999f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:14.722508 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76896f-ae3f-4abd-af01-13f9b39999f0 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:14.723164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76896f-ae3f-4abd-af01-13f9b39999f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:14.723585 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76896f-ae3f-4abd-af01-13f9b39999f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:14.724863 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76896f-ae3f-4abd-af01-13f9b39999f0 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:14.738083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 338/674] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:14.738750 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76896f-ae3f-4abd-af01-13f9b39999f0 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:14.783120 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc6700-629c-4e7d-9c50-e5b94c72e1ba None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:14.823789 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cabb3-9376-413a-b904-a40e9d8d8f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:14.824419 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cabb3-9376-413a-b904-a40e9d8d8f21 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:14.824691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cabb3-9376-413a-b904-a40e9d8d8f21 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:14.824959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cabb3-9376-413a-b904-a40e9d8d8f21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:14.832376 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cabb3-9376-413a-b904-a40e9d8d8f21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:14.834027 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cabb3-9376-413a-b904-a40e9d8d8f21 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:14.845975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-447cabb3-9376-413a-b904-a40e9d8d8f21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:14.845975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:14.845975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:14.845975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:14.845975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:14.845975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:14.845975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:14.845975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:14.845975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:14.845975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:14.845975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:14.845975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:14.845975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:14.845975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:14.845975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:14.847450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:14.847450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:14.847450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:14.847450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:14.847450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:14.847450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:14.847450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:14.847450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:14.847450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:14.847450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:14.847450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:14.847450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:14.847450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:14.847450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:14.847450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:14.847450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:14.847450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:14.848392 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:14.848392 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:14.848392 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:14.848392 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:14.848392 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:14.848392 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:14.848392 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:14.848392 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:14.848392 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 337/675] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:14.848871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cabb3-9376-413a-b904-a40e9d8d8f21 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:14.853325 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76896f-ae3f-4abd-af01-13f9b39999f0 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:14.896581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca2d16-0a82-4eaa-ad97-97f40f398998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:14.897110 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca2d16-0a82-4eaa-ad97-97f40f398998 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:14.897384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca2d16-0a82-4eaa-ad97-97f40f398998 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:14.897730 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca2d16-0a82-4eaa-ad97-97f40f398998 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:14.898453 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca2d16-0a82-4eaa-ad97-97f40f398998 None admin] RBAC: Adding query filter params (role.id=85dac7b70cf04091baaf69caabd27a8b, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=51fe6dfa43d04cdeb0421d2613c8c2ca) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:14.898757 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca2d16-0a82-4eaa-ad97-97f40f398998 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:14.900184 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca2d16-0a82-4eaa-ad97-97f40f398998 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:14.902898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:14.913519 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 339/676] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:32:14 2022] GET /identity/v3/role_assignments?user.id=51fe6dfa43d04cdeb0421d2613c8c2ca&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=85dac7b70cf04091baaf69caabd27a8b => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:14.913519 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e491d-73fc-4e2e-a011-a77fcaecb707 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:14.913519 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e491d-73fc-4e2e-a011-a77fcaecb707 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:14.913519 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e491d-73fc-4e2e-a011-a77fcaecb707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:14.932403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-268e491d-73fc-4e2e-a011-a77fcaecb707 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:14.933734 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-268e491d-73fc-4e2e-a011-a77fcaecb707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:14.989102 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:14.994171 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cabb3-9376-413a-b904-a40e9d8d8f21 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:15.020699 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 340/677] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:32:15.021585 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e491d-73fc-4e2e-a011-a77fcaecb707 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:15.050405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558b015-0890-487c-9427-0c8e156a406b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:15.051162 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558b015-0890-487c-9427-0c8e156a406b None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:15.051507 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558b015-0890-487c-9427-0c8e156a406b None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:15.051847 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558b015-0890-487c-9427-0c8e156a406b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:15.069749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558b015-0890-487c-9427-0c8e156a406b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:15.071590 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558b015-0890-487c-9427-0c8e156a406b None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:15.090988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-3558b015-0890-487c-9427-0c8e156a406b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:15.090988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:15.090988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:15.090988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:15.090988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:15.090988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:15.090988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:15.090988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:15.090988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:15.090988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:15.090988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:15.090988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:15.090988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:15.090988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:15.090988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:15.090988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:15.091977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:15.091977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:15.091977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:15.091977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:15.091977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:15.091977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:15.091977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:15.091977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:15.091977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:15.091977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:15.091977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:15.091977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:15.091977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:15.091977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:15.091977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:15.091977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:15.091977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:15.093001 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:15.093001 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:15.093001 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:15.093001 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 338/678] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:15.093237 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558b015-0890-487c-9427-0c8e156a406b None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:15.180377 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e491d-73fc-4e2e-a011-a77fcaecb707 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:15.244643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c8c69-6b0d-4410-a709-5ed32a58b3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:15.245681 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c8c69-6b0d-4410-a709-5ed32a58b3e2 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:15.246160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c8c69-6b0d-4410-a709-5ed32a58b3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:15.246654 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c8c69-6b0d-4410-a709-5ed32a58b3e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:15.255512 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c8c69-6b0d-4410-a709-5ed32a58b3e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:15.257343 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c8c69-6b0d-4410-a709-5ed32a58b3e2 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:15.268029 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:15.273787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-e72c8c69-6b0d-4410-a709-5ed32a58b3e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:15.273787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:15.273787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:15.273787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:15.273787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:15.273787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:15.273787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:15.273787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:15.273787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:15.273787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:15.273787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:15.273787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:15.273787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:15.273787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:15.273787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:15.274663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:15.274663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:15.274663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:15.274663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:15.274663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:15.274663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:15.274663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:15.274663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:15.274663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:15.274663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:15.274663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:15.274663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:15.274663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:15.274663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:15.274663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:15.274663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:15.274663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:15.275525 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:15.275525 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:15.275525 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:15.275525 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:15.275525 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:15.275525 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:15.275525 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:15.275525 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:15.278951 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 341/679] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:15.280603 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558b015-0890-487c-9427-0c8e156a406b None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:15.281417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c8c69-6b0d-4410-a709-5ed32a58b3e2 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:15.327365 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655cde1-3781-41c5-819c-7dec2b18e82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:15.327986 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655cde1-3781-41c5-819c-7dec2b18e82a None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:15.328269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655cde1-3781-41c5-819c-7dec2b18e82a None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:15.328548 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655cde1-3781-41c5-819c-7dec2b18e82a None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:15.329792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655cde1-3781-41c5-819c-7dec2b18e82a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:15.330123 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655cde1-3781-41c5-819c-7dec2b18e82a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:15.331928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655cde1-3781-41c5-819c-7dec2b18e82a None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:15.336610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:15.352278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 339/680] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:15.352278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655cde1-3781-41c5-819c-7dec2b18e82a None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:15.428730 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c8c69-6b0d-4410-a709-5ed32a58b3e2 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:15.469738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655cde1-3781-41c5-819c-7dec2b18e82a None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:15.473084 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c66458-fc41-4ecf-8039-fb960e9f8326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:15.473826 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c66458-fc41-4ecf-8039-fb960e9f8326 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:15.474173 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c66458-fc41-4ecf-8039-fb960e9f8326 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:15.474517 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c66458-fc41-4ecf-8039-fb960e9f8326 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:15.475513 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c66458-fc41-4ecf-8039-fb960e9f8326 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:15.475882 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c66458-fc41-4ecf-8039-fb960e9f8326 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:15.477417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c66458-fc41-4ecf-8039-fb960e9f8326 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:15.500411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 342/681] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:15.501553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c66458-fc41-4ecf-8039-fb960e9f8326 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:15.523822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39377360-7253-49d9-8bc6-07f873d6b1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:15.523822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39377360-7253-49d9-8bc6-07f873d6b1f7 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:15.523822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39377360-7253-49d9-8bc6-07f873d6b1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:15.523822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39377360-7253-49d9-8bc6-07f873d6b1f7 None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:15.524233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39377360-7253-49d9-8bc6-07f873d6b1f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:15.524233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39377360-7253-49d9-8bc6-07f873d6b1f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:15.524233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39377360-7253-49d9-8bc6-07f873d6b1f7 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:15.541655 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 340/682] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:15.541655 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39377360-7253-49d9-8bc6-07f873d6b1f7 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:15.558908 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:15.619306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:15.629840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c66458-fc41-4ecf-8039-fb960e9f8326 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:15.676690 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4901f-09d4-405a-809b-cf98c6ad7c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:15.677718 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4901f-09d4-405a-809b-cf98c6ad7c78 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:15.678249 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39377360-7253-49d9-8bc6-07f873d6b1f7 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:15.678731 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4901f-09d4-405a-809b-cf98c6ad7c78 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:15.679308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4901f-09d4-405a-809b-cf98c6ad7c78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:15.697060 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4901f-09d4-405a-809b-cf98c6ad7c78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:32:15.704251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-6da4901f-09d4-405a-809b-cf98c6ad7c78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:32:15.704251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:15.704251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:15.704251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:15.704251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:15.704251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:15.704251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:15.704251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:15.704251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:15.704251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:15.704251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:15.704251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:15.704251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:32:15.704251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:32:15.704251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:32:15.704251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:32:15.705196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:32:15.705196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:32:15.705196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:32:15.705196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:32:15.705196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:15.705196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:15.705196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:15.705196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:15.705196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:15.705196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:15.705196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:15.705196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:15.705196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:15.705196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:15.705196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:15.705196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:15.706092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:15.706092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:15.706092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:15.706092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:15.706092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:32:15.706092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:32:15.706092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:32:15.706092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:32:15.706092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:32:15.706092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:32:15.706092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:32:15.706092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:15.706727 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 343/683] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:32:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:15.708766 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4901f-09d4-405a-809b-cf98c6ad7c78 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:15.725689 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea8ab4-87f4-4d06-8955-eaf61c1bb7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:15.726233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea8ab4-87f4-4d06-8955-eaf61c1bb7b5 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:15.726514 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea8ab4-87f4-4d06-8955-eaf61c1bb7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:15.726786 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea8ab4-87f4-4d06-8955-eaf61c1bb7b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:15.727516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea8ab4-87f4-4d06-8955-eaf61c1bb7b5 None admin] RBAC: Adding query filter params (role.id=85dac7b70cf04091baaf69caabd27a8b, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=782bdef852d34b9ba3a957962f93994f) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:15.727929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea8ab4-87f4-4d06-8955-eaf61c1bb7b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:15.729494 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea8ab4-87f4-4d06-8955-eaf61c1bb7b5 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:15.737287 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 341/684] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:32:15 2022] GET /identity/v3/role_assignments?user.id=782bdef852d34b9ba3a957962f93994f&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=85dac7b70cf04091baaf69caabd27a8b => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:15.744771 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea8ab4-87f4-4d06-8955-eaf61c1bb7b5 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:15.845315 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4901f-09d4-405a-809b-cf98c6ad7c78 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:15.928389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80082eac-f57b-4e54-a415-9b4081353c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:15.929183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80082eac-f57b-4e54-a415-9b4081353c8f None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:15.929617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80082eac-f57b-4e54-a415-9b4081353c8f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:15.930012 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80082eac-f57b-4e54-a415-9b4081353c8f None admin] PATH_INFO: `/v3/users/swift` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:15.933146 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:15.943838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80082eac-f57b-4e54-a415-9b4081353c8f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:15.945827 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80082eac-f57b-4e54-a415-9b4081353c8f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:15.960604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-80082eac-f57b-4e54-a415-9b4081353c8f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:32:15.960604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:15.960604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:15.960604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:15.960604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:15.960604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:15.960604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:15.960604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:15.960604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:15.960604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:15.960604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:15.960604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:15.960604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:15.960604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:15.960604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:15.960604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:15.961971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:15.961971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:15.961971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:15.961971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:15.961971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:15.961971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:15.961971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:15.961971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:15.961971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:15.961971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:15.961971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:15.961971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:15.961971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:15.961971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:15.961971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:15.961971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:15.961971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:15.961971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:15.963130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:15.963130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:15.963130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:15.963130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:15.963130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:15.963130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:15.963130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:15.963130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:15.963130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:32:15.963130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:15.963697 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 344/685] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:32:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:15.964075 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80082eac-f57b-4e54-a415-9b4081353c8f None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:15.981040 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea8ab4-87f4-4d06-8955-eaf61c1bb7b5 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:15.988504 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:16.045642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b80170-2d9a-46bc-87d2-7e6f0e2d4ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:16.046320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b80170-2d9a-46bc-87d2-7e6f0e2d4ab5 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:16.046657 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b80170-2d9a-46bc-87d2-7e6f0e2d4ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:16.046861 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b80170-2d9a-46bc-87d2-7e6f0e2d4ab5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:16.047629 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b80170-2d9a-46bc-87d2-7e6f0e2d4ab5 None admin] RBAC: Adding query filter params (role.id=85dac7b70cf04091baaf69caabd27a8b, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=7847dbf8f31146c5ab2136fbdb487783) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:16.047940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b80170-2d9a-46bc-87d2-7e6f0e2d4ab5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:16.050062 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b80170-2d9a-46bc-87d2-7e6f0e2d4ab5 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:16.061538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 342/686] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:32:15 2022] GET /identity/v3/role_assignments?user.id=7847dbf8f31146c5ab2136fbdb487783&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=85dac7b70cf04091baaf69caabd27a8b => generated 608 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:16.062460 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b80170-2d9a-46bc-87d2-7e6f0e2d4ab5 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:16.118661 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80082eac-f57b-4e54-a415-9b4081353c8f None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:16.173058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1bb02-2de0-4b16-8899-4977daa11456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:16.174497 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1bb02-2de0-4b16-8899-4977daa11456 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:16.175097 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1bb02-2de0-4b16-8899-4977daa11456 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:16.175577 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1bb02-2de0-4b16-8899-4977daa11456 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:16.176466 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1bb02-2de0-4b16-8899-4977daa11456 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:16.177102 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1bb02-2de0-4b16-8899-4977daa11456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:16.178780 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1bb02-2de0-4b16-8899-4977daa11456 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:16.190409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 345/687] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:32:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:16.196851 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1bb02-2de0-4b16-8899-4977daa11456 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:16.322851 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:16.345210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b80170-2d9a-46bc-87d2-7e6f0e2d4ab5 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:16.353696 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1bb02-2de0-4b16-8899-4977daa11456 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:16.399828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37338789-0a6f-40e1-894a-3556ce0c7ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:16.400448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37338789-0a6f-40e1-894a-3556ce0c7ff2 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:16.400728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37338789-0a6f-40e1-894a-3556ce0c7ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:16.400998 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37338789-0a6f-40e1-894a-3556ce0c7ff2 None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:16.401776 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37338789-0a6f-40e1-894a-3556ce0c7ff2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:16.402080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37338789-0a6f-40e1-894a-3556ce0c7ff2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:16.403501 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37338789-0a6f-40e1-894a-3556ce0c7ff2 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:16.406654 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b01e9-2cf0-47b2-9917-0f1004a8a31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:16.407280 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b01e9-2cf0-47b2-9917-0f1004a8a31b None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:16.407548 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b01e9-2cf0-47b2-9917-0f1004a8a31b None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:16.407811 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b01e9-2cf0-47b2-9917-0f1004a8a31b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:16.418403 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:16.433338 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b01e9-2cf0-47b2-9917-0f1004a8a31b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:16.433990 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 343/688] 10.222.0.58 () {56 vars in 1135 bytes} [Wed Aug 24 09:32:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:16.435129 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b01e9-2cf0-47b2-9917-0f1004a8a31b None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:16.439553 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37338789-0a6f-40e1-894a-3556ce0c7ff2 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:16.454694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-736b01e9-2cf0-47b2-9917-0f1004a8a31b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:16.454694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:16.454694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:16.454694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:16.454694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:16.454694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:16.454694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:16.454694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:16.454694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:16.454694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:16.454694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:16.454694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:16.454694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:16.454694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:16.454694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:16.454694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:16.456285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:16.456285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:16.456285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:16.456285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:16.456285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:16.456285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:16.456285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:16.456285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:16.456285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:16.456285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:16.456285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:16.456285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:16.456285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:16.456285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:16.456285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:16.456285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:16.456285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:16.457217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:16.457217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:16.457217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:16.457217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 346/689] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:32:16.474970 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b01e9-2cf0-47b2-9917-0f1004a8a31b None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:16.569368 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37338789-0a6f-40e1-894a-3556ce0c7ff2 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:16.608821 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b01e9-2cf0-47b2-9917-0f1004a8a31b None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:16.626301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a3968-6c2e-454c-becf-d8c9634f1680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:16.626824 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a3968-6c2e-454c-becf-d8c9634f1680 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:16.627101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a3968-6c2e-454c-becf-d8c9634f1680 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:16.628002 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a3968-6c2e-454c-becf-d8c9634f1680 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:16.639671 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:16.648734 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e71ca-a886-4940-8878-a74037d88321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:16.649342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e71ca-a886-4940-8878-a74037d88321 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:16.653487 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e71ca-a886-4940-8878-a74037d88321 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:16.653487 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e71ca-a886-4940-8878-a74037d88321 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:16.653487 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e71ca-a886-4940-8878-a74037d88321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:16.653487 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e71ca-a886-4940-8878-a74037d88321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:16.653487 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e71ca-a886-4940-8878-a74037d88321 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:16.666402 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 347/690] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:16.671909 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e71ca-a886-4940-8878-a74037d88321 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:16.794897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:16.809496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e71ca-a886-4940-8878-a74037d88321 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:16.825491 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a3968-6c2e-454c-becf-d8c9634f1680 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:16.825491 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a3968-6c2e-454c-becf-d8c9634f1680 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:16.865113 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7260a-3d78-4ee1-8b7e-576e7b77b530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:16.865698 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7260a-3d78-4ee1-8b7e-576e7b77b530 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:16.866977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7260a-3d78-4ee1-8b7e-576e7b77b530 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:16.867261 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7260a-3d78-4ee1-8b7e-576e7b77b530 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:16.883147 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7260a-3d78-4ee1-8b7e-576e7b77b530 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:16.884589 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7260a-3d78-4ee1-8b7e-576e7b77b530 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:16.909498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-d6f7260a-3d78-4ee1-8b7e-576e7b77b530 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:32:16.909498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:16.909498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:16.909498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:16.909498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:16.909498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:16.909498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:16.909498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:16.909498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:16.909498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:16.909498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:16.909498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:16.909498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:16.909498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:16.909498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:16.909498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:16.910668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:16.910668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:16.910668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:16.910668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:16.910668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:16.910668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:16.910668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:16.910668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:16.910668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:16.910668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:16.910668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:16.910668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:16.910668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:16.910668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:16.910668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:16.910668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:16.910668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:16.910668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:16.911582 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:16.911582 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:16.911582 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:16.911582 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:16.911582 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:16.911582 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:16.911582 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:16.911582 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:16.911582 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:32:16.911582 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:16.914463 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 348/691] 10.222.0.58 () {56 vars in 1093 bytes} [Wed Aug 24 09:32:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:16.922247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7260a-3d78-4ee1-8b7e-576e7b77b530 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:17.009491 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:17.076095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 344/692] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:32:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:17.086530 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a3968-6c2e-454c-becf-d8c9634f1680 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:17.118545 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7260a-3d78-4ee1-8b7e-576e7b77b530 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:17.165281 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5866f9c-68a4-4257-93dc-bec751f9f903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:17.167348 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5866f9c-68a4-4257-93dc-bec751f9f903 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:17.167631 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5866f9c-68a4-4257-93dc-bec751f9f903 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:17.167908 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5866f9c-68a4-4257-93dc-bec751f9f903 None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:17.168690 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5866f9c-68a4-4257-93dc-bec751f9f903 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:17.169002 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5866f9c-68a4-4257-93dc-bec751f9f903 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:17.172562 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5866f9c-68a4-4257-93dc-bec751f9f903 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:17.199253 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 349/693] 10.222.0.58 () {56 vars in 1133 bytes} [Wed Aug 24 09:32:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:17.207731 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c12d7-d0a3-452f-84da-ebafe036c209 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:17.207985 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c12d7-d0a3-452f-84da-ebafe036c209 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:17.208211 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c12d7-d0a3-452f-84da-ebafe036c209 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:17.214690 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 350/694] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:17 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:17.214690 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c12d7-d0a3-452f-84da-ebafe036c209 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:17.267487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:17.275666 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a3968-6c2e-454c-becf-d8c9634f1680 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:17.327341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58dc94-b902-45da-9729-883314190fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:17.328792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58dc94-b902-45da-9729-883314190fe8 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:17.328792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58dc94-b902-45da-9729-883314190fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:17.328792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58dc94-b902-45da-9729-883314190fe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:17.343414 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58dc94-b902-45da-9729-883314190fe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:17.347066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58dc94-b902-45da-9729-883314190fe8 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:17.364354 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c12d7-d0a3-452f-84da-ebafe036c209 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:17.373798 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:17.381108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-af58dc94-b902-45da-9729-883314190fe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:17.381108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:17.381108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:17.381108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:17.381108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:17.381108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:17.381108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:17.381108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:17.381108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:17.381108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:17.381108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:17.381108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:17.381108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:17.381108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:17.381108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:17.381108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:17.382099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:17.382099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:17.382099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:17.382099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:17.382099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:17.382099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:17.382099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:17.382099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:17.382099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:17.382099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:17.382099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:17.382099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:17.382099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:17.382099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:17.382099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:17.382099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:17.382099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:17.382994 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:17.382994 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:17.382994 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:17.388306 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 345/695] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:17.389791 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88b458-027c-4d30-aa17-72d3a11e5cf2 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:17.390414 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88b458-027c-4d30-aa17-72d3a11e5cf2 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:17.390701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88b458-027c-4d30-aa17-72d3a11e5cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:17.415126 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-be88b458-027c-4d30-aa17-72d3a11e5cf2 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:17.419191 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-be88b458-027c-4d30-aa17-72d3a11e5cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:17.425096 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65602c-7c94-4f08-b072-ed9da67d75bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:17.426108 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65602c-7c94-4f08-b072-ed9da67d75bb None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:17.426610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65602c-7c94-4f08-b072-ed9da67d75bb None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:17.427096 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65602c-7c94-4f08-b072-ed9da67d75bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:17.525876 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65602c-7c94-4f08-b072-ed9da67d75bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:17.527790 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65602c-7c94-4f08-b072-ed9da67d75bb None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:17.561504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 346/696] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:32:17.563361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88b458-027c-4d30-aa17-72d3a11e5cf2 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:17.658546 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 351/697] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:32:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:17.665327 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65602c-7c94-4f08-b072-ed9da67d75bb None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:17.688259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:17.757043 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:17.802040 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88b458-027c-4d30-aa17-72d3a11e5cf2 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:17.880509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6384908-b9e8-4a0b-9c63-16cd6144f4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:17.881127 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6384908-b9e8-4a0b-9c63-16cd6144f4c6 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:17.881407 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6384908-b9e8-4a0b-9c63-16cd6144f4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:17.883897 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65602c-7c94-4f08-b072-ed9da67d75bb None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:17.885550 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6384908-b9e8-4a0b-9c63-16cd6144f4c6 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:17.886280 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6384908-b9e8-4a0b-9c63-16cd6144f4c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:17.886592 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6384908-b9e8-4a0b-9c63-16cd6144f4c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:17.887974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6384908-b9e8-4a0b-9c63-16cd6144f4c6 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:17.913199 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 347/698] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:17.914876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6384908-b9e8-4a0b-9c63-16cd6144f4c6 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:17.967371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00943592-eba5-4e24-8d46-4109545331b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:17.968901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00943592-eba5-4e24-8d46-4109545331b1 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:17.971816 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00943592-eba5-4e24-8d46-4109545331b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:17.974677 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00943592-eba5-4e24-8d46-4109545331b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:18.016150 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00943592-eba5-4e24-8d46-4109545331b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:18.017660 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00943592-eba5-4e24-8d46-4109545331b1 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:18.039476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-00943592-eba5-4e24-8d46-4109545331b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:18.039476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:18.039476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:18.039476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:18.039476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:18.039476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:18.039476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:18.039476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:18.039476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:18.039476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:18.039476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:18.039476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:18.039476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:18.039476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:18.039476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:18.039476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:18.040460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:18.040460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:18.040460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:18.040460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:18.040460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:18.040460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:18.040460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:18.040460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:18.040460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:18.040460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:18.040460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:18.040460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:18.040460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:18.040460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:18.040460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:18.040460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:18.040460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:18.041326 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:18.041326 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:18.041326 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:18.048409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 352/699] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:18.050239 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00943592-eba5-4e24-8d46-4109545331b1 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:18.103551 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6384908-b9e8-4a0b-9c63-16cd6144f4c6 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:18.144135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6333649-228d-4cb9-8211-39523a10cc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:18.144763 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6333649-228d-4cb9-8211-39523a10cc59 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:18.146792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6333649-228d-4cb9-8211-39523a10cc59 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:18.146792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6333649-228d-4cb9-8211-39523a10cc59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:18.156384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:18.165681 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:18.173748 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6333649-228d-4cb9-8211-39523a10cc59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:18.175547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6333649-228d-4cb9-8211-39523a10cc59 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:18.194969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-d6333649-228d-4cb9-8211-39523a10cc59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:18.194969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:18.194969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:18.194969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:18.194969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:18.194969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:18.194969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:18.194969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:18.194969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:18.194969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:18.194969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:18.194969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:18.194969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:18.194969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:18.194969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:18.194969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:18.196143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:18.196143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:18.196143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:18.196143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:18.196143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:18.196143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:18.196143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:18.196143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:18.196143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:18.196143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:18.196143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:18.196143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:18.196143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:18.196143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:18.196143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:18.196143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:18.196143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:18.197025 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:18.197025 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:18.197025 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:18.197025 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 348/700] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:18.197255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6333649-228d-4cb9-8211-39523a10cc59 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:18.212090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00943592-eba5-4e24-8d46-4109545331b1 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:18.262430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587db29c-ed79-43e4-88db-3411da070dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:18.263069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587db29c-ed79-43e4-88db-3411da070dbf None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:18.263483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587db29c-ed79-43e4-88db-3411da070dbf None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:18.263765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587db29c-ed79-43e4-88db-3411da070dbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:18.271834 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587db29c-ed79-43e4-88db-3411da070dbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:18.273294 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587db29c-ed79-43e4-88db-3411da070dbf None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:18.290277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-587db29c-ed79-43e4-88db-3411da070dbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:18.290277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:18.290277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:18.290277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:18.290277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:18.290277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:18.290277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:18.290277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:18.290277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:18.290277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:18.290277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:18.290277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:18.290277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:18.290277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:18.290277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:18.291502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:18.291502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:18.291502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:18.291502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:18.291502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:18.291502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:18.291502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:18.291502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:18.291502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:18.291502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:18.291502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:18.291502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:18.291502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:18.291502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:18.291502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:18.291502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:18.291502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:18.292684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:18.292684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:18.292684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:18.292684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:18.292684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:18.292684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:18.292684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:18.292684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:18.296876 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 353/701] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:18.298848 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da603b41-589a-4059-832d-a40473b68b3d None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:18.299163 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da603b41-589a-4059-832d-a40473b68b3d None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:18.299728 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da603b41-589a-4059-832d-a40473b68b3d None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:18.304816 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 354/702] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:18.304816 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da603b41-589a-4059-832d-a40473b68b3d None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:18.360333 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6333649-228d-4cb9-8211-39523a10cc59 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:18.412583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ff62a-a049-4e34-8edb-473a8c53229d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:18.413608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ff62a-a049-4e34-8edb-473a8c53229d None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:18.413877 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ff62a-a049-4e34-8edb-473a8c53229d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:18.414162 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ff62a-a049-4e34-8edb-473a8c53229d None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:18.414822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ff62a-a049-4e34-8edb-473a8c53229d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:18.415133 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ff62a-a049-4e34-8edb-473a8c53229d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:18.416939 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ff62a-a049-4e34-8edb-473a8c53229d None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:18.430848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 349/703] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:18.431751 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ff62a-a049-4e34-8edb-473a8c53229d None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:18.436260 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da603b41-589a-4059-832d-a40473b68b3d None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:18.475744 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:18.484975 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d389bf-f746-4407-b7ff-8cf742d97c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:18.486070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d389bf-f746-4407-b7ff-8cf742d97c61 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:18.486566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d389bf-f746-4407-b7ff-8cf742d97c61 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:18.487131 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d389bf-f746-4407-b7ff-8cf742d97c61 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:18.488165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d389bf-f746-4407-b7ff-8cf742d97c61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:18.488786 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d389bf-f746-4407-b7ff-8cf742d97c61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:18.490663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d389bf-f746-4407-b7ff-8cf742d97c61 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:18.496023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:18.510955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 355/704] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:18.512496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55475764-51af-471e-9545-0f1345f692b7 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:18.512784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55475764-51af-471e-9545-0f1345f692b7 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:18.513062 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55475764-51af-471e-9545-0f1345f692b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:18.535356 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-55475764-51af-471e-9545-0f1345f692b7 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:18.536573 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-55475764-51af-471e-9545-0f1345f692b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:18.558133 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ff62a-a049-4e34-8edb-473a8c53229d None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:18.597069 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bfd56-5006-487a-ab94-1f63b9cd485f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:18.597706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bfd56-5006-487a-ab94-1f63b9cd485f None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:18.597987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bfd56-5006-487a-ab94-1f63b9cd485f None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:18.598280 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bfd56-5006-487a-ab94-1f63b9cd485f None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:18.599019 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41bfd56-5006-487a-ab94-1f63b9cd485f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:18.599319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41bfd56-5006-487a-ab94-1f63b9cd485f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:18.600782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41bfd56-5006-487a-ab94-1f63b9cd485f None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:18.614656 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 350/705] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:18.614823 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 356/706] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:32:18.615718 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55475764-51af-471e-9545-0f1345f692b7 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:18.620298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bfd56-5006-487a-ab94-1f63b9cd485f None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:18.741527 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55475764-51af-471e-9545-0f1345f692b7 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:18.748479 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bfd56-5006-487a-ab94-1f63b9cd485f None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:18.752181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:18.763299 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:18.783395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa674e-54ea-44eb-b13d-07af3f31e38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:18.784816 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa674e-54ea-44eb-b13d-07af3f31e38f None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:18.785097 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa674e-54ea-44eb-b13d-07af3f31e38f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:18.785371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa674e-54ea-44eb-b13d-07af3f31e38f None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:18.786051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa674e-54ea-44eb-b13d-07af3f31e38f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:18.787471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa674e-54ea-44eb-b13d-07af3f31e38f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:18.796643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3fc2c-b9d5-472c-8059-0ef26755935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:18.797922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3fc2c-b9d5-472c-8059-0ef26755935e None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:18.798893 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3fc2c-b9d5-472c-8059-0ef26755935e None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:18.799903 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3fc2c-b9d5-472c-8059-0ef26755935e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:18.810653 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3fc2c-b9d5-472c-8059-0ef26755935e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:18.812448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3fc2c-b9d5-472c-8059-0ef26755935e None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:18.812796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 357/707] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 09:32:18 2022] POST /identity/v3/users => generated 254 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:32:18.819027 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba2a9d-fcc2-4690-b0f4-daa9c9dd6910 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:18.819307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba2a9d-fcc2-4690-b0f4-daa9c9dd6910 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:18.819579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba2a9d-fcc2-4690-b0f4-daa9c9dd6910 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:18.827591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-c7c3fc2c-b9d5-472c-8059-0ef26755935e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:18.827591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:18.827591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:18.827591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:18.827591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:18.827591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:18.827591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:18.827591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:18.827591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:18.827591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:18.827591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:18.827591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:18.827591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:18.827591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:18.827591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:18.828538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:18.828538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:18.828538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:18.828538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:18.828538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:18.828538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:18.828538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:18.828538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:18.828538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:18.828538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:18.828538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:18.828538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:18.828538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:18.828538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:18.828538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:18.828538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:18.828538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:18.829432 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:18.829432 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:18.829432 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:18.829432 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:18.829432 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:18.829432 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:18.829432 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:18.829432 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:18.834663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 358/708] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:18 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:18.834663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba2a9d-fcc2-4690-b0f4-daa9c9dd6910 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:18.836774 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 351/709] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:18.838371 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b212f-bb94-48d1-8730-80764a64064c None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:18.838858 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b212f-bb94-48d1-8730-80764a64064c None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:18.839332 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b212f-bb94-48d1-8730-80764a64064c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:18.860194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-865b212f-bb94-48d1-8730-80764a64064c None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:18.862421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-865b212f-bb94-48d1-8730-80764a64064c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:18.967727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 352/710] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:32:18.968787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b212f-bb94-48d1-8730-80764a64064c None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:19.029271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba2a9d-fcc2-4690-b0f4-daa9c9dd6910 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:19.072907 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f763204-eaca-4fc3-be3a-a5f5721a7412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:19.074921 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f763204-eaca-4fc3-be3a-a5f5721a7412 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:19.074921 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f763204-eaca-4fc3-be3a-a5f5721a7412 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:19.074921 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f763204-eaca-4fc3-be3a-a5f5721a7412 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:19.075581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f763204-eaca-4fc3-be3a-a5f5721a7412 None admin] RBAC: Adding query filter params (role.id=85dac7b70cf04091baaf69caabd27a8b, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=ff2db35b94c84ec7bba96117d23baf6b) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:19.075892 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f763204-eaca-4fc3-be3a-a5f5721a7412 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:19.078282 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f763204-eaca-4fc3-be3a-a5f5721a7412 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:19.091019 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 359/711] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:32:18 2022] GET /identity/v3/role_assignments?user.id=ff2db35b94c84ec7bba96117d23baf6b&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=85dac7b70cf04091baaf69caabd27a8b => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:19.091896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f763204-eaca-4fc3-be3a-a5f5721a7412 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:19.106857 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:19.112539 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b212f-bb94-48d1-8730-80764a64064c None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:19.138672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:19.167346 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bf440-4407-484b-9e86-9004da5d7983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:19.168276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bf440-4407-484b-9e86-9004da5d7983 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:19.168705 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bf440-4407-484b-9e86-9004da5d7983 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:19.169127 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bf440-4407-484b-9e86-9004da5d7983 None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:19.170031 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bf440-4407-484b-9e86-9004da5d7983 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:19.172271 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bf440-4407-484b-9e86-9004da5d7983 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:19.174023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bf440-4407-484b-9e86-9004da5d7983 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:19.188649 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 353/712] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:19.201494 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bf440-4407-484b-9e86-9004da5d7983 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:19.282985 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f763204-eaca-4fc3-be3a-a5f5721a7412 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:19.338183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82ad5c-c563-41ca-aa08-b3c2975ad290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:19.339394 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82ad5c-c563-41ca-aa08-b3c2975ad290 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:19.339394 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82ad5c-c563-41ca-aa08-b3c2975ad290 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:19.339571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82ad5c-c563-41ca-aa08-b3c2975ad290 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:19.341056 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82ad5c-c563-41ca-aa08-b3c2975ad290 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:19.341585 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82ad5c-c563-41ca-aa08-b3c2975ad290 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:19.374362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-3e82ad5c-c563-41ca-aa08-b3c2975ad290 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:32:19.374362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:19.374362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:32:19.374362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:32:19.374362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:32:19.374362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:32:19.374362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:32:19.374362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:19.374362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:32:19.374362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:19.374362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:19.374362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:19.374362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:19.374362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:19.374362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:19.374362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:19.374362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:19.375642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:19.375642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:19.375642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:19.375642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:19.375642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:19.375642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:19.375642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:32:19.375642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:32:19.375642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:32:19.375642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:32:19.375642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:19.375642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:19.375642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:19.375642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:19.375642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:19.375642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:19.376610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:19.376610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:19.376610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:19.376610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:19.376610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:19.376610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:19.376610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:19.376610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:19.376610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:19.376610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:19.376610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:32:19.376610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:19.376610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:32:19.376610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:19.376610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 360/713] 10.222.0.58 () {56 vars in 1129 bytes} [Wed Aug 24 09:32:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:19.378396 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82ad5c-c563-41ca-aa08-b3c2975ad290 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:19.456201 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bf440-4407-484b-9e86-9004da5d7983 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:19.531169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640e6e4-1f34-4f56-905a-aba782746698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:19.532032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:19.534446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640e6e4-1f34-4f56-905a-aba782746698 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:19.536733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640e6e4-1f34-4f56-905a-aba782746698 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:19.537037 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640e6e4-1f34-4f56-905a-aba782746698 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:19.538294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640e6e4-1f34-4f56-905a-aba782746698 None admin] RBAC: Adding query filter params (role.id=cd2effe8340d4be08a28d3a40db6979d, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=18be8c54c9644c5e9812eea09e60c11c) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:19.538836 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640e6e4-1f34-4f56-905a-aba782746698 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:19.541149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640e6e4-1f34-4f56-905a-aba782746698 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:19.551497 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82ad5c-c563-41ca-aa08-b3c2975ad290 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:19.564081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 354/714] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:32:19 2022] GET /identity/v3/role_assignments?user.id=18be8c54c9644c5e9812eea09e60c11c&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=cd2effe8340d4be08a28d3a40db6979d => generated 259 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:19.565503 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640e6e4-1f34-4f56-905a-aba782746698 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:19.608902 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:19.618476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879b91f-d8de-4c97-bf28-cb7e0b90e0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:19.619517 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879b91f-d8de-4c97-bf28-cb7e0b90e0c6 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:19.619961 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879b91f-d8de-4c97-bf28-cb7e0b90e0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:19.620415 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879b91f-d8de-4c97-bf28-cb7e0b90e0c6 None admin] PATH_INFO: `/v3/services/network` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:19.629493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879b91f-d8de-4c97-bf28-cb7e0b90e0c6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:19.631533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d879b91f-d8de-4c97-bf28-cb7e0b90e0c6 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:19.653498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-d879b91f-d8de-4c97-bf28-cb7e0b90e0c6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:32:19.653498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:19.653498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:32:19.653498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:32:19.653498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:32:19.653498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:32:19.653498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:32:19.653498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:19.653498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:32:19.653498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:19.653498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:19.653498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:19.653498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:19.653498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:19.653498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:19.653498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:19.653498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:19.654541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:19.654541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:19.654541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:19.654541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:19.654541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:19.654541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:19.654541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:32:19.654541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:32:19.654541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:32:19.654541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:32:19.654541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:19.654541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:19.654541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:19.654541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:19.654541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:19.654541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:19.655359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:19.655359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:19.655359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:19.655359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:19.655359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:19.655359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:19.655359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:19.655359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:19.655359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:19.655359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:19.655359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:32:19.655359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:19.655359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:32:19.655359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:19.656071 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 361/715] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:19 2022] GET /identity/v3/services/network => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:19.664690 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879b91f-d8de-4c97-bf28-cb7e0b90e0c6 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:19.711012 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640e6e4-1f34-4f56-905a-aba782746698 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:19.764283 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd4db9-a9c6-458c-90bd-79cacedeba2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:19.764946 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd4db9-a9c6-458c-90bd-79cacedeba2e None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:19.766812 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd4db9-a9c6-458c-90bd-79cacedeba2e None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:19.767180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd4db9-a9c6-458c-90bd-79cacedeba2e None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:19.768451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd4db9-a9c6-458c-90bd-79cacedeba2e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:19.769003 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd4db9-a9c6-458c-90bd-79cacedeba2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:19.770825 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd4db9-a9c6-458c-90bd-79cacedeba2e None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:19.777153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 355/716] 10.222.0.58 () {56 vars in 1124 bytes} [Wed Aug 24 09:32:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:19.785167 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd4db9-a9c6-458c-90bd-79cacedeba2e None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:19.901508 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:19.907391 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd4db9-a9c6-458c-90bd-79cacedeba2e None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:19.923521 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879b91f-d8de-4c97-bf28-cb7e0b90e0c6 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:19.960849 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592ff53-c65e-4ee6-ac41-4223644cc2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:19.961555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592ff53-c65e-4ee6-ac41-4223644cc2b8 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:19.962121 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592ff53-c65e-4ee6-ac41-4223644cc2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:19.962466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592ff53-c65e-4ee6-ac41-4223644cc2b8 None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:19.963110 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592ff53-c65e-4ee6-ac41-4223644cc2b8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:19.963415 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592ff53-c65e-4ee6-ac41-4223644cc2b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:19.964876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592ff53-c65e-4ee6-ac41-4223644cc2b8 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:19.972392 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 356/717] 10.222.0.58 () {56 vars in 1124 bytes} [Wed Aug 24 09:32:19 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:20.058367 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836147f-9fb1-4dd2-80d4-c220fb616ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:20.059559 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836147f-9fb1-4dd2-80d4-c220fb616ffe None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:20.059992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836147f-9fb1-4dd2-80d4-c220fb616ffe None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:20.060418 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836147f-9fb1-4dd2-80d4-c220fb616ffe None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:20.061235 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836147f-9fb1-4dd2-80d4-c220fb616ffe None admin] RBAC: Adding query filter params (name=network) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:20.061737 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836147f-9fb1-4dd2-80d4-c220fb616ffe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:20.063265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836147f-9fb1-4dd2-80d4-c220fb616ffe None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:20.079913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 362/718] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 09:32:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:20.088172 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592ff53-c65e-4ee6-ac41-4223644cc2b8 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:20.289636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592ff53-c65e-4ee6-ac41-4223644cc2b8 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:20.335681 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33789eb3-59d0-4768-a682-d03827c44676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:20.336663 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33789eb3-59d0-4768-a682-d03827c44676 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:20.337146 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33789eb3-59d0-4768-a682-d03827c44676 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:20.337660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33789eb3-59d0-4768-a682-d03827c44676 None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:20.338517 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33789eb3-59d0-4768-a682-d03827c44676 None admin] RBAC: Adding query filter params (type=network) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:20.339032 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33789eb3-59d0-4768-a682-d03827c44676 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:20.340598 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33789eb3-59d0-4768-a682-d03827c44676 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:20.346376 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 357/719] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 09:32:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:21.550521 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42881538-2c0a-4130-b75b-8832f0027c0c None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:21.551018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42881538-2c0a-4130-b75b-8832f0027c0c None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:21.551018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42881538-2c0a-4130-b75b-8832f0027c0c None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:21.552356 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 363/720] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:21.561441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a347242-706c-4534-9548-19e3a7f8073c None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:21.561441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a347242-706c-4534-9548-19e3a7f8073c None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:21.561441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a347242-706c-4534-9548-19e3a7f8073c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:21.587172 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-8a347242-706c-4534-9548-19e3a7f8073c None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:21.588897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-8a347242-706c-4534-9548-19e3a7f8073c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:21.604898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:21.682154 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 358/721] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:32:22.043517 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42881538-2c0a-4130-b75b-8832f0027c0c None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:22.088470 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:22.117140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3ff72-2818-4a31-812d-c761609617ac None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:22.117327 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3ff72-2818-4a31-812d-c761609617ac None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:22.117633 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3ff72-2818-4a31-812d-c761609617ac None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:22.119118 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 359/722] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:22.130740 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c9810-fb5b-4952-946f-e561cffb7417 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:22.131023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c9810-fb5b-4952-946f-e561cffb7417 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:22.131313 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c9810-fb5b-4952-946f-e561cffb7417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:22.176758 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-2f6c9810-fb5b-4952-946f-e561cffb7417 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:22.178008 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-2f6c9810-fb5b-4952-946f-e561cffb7417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:22.317225 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42881538-2c0a-4130-b75b-8832f0027c0c None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:22.376013 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d013c4-2603-4d5d-96db-3b719fa76c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:22.377427 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d013c4-2603-4d5d-96db-3b719fa76c48 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:22.381558 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d013c4-2603-4d5d-96db-3b719fa76c48 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:22.382197 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d013c4-2603-4d5d-96db-3b719fa76c48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:22.398322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d013c4-2603-4d5d-96db-3b719fa76c48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:32:22.410876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 360/723] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:32:22.411888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-42d013c4-2603-4d5d-96db-3b719fa76c48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:22.411888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:22.411888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:22.411888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:22.411888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:22.411888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:22.411888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:22.411888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:22.411888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:22.411888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:22.411888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:22.411888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:22.411888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:32:22.411888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:32:22.411888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:32:22.411888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:32:22.412946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:32:22.412946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:32:22.412946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:32:22.412946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:32:22.412946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:22.412946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:22.412946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:22.412946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:22.412946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:22.412946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:22.412946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:22.412946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:22.412946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:22.412946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:22.412946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:22.412946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:22.413889 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:22.413889 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:22.413889 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:22.413889 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:22.413889 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:32:22.413889 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:32:22.413889 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:32:22.413889 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:32:22.413889 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:32:22.413889 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:32:22.413889 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:22.413889 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:22.416779 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 364/724] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:32:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:22.422851 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c9810-fb5b-4952-946f-e561cffb7417 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:22.592460 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:22.612833 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1caa2cb-ce22-4817-8655-2c2f0916bcaf None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:22.614705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1caa2cb-ce22-4817-8655-2c2f0916bcaf None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:22.615238 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1caa2cb-ce22-4817-8655-2c2f0916bcaf None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:22.616798 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 365/725] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:32:22.622254 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52f4ca-6120-49ce-b915-51b7d858cdd2 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:22.622785 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52f4ca-6120-49ce-b915-51b7d858cdd2 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:22.623258 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52f4ca-6120-49ce-b915-51b7d858cdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:22.627780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c9810-fb5b-4952-946f-e561cffb7417 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:22.644931 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-0c52f4ca-6120-49ce-b915-51b7d858cdd2 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:22.646790 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-0c52f4ca-6120-49ce-b915-51b7d858cdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:22.710205 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4033e4-129e-457a-8652-8f8c6cb0cfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:22.710821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4033e4-129e-457a-8652-8f8c6cb0cfdb None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:22.711124 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4033e4-129e-457a-8652-8f8c6cb0cfdb None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:22.711359 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4033e4-129e-457a-8652-8f8c6cb0cfdb None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:22.712037 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4033e4-129e-457a-8652-8f8c6cb0cfdb None admin] RBAC: Adding query filter params (name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:22.712341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4033e4-129e-457a-8652-8f8c6cb0cfdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:22.713736 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4033e4-129e-457a-8652-8f8c6cb0cfdb None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:22.737262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 361/726] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 09:32:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:22.745416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4033e4-129e-457a-8652-8f8c6cb0cfdb None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:22.773030 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 366/727] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 09:32:22.773030 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52f4ca-6120-49ce-b915-51b7d858cdd2 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:22.788063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:22.992568 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52f4ca-6120-49ce-b915-51b7d858cdd2 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:23.062167 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4033e4-129e-457a-8652-8f8c6cb0cfdb None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:23.073230 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a61379-8140-4e37-a66c-709101de3933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:23.074169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a61379-8140-4e37-a66c-709101de3933 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:23.074650 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a61379-8140-4e37-a66c-709101de3933 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:23.075709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a61379-8140-4e37-a66c-709101de3933 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:23.093965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a61379-8140-4e37-a66c-709101de3933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:23.095636 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a61379-8140-4e37-a66c-709101de3933 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:23.112204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-29a61379-8140-4e37-a66c-709101de3933 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:23.112204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:23.112204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:23.112204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:23.112204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:23.112204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:23.112204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:23.112204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:23.112204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:23.112204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:23.112204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:23.112204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:23.112204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:23.112204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:23.112204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:23.112204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:23.113164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:23.113164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:23.113164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:23.113164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:23.113164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:23.113164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:23.113164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:23.113164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:23.113164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:23.113164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:23.113164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:23.113164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:23.113164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:23.113164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:23.113164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:23.113164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:23.113164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:23.114095 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:23.114095 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:23.114095 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:23.118205 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 367/728] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:23.119527 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc0433-5f8d-4946-8e49-a997f5cbfd35 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:23.119819 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc0433-5f8d-4946-8e49-a997f5cbfd35 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:23.120100 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc0433-5f8d-4946-8e49-a997f5cbfd35 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:23.121647 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 368/729] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:23.122192 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc0433-5f8d-4946-8e49-a997f5cbfd35 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:23.146079 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fa2a0-a1f8-4416-a1ef-dee281cdbf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:23.146958 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fa2a0-a1f8-4416-a1ef-dee281cdbf50 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:23.147333 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fa2a0-a1f8-4416-a1ef-dee281cdbf50 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:23.147643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fa2a0-a1f8-4416-a1ef-dee281cdbf50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:23.162776 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:23.170334 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6fa2a0-a1f8-4416-a1ef-dee281cdbf50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:32:23.175669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-2d6fa2a0-a1f8-4416-a1ef-dee281cdbf50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:32:23.175669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:23.175669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:23.175669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:23.175669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:23.175669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:23.175669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:23.175669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:23.175669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:23.175669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:23.175669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:23.175669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:23.175669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:32:23.175669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:32:23.175669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:32:23.175669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:32:23.176577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:32:23.176577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:32:23.176577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:32:23.176577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:32:23.176577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:23.176577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:23.176577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:23.176577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:23.176577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:23.176577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:23.176577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:23.176577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:23.176577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:23.176577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:23.176577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:23.176577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:23.177413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:23.177413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:23.177413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:23.177413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:23.177413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:32:23.177413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:32:23.177413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:32:23.177413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:32:23.177413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:32:23.177413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:32:23.177413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:32:23.177413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:23.177413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 362/730] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:32:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:23.178145 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fa2a0-a1f8-4416-a1ef-dee281cdbf50 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:23.208925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:23.291324 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fa2a0-a1f8-4416-a1ef-dee281cdbf50 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:23.327593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91840da5-61f0-48b6-80f2-290e23db5866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:23.328205 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91840da5-61f0-48b6-80f2-290e23db5866 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:23.328481 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91840da5-61f0-48b6-80f2-290e23db5866 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:23.328754 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91840da5-61f0-48b6-80f2-290e23db5866 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:23.329404 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91840da5-61f0-48b6-80f2-290e23db5866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:23.329736 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91840da5-61f0-48b6-80f2-290e23db5866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:23.331218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91840da5-61f0-48b6-80f2-290e23db5866 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:23.343389 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 363/731] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:23.344613 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad573d-3343-40a4-81e6-aa493d2d239d None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:23.344894 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad573d-3343-40a4-81e6-aa493d2d239d None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:23.345168 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad573d-3343-40a4-81e6-aa493d2d239d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:23.364984 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-46ad573d-3343-40a4-81e6-aa493d2d239d None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:23.366366 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-46ad573d-3343-40a4-81e6-aa493d2d239d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:23.374754 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc0433-5f8d-4946-8e49-a997f5cbfd35 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:23.424609 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b6a8b-f0a2-4ee9-84cd-2a8e3d3cab78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:23.425256 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b6a8b-f0a2-4ee9-84cd-2a8e3d3cab78 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:23.425555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b6a8b-f0a2-4ee9-84cd-2a8e3d3cab78 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:23.425830 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b6a8b-f0a2-4ee9-84cd-2a8e3d3cab78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:23.428726 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:23.443631 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 364/732] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:32:23.444767 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad573d-3343-40a4-81e6-aa493d2d239d None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:23.447056 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b6a8b-f0a2-4ee9-84cd-2a8e3d3cab78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:32:23.451955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-589b6a8b-f0a2-4ee9-84cd-2a8e3d3cab78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:32:23.451955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:23.451955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:23.451955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:23.451955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:23.451955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:23.451955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:23.451955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:23.451955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:23.451955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:23.451955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:23.451955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:23.451955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:32:23.451955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:32:23.451955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:32:23.451955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:32:23.452856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:32:23.452856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:32:23.452856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:32:23.452856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:32:23.452856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:23.452856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:23.452856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:23.452856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:23.452856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:23.452856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:23.452856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:23.452856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:23.452856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:23.452856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:23.452856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:23.452856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:23.453729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:23.453729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:23.453729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:23.453729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:23.453729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:32:23.453729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:32:23.453729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:32:23.453729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:32:23.453729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:32:23.453729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:32:23.453729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:32:23.453729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:23.453729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 369/733] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:32:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:23.455959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50cb8b-9b40-4bc8-a4fd-c84e2ade888e None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:23.456355 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50cb8b-9b40-4bc8-a4fd-c84e2ade888e None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:23.456730 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50cb8b-9b40-4bc8-a4fd-c84e2ade888e None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:23.461929 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 370/734] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:23.461929 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50cb8b-9b40-4bc8-a4fd-c84e2ade888e None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:23.578080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad573d-3343-40a4-81e6-aa493d2d239d None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:23.600758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50cb8b-9b40-4bc8-a4fd-c84e2ade888e None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:23.629259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:23.633037 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b96bc-f0e6-41df-93e7-db4f758a6658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:23.633878 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b96bc-f0e6-41df-93e7-db4f758a6658 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:23.634243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b96bc-f0e6-41df-93e7-db4f758a6658 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:23.634687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b96bc-f0e6-41df-93e7-db4f758a6658 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:23.635304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b96bc-f0e6-41df-93e7-db4f758a6658 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:23.635670 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b96bc-f0e6-41df-93e7-db4f758a6658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:23.637161 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b96bc-f0e6-41df-93e7-db4f758a6658 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:23.649447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637606c-47cb-4c3f-9d5e-777416d64459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:23.650100 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637606c-47cb-4c3f-9d5e-777416d64459 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:23.650381 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637606c-47cb-4c3f-9d5e-777416d64459 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:23.650648 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637606c-47cb-4c3f-9d5e-777416d64459 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:23.651288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 365/735] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:32:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:23.652148 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b96bc-f0e6-41df-93e7-db4f758a6658 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:23.669661 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637606c-47cb-4c3f-9d5e-777416d64459 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:23.671266 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637606c-47cb-4c3f-9d5e-777416d64459 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:23.683670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-4637606c-47cb-4c3f-9d5e-777416d64459 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:32:23.683670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:23.683670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:23.683670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:23.683670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:23.683670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:23.683670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:23.683670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:23.683670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:23.683670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:23.683670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:23.683670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:23.683670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:23.683670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:23.683670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:23.683670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:23.684622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:23.684622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:23.684622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:23.684622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:23.684622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:23.684622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:23.684622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:23.684622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:23.684622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:23.684622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:23.684622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:23.684622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:23.684622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:23.684622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:23.684622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:23.684622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:23.684622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:23.684622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:23.686136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:23.686136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:23.686136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:23.686136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:23.686136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:23.686136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:23.686136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:23.686136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:23.686136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:32:23.686136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:23.686136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 371/736] 10.222.0.58 () {56 vars in 1117 bytes} [Wed Aug 24 09:32:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:23.686752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688eb9d-8787-4edd-b6bd-826622653ec1 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:23.686752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688eb9d-8787-4edd-b6bd-826622653ec1 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:23.686752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688eb9d-8787-4edd-b6bd-826622653ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:23.706459 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-b688eb9d-8787-4edd-b6bd-826622653ec1 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:23.708223 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-b688eb9d-8787-4edd-b6bd-826622653ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:23.718553 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:23.776155 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b96bc-f0e6-41df-93e7-db4f758a6658 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:23.784821 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 372/737] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 09:32:23.785695 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688eb9d-8787-4edd-b6bd-826622653ec1 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:23.815967 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a83d5-dd7f-445b-bdb4-2691e306e95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:23.816571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a83d5-dd7f-445b-bdb4-2691e306e95f None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:23.816851 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a83d5-dd7f-445b-bdb4-2691e306e95f None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:23.817125 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a83d5-dd7f-445b-bdb4-2691e306e95f None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:23.817826 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a83d5-dd7f-445b-bdb4-2691e306e95f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:23.818129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a83d5-dd7f-445b-bdb4-2691e306e95f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:23.819505 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a83d5-dd7f-445b-bdb4-2691e306e95f None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:23.832480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 366/738] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:32:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:23.832480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a83d5-dd7f-445b-bdb4-2691e306e95f None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:23.900844 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688eb9d-8787-4edd-b6bd-826622653ec1 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:23.915136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:23.936801 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a83d5-dd7f-445b-bdb4-2691e306e95f None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:23.938450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cddc4-5401-44eb-b3fd-a65cd6c4198a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:23.939072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cddc4-5401-44eb-b3fd-a65cd6c4198a None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:23.940222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cddc4-5401-44eb-b3fd-a65cd6c4198a None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:23.940222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377cddc4-5401-44eb-b3fd-a65cd6c4198a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:23.950528 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:23.951091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377cddc4-5401-44eb-b3fd-a65cd6c4198a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:23.952630 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377cddc4-5401-44eb-b3fd-a65cd6c4198a None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:23.968464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-377cddc4-5401-44eb-b3fd-a65cd6c4198a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:23.968464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:23.968464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:23.968464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:23.968464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:23.968464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:23.968464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:23.968464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:23.968464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:23.968464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:23.968464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:23.968464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:23.968464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:23.968464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:23.968464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:23.968464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:23.969414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:23.969414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:23.969414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:23.969414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:23.969414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:23.969414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:23.969414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:23.969414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:23.969414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:23.969414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:23.969414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:23.969414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:23.969414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:23.969414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:23.969414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:23.969414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:23.969414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:23.970357 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:23.970357 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:23.970357 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:23.970357 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 373/739] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:23.970357 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cddc4-5401-44eb-b3fd-a65cd6c4198a None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:23.978082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b4a3f-0d2d-4531-915f-ec5ae6dbbaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:23.978689 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b4a3f-0d2d-4531-915f-ec5ae6dbbaa4 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:23.978971 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b4a3f-0d2d-4531-915f-ec5ae6dbbaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:23.979245 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b4a3f-0d2d-4531-915f-ec5ae6dbbaa4 None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:23.979965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b4a3f-0d2d-4531-915f-ec5ae6dbbaa4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:23.980271 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b4a3f-0d2d-4531-915f-ec5ae6dbbaa4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:23.981715 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b4a3f-0d2d-4531-915f-ec5ae6dbbaa4 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:24.001986 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 367/740] 10.222.0.58 () {56 vars in 1149 bytes} [Wed Aug 24 09:32:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:24.002841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b4a3f-0d2d-4531-915f-ec5ae6dbbaa4 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:24.084122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377cddc4-5401-44eb-b3fd-a65cd6c4198a None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:24.107173 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b4a3f-0d2d-4531-915f-ec5ae6dbbaa4 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:24.118183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2637960-a263-473f-82d4-e1d20c61d472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:24.118805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2637960-a263-473f-82d4-e1d20c61d472 None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:24.119055 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2637960-a263-473f-82d4-e1d20c61d472 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:24.119326 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2637960-a263-473f-82d4-e1d20c61d472 None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:24.119964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2637960-a263-473f-82d4-e1d20c61d472 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:24.121327 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2637960-a263-473f-82d4-e1d20c61d472 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:24.136340 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 374/741] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 09:32:23 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:32:24.137141 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2637960-a263-473f-82d4-e1d20c61d472 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:24.159403 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17fa2d-df41-4748-853a-6a781e5a2524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:24.160149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17fa2d-df41-4748-853a-6a781e5a2524 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:24.160433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17fa2d-df41-4748-853a-6a781e5a2524 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:24.160704 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17fa2d-df41-4748-853a-6a781e5a2524 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:24.168230 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:24.173179 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17fa2d-df41-4748-853a-6a781e5a2524 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:24.175308 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17fa2d-df41-4748-853a-6a781e5a2524 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:24.192803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-fe17fa2d-df41-4748-853a-6a781e5a2524 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:24.192803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:24.192803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:24.192803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:24.192803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:24.192803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:24.192803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:24.192803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:24.192803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:24.192803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:24.192803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:24.192803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:24.192803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:24.192803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:24.192803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:24.192803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:24.193848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:24.193848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:24.193848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:24.193848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:24.193848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:24.193848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:24.193848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:24.193848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:24.193848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:24.193848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:24.193848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:24.193848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:24.193848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:24.193848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:24.193848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:24.193848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:24.193848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:24.194753 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:24.194753 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:24.194753 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:24.194753 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 368/742] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:24.195567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17fa2d-df41-4748-853a-6a781e5a2524 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:24.219240 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:24.266276 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2637960-a263-473f-82d4-e1d20c61d472 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:24.327953 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f157d-8e5b-40df-9860-4dbdc15eb95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:24.328570 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f157d-8e5b-40df-9860-4dbdc15eb95f None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:24.328845 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f157d-8e5b-40df-9860-4dbdc15eb95f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:24.329116 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f157d-8e5b-40df-9860-4dbdc15eb95f None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:24.329849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f157d-8e5b-40df-9860-4dbdc15eb95f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:24.330150 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f157d-8e5b-40df-9860-4dbdc15eb95f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:24.332108 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f157d-8e5b-40df-9860-4dbdc15eb95f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:24.336145 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17fa2d-df41-4748-853a-6a781e5a2524 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:24.348286 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 375/743] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:24.349219 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f157d-8e5b-40df-9860-4dbdc15eb95f None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:24.379231 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265afb75-d1cb-4690-9ecc-0b00d47d1cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:24.379850 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265afb75-d1cb-4690-9ecc-0b00d47d1cdb None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:24.380152 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265afb75-d1cb-4690-9ecc-0b00d47d1cdb None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:24.380402 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265afb75-d1cb-4690-9ecc-0b00d47d1cdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:24.461844 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:24.468790 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265afb75-d1cb-4690-9ecc-0b00d47d1cdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:24.470624 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265afb75-d1cb-4690-9ecc-0b00d47d1cdb None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:24.483101 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f157d-8e5b-40df-9860-4dbdc15eb95f None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:24.491818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:24.528093 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff170c-12c6-4278-8e5c-f6f045821db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:24.528794 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff170c-12c6-4278-8e5c-f6f045821db3 None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:24.529140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff170c-12c6-4278-8e5c-f6f045821db3 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:24.529496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff170c-12c6-4278-8e5c-f6f045821db3 None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:24.530391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff170c-12c6-4278-8e5c-f6f045821db3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:24.532057 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff170c-12c6-4278-8e5c-f6f045821db3 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:24.552312 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 376/744] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 09:32:24 2022] POST /identity/v3/services => generated 240 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:32:24.553080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff170c-12c6-4278-8e5c-f6f045821db3 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:24.608910 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 369/745] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:32:24 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:24.609921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265afb75-d1cb-4690-9ecc-0b00d47d1cdb None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:24.702346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff170c-12c6-4278-8e5c-f6f045821db3 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:24.745308 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265afb75-d1cb-4690-9ecc-0b00d47d1cdb None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:24.747648 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99afdd-7ba1-49a3-be2d-c4e8977dec99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:24.748576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99afdd-7ba1-49a3-be2d-c4e8977dec99 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:24.749712 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99afdd-7ba1-49a3-be2d-c4e8977dec99 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:24.750189 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99afdd-7ba1-49a3-be2d-c4e8977dec99 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:24.751090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99afdd-7ba1-49a3-be2d-c4e8977dec99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:24.751608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99afdd-7ba1-49a3-be2d-c4e8977dec99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:24.753875 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99afdd-7ba1-49a3-be2d-c4e8977dec99 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:24.763736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:24.772012 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 377/746] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:24.772012 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99afdd-7ba1-49a3-be2d-c4e8977dec99 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:24.772249 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:24.796527 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af5552-8906-4280-97f5-76e68a075958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:24.797178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af5552-8906-4280-97f5-76e68a075958 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:24.797441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af5552-8906-4280-97f5-76e68a075958 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:24.797760 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af5552-8906-4280-97f5-76e68a075958 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:24.806988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af5552-8906-4280-97f5-76e68a075958 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:24.808366 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af5552-8906-4280-97f5-76e68a075958 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:24.823506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-92af5552-8906-4280-97f5-76e68a075958 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:32:24.823506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:24.823506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:24.823506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:24.823506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:24.823506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:24.823506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:24.823506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:24.823506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:24.823506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:24.823506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:24.823506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:24.823506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:24.823506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:24.823506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:24.823506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:24.824518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:24.824518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:24.824518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:24.824518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:24.824518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:24.824518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:24.824518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:24.824518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:24.824518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:24.824518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:24.824518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:24.824518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:24.824518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:24.824518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:24.824518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:24.824518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:24.824518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:24.824518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:24.826063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:24.826063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:24.826063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:24.826063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:24.826063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:24.826063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:24.826063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:24.826063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:24.826063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:32:24.826063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:24.826063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 370/747] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:32:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:24.826063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af5552-8906-4280-97f5-76e68a075958 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:24.912586 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99afdd-7ba1-49a3-be2d-c4e8977dec99 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:24.934159 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af5552-8906-4280-97f5-76e68a075958 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:24.959353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac02350-59e7-4912-a41b-0cd1a3bc4437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:24.959978 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac02350-59e7-4912-a41b-0cd1a3bc4437 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:24.960249 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac02350-59e7-4912-a41b-0cd1a3bc4437 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:24.960517 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac02350-59e7-4912-a41b-0cd1a3bc4437 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:24.972767 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac02350-59e7-4912-a41b-0cd1a3bc4437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:24.976161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac02350-59e7-4912-a41b-0cd1a3bc4437 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:24.989634 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2141fd-9a87-4111-b6a6-17e96facc97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:24.990583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2141fd-9a87-4111-b6a6-17e96facc97f None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:24.991029 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2141fd-9a87-4111-b6a6-17e96facc97f None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:24.991469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2141fd-9a87-4111-b6a6-17e96facc97f None admin] PATH_INFO: `/v3/users/nova` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:24.995090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-0ac02350-59e7-4912-a41b-0cd1a3bc4437 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:24.995090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:24.995090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:24.995090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:24.995090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:24.995090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:24.995090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:24.995090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:24.995090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:24.995090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:24.995090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:24.995090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:24.995090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:24.995090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:24.995090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:24.995090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:24.996248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:24.996248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:24.996248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:24.996248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:24.996248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:24.996248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:24.996248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:24.996248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:24.996248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:24.996248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:24.996248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:24.996248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:24.996248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:24.996248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:24.996248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:24.996248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:24.996248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:24.997344 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:24.997344 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:24.997344 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:24.998573 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 378/748] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:24.999523 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac02350-59e7-4912-a41b-0cd1a3bc4437 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:25.003403 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2141fd-9a87-4111-b6a6-17e96facc97f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:25.006072 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2141fd-9a87-4111-b6a6-17e96facc97f None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:25.022073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-bb2141fd-9a87-4111-b6a6-17e96facc97f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:32:25.022073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:25.022073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:25.022073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:25.022073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:25.022073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:25.022073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:25.022073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:25.022073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:25.022073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:25.022073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:25.022073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:25.022073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:25.022073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:25.022073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:25.022073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:25.023217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:25.023217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:25.023217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:25.023217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:25.023217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:25.023217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:25.023217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:25.023217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:25.023217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:25.023217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:25.023217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:25.023217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:25.023217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:25.023217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:25.023217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:25.023217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:25.023217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:25.023217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:25.024180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:25.024180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:25.024180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:25.024180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:25.024180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:25.024180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:25.024180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:25.024180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:25.024180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:32:25.024180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:25.031478 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 371/749] 10.222.0.58 () {56 vars in 1093 bytes} [Wed Aug 24 09:32:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:25.031478 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2141fd-9a87-4111-b6a6-17e96facc97f None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:25.068535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:25.090134 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:25.124571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac02350-59e7-4912-a41b-0cd1a3bc4437 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:25.163003 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8fdbd-1a93-40c5-96be-6e959371fb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:25.163517 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8fdbd-1a93-40c5-96be-6e959371fb7f None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:25.163790 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8fdbd-1a93-40c5-96be-6e959371fb7f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:25.164113 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8fdbd-1a93-40c5-96be-6e959371fb7f None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:25.164888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8fdbd-1a93-40c5-96be-6e959371fb7f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:25.165251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8fdbd-1a93-40c5-96be-6e959371fb7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:25.166715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8fdbd-1a93-40c5-96be-6e959371fb7f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:25.181499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2141fd-9a87-4111-b6a6-17e96facc97f None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:25.192695 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 379/750] 10.222.0.58 () {56 vars in 1135 bytes} [Wed Aug 24 09:32:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:25.193654 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8fdbd-1a93-40c5-96be-6e959371fb7f None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:25.218010 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3c29a-d3d9-432d-9972-f20e604038d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:25.218891 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3c29a-d3d9-432d-9972-f20e604038d9 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:25.219321 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3c29a-d3d9-432d-9972-f20e604038d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:25.219743 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3c29a-d3d9-432d-9972-f20e604038d9 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:25.220532 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3c29a-d3d9-432d-9972-f20e604038d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:25.221561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3c29a-d3d9-432d-9972-f20e604038d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:25.226317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3c29a-d3d9-432d-9972-f20e604038d9 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:25.246316 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 372/751] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:25.247504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3c29a-d3d9-432d-9972-f20e604038d9 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:25.312307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8fdbd-1a93-40c5-96be-6e959371fb7f None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:25.324124 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:25.355455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04bb6c-46c8-4719-b05c-bafae10d8d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:25.355677 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04bb6c-46c8-4719-b05c-bafae10d8d10 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:25.355894 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04bb6c-46c8-4719-b05c-bafae10d8d10 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:25.356226 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04bb6c-46c8-4719-b05c-bafae10d8d10 None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:25.356995 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04bb6c-46c8-4719-b05c-bafae10d8d10 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:25.357310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04bb6c-46c8-4719-b05c-bafae10d8d10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:25.358988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04bb6c-46c8-4719-b05c-bafae10d8d10 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:25.360416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:25.365773 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3c29a-d3d9-432d-9972-f20e604038d9 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:25.379571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 380/752] 10.222.0.58 () {56 vars in 1133 bytes} [Wed Aug 24 09:32:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:25.380661 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04bb6c-46c8-4719-b05c-bafae10d8d10 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:25.402231 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bf78f-3fdb-41f4-bfb7-b01bafcf5dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:25.403168 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bf78f-3fdb-41f4-bfb7-b01bafcf5dee None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:25.403645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bf78f-3fdb-41f4-bfb7-b01bafcf5dee None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:25.404128 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bf78f-3fdb-41f4-bfb7-b01bafcf5dee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:25.473145 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bf78f-3fdb-41f4-bfb7-b01bafcf5dee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:25.474925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bf78f-3fdb-41f4-bfb7-b01bafcf5dee None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:25.493357 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04bb6c-46c8-4719-b05c-bafae10d8d10 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:25.531819 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ec455-ed65-4f13-84c5-583c9d8f104a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:25.532459 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ec455-ed65-4f13-84c5-583c9d8f104a None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:25.532734 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ec455-ed65-4f13-84c5-583c9d8f104a None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:25.533001 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ec455-ed65-4f13-84c5-583c9d8f104a None admin] PATH_INFO: `/v3/projects/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:25.541605 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ec455-ed65-4f13-84c5-583c9d8f104a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:25.543147 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ec455-ed65-4f13-84c5-583c9d8f104a None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:25.555373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-dd2ec455-ed65-4f13-84c5-583c9d8f104a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:25.555373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:25.555373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:25.555373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:25.555373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:25.555373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:25.555373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:25.555373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:25.555373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:25.555373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:25.555373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:25.555373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:25.555373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:25.555373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:25.555373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:25.556274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:25.556274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:25.556274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:25.556274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:25.556274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:25.556274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:25.556274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:25.556274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:25.556274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:25.556274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:25.556274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:25.556274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:25.556274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:25.556274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:25.556274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:25.556274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:25.556274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:25.557138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:25.557138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:25.557138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:25.557138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:25.557138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:25.557138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:25.557138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:25.557138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:25.561255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 381/753] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:25.562179 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ec455-ed65-4f13-84c5-583c9d8f104a None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:25.578066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:25.583978 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 373/754] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:32:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:32:25.585087 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bf78f-3fdb-41f4-bfb7-b01bafcf5dee None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:25.605519 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:25.693584 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bf78f-3fdb-41f4-bfb7-b01bafcf5dee None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:25.720360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ec455-ed65-4f13-84c5-583c9d8f104a None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:25.730854 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725141a-1289-49d7-be7b-e935d86c6c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:25.731776 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725141a-1289-49d7-be7b-e935d86c6c37 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:25.732309 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725141a-1289-49d7-be7b-e935d86c6c37 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:25.733036 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725141a-1289-49d7-be7b-e935d86c6c37 None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:25.734021 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725141a-1289-49d7-be7b-e935d86c6c37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:25.734525 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725141a-1289-49d7-be7b-e935d86c6c37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:25.736199 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725141a-1289-49d7-be7b-e935d86c6c37 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:25.750117 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 374/755] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:25.751861 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725141a-1289-49d7-be7b-e935d86c6c37 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:25.761168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad69f90-8a9b-4acf-b787-f392675c9c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:25.761851 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad69f90-8a9b-4acf-b787-f392675c9c1a None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:25.762517 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad69f90-8a9b-4acf-b787-f392675c9c1a None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:25.762517 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad69f90-8a9b-4acf-b787-f392675c9c1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:25.774959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad69f90-8a9b-4acf-b787-f392675c9c1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:25.776389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad69f90-8a9b-4acf-b787-f392675c9c1a None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:25.793052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-5ad69f90-8a9b-4acf-b787-f392675c9c1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:25.793052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:25.793052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:25.793052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:25.793052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:25.793052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:25.793052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:25.793052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:25.793052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:25.793052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:25.793052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:25.793052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:25.793052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:25.793052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:25.793052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:25.793052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:25.794070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:25.794070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:25.794070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:25.794070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:25.794070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:25.794070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:25.794070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:25.794070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:25.794070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:25.794070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:25.794070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:25.794070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:25.794070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:25.794070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:25.794070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:25.794070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:25.794070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:25.795649 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:25.795649 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:25.795649 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:25.798781 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 382/756] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:25.799711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad69f90-8a9b-4acf-b787-f392675c9c1a None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:25.821105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:25.865788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725141a-1289-49d7-be7b-e935d86c6c37 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:25.891944 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:25.902494 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813cb10-4bc5-4269-92d4-d52eaec0830c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:25.903442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813cb10-4bc5-4269-92d4-d52eaec0830c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:25.903964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813cb10-4bc5-4269-92d4-d52eaec0830c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:25.904439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813cb10-4bc5-4269-92d4-d52eaec0830c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:25.915061 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad69f90-8a9b-4acf-b787-f392675c9c1a None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:25.916889 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813cb10-4bc5-4269-92d4-d52eaec0830c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:25.918532 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813cb10-4bc5-4269-92d4-d52eaec0830c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:25.933922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-5813cb10-4bc5-4269-92d4-d52eaec0830c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:25.933922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:25.933922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:25.933922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:25.933922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:25.933922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:25.933922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:25.933922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:25.933922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:25.933922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:25.933922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:25.933922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:25.933922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:25.933922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:25.933922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:25.933922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:25.934863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:25.934863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:25.934863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:25.934863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:25.934863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:25.934863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:25.934863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:25.934863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:25.934863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:25.934863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:25.934863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:25.934863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:25.934863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:25.934863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:25.934863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:25.934863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:25.934863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:25.935724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:25.935724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:25.935724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:25.937784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 375/757] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:25.938981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813cb10-4bc5-4269-92d4-d52eaec0830c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:25.952321 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4337c-0946-4fee-a251-23cd198aef74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:25.952934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4337c-0946-4fee-a251-23cd198aef74 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:25.953216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4337c-0946-4fee-a251-23cd198aef74 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:25.953505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4337c-0946-4fee-a251-23cd198aef74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:25.954239 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4337c-0946-4fee-a251-23cd198aef74 None admin] RBAC: Adding query filter params (role.id=85dac7b70cf04091baaf69caabd27a8b, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=3ae62427d5914e67b5b4d0237ecccd06) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:25.954546 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4337c-0946-4fee-a251-23cd198aef74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:25.956120 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4337c-0946-4fee-a251-23cd198aef74 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:25.962369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 383/758] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:32:25 2022] GET /identity/v3/role_assignments?user.id=3ae62427d5914e67b5b4d0237ecccd06&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=85dac7b70cf04091baaf69caabd27a8b => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:25.962982 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4337c-0946-4fee-a251-23cd198aef74 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:26.050676 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813cb10-4bc5-4269-92d4-d52eaec0830c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:26.062240 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:26.083033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4337c-0946-4fee-a251-23cd198aef74 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:26.090019 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ee372-d13e-4e56-8de2-af73b98b1c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:26.090705 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ee372-d13e-4e56-8de2-af73b98b1c2c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:26.091078 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ee372-d13e-4e56-8de2-af73b98b1c2c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:26.091414 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ee372-d13e-4e56-8de2-af73b98b1c2c None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:26.092144 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ee372-d13e-4e56-8de2-af73b98b1c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:26.092520 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ee372-d13e-4e56-8de2-af73b98b1c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:26.094103 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ee372-d13e-4e56-8de2-af73b98b1c2c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:26.108238 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 376/759] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:26.115187 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ee372-d13e-4e56-8de2-af73b98b1c2c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:26.139232 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d952dc-1689-4e5f-ab4f-08d4e24ab75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:26.139911 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d952dc-1689-4e5f-ab4f-08d4e24ab75e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:26.140184 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d952dc-1689-4e5f-ab4f-08d4e24ab75e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:26.140507 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d952dc-1689-4e5f-ab4f-08d4e24ab75e None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:26.141224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d952dc-1689-4e5f-ab4f-08d4e24ab75e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:26.141632 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d952dc-1689-4e5f-ab4f-08d4e24ab75e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:26.143621 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d952dc-1689-4e5f-ab4f-08d4e24ab75e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:26.170045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 384/760] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:26.176561 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d952dc-1689-4e5f-ab4f-08d4e24ab75e None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:26.182427 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:26.313709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d952dc-1689-4e5f-ab4f-08d4e24ab75e None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:26.327025 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ee372-d13e-4e56-8de2-af73b98b1c2c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:26.354603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23ae34-cf19-42ac-b0ec-ad10ff891ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:26.355234 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23ae34-cf19-42ac-b0ec-ad10ff891ddf None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:26.355511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23ae34-cf19-42ac-b0ec-ad10ff891ddf None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:26.355787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23ae34-cf19-42ac-b0ec-ad10ff891ddf None admin] PATH_INFO: `/v3/projects/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:26.365222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23ae34-cf19-42ac-b0ec-ad10ff891ddf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:26.366688 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23ae34-cf19-42ac-b0ec-ad10ff891ddf None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:26.367815 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636278b-33a2-4dfc-a6c2-0654c52d4128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:26.368820 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636278b-33a2-4dfc-a6c2-0654c52d4128 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:26.369398 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636278b-33a2-4dfc-a6c2-0654c52d4128 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:26.369915 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636278b-33a2-4dfc-a6c2-0654c52d4128 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:26.377998 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636278b-33a2-4dfc-a6c2-0654c52d4128 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:26.379643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-3b23ae34-cf19-42ac-b0ec-ad10ff891ddf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:26.379643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:26.379643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:26.379643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:26.379643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:26.379643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:26.379643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:26.379643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:26.379643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:26.379643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:26.379643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:26.379643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:26.379643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:26.379643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:26.379643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:26.380510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:26.380510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:26.380510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:26.380510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:26.380510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:26.380510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:26.380510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:26.380510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:26.380510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:26.380510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:26.380510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:26.380510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:26.380510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:26.380510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:26.380510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:26.380510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:26.380510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:26.381388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:26.381388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:26.381388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:26.381388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:26.381388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:26.381388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:26.381388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:26.381388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:26.382369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636278b-33a2-4dfc-a6c2-0654c52d4128 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:26.385547 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 385/761] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:32:26.387938 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce8337-29c7-49e5-86db-4a93aabd20f9 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:26.389841 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce8337-29c7-49e5-86db-4a93aabd20f9 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:26.390126 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce8337-29c7-49e5-86db-4a93aabd20f9 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:26.393108 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 386/762] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:26.393108 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce8337-29c7-49e5-86db-4a93aabd20f9 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:26.402818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-9636278b-33a2-4dfc-a6c2-0654c52d4128 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:26.402818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:26.402818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:26.402818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:26.402818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:26.402818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:26.402818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:26.402818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:26.402818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:26.402818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:26.402818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:26.402818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:26.402818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:26.402818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:26.402818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:26.403907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:26.403907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:26.403907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:26.403907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:26.403907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:26.403907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:26.403907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:26.403907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:26.403907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:26.403907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:26.403907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:26.403907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:26.403907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:26.403907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:26.403907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:26.403907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:26.403907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:26.404987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:26.404987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:26.404987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:26.404987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:26.404987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:26.404987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:26.404987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:26.404987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:26.411478 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 377/763] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:26.412961 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc0969-8f1c-48c2-8401-125ea9056490 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:26.413366 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc0969-8f1c-48c2-8401-125ea9056490 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:26.414098 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc0969-8f1c-48c2-8401-125ea9056490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:26.434700 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-a8fc0969-8f1c-48c2-8401-125ea9056490 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:26.436349 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-a8fc0969-8f1c-48c2-8401-125ea9056490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:26.466578 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:26.476801 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:26.524731 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 378/764] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:32:26.525842 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc0969-8f1c-48c2-8401-125ea9056490 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:26.527701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce8337-29c7-49e5-86db-4a93aabd20f9 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:26.570317 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e4940-01f0-4d87-8a7e-ad9f91bad6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:26.571717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e4940-01f0-4d87-8a7e-ad9f91bad6f8 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:26.572141 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e4940-01f0-4d87-8a7e-ad9f91bad6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:26.572551 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e4940-01f0-4d87-8a7e-ad9f91bad6f8 None admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:26.573603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e4940-01f0-4d87-8a7e-ad9f91bad6f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:26.574173 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e4940-01f0-4d87-8a7e-ad9f91bad6f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:26.575992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e4940-01f0-4d87-8a7e-ad9f91bad6f8 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:26.596145 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 387/765] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:26.598337 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e4940-01f0-4d87-8a7e-ad9f91bad6f8 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:26.689255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc0969-8f1c-48c2-8401-125ea9056490 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:26.726046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2602603-c6f7-467f-8e7a-b6bb3d75e620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:26.726650 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2602603-c6f7-467f-8e7a-b6bb3d75e620 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:26.726931 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2602603-c6f7-467f-8e7a-b6bb3d75e620 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:26.727218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2602603-c6f7-467f-8e7a-b6bb3d75e620 None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:26.727892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2602603-c6f7-467f-8e7a-b6bb3d75e620 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:26.728199 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2602603-c6f7-467f-8e7a-b6bb3d75e620 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:26.729719 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2602603-c6f7-467f-8e7a-b6bb3d75e620 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:26.738038 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e4940-01f0-4d87-8a7e-ad9f91bad6f8 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:26.743382 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 379/766] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:26.744719 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad5912-73c5-47a6-8872-34f18a541904 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:26.745009 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad5912-73c5-47a6-8872-34f18a541904 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:26.745287 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad5912-73c5-47a6-8872-34f18a541904 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:26.750716 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 380/767] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:26.751506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad5912-73c5-47a6-8872-34f18a541904 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:26.772847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:26.775823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:26.791178 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7beb6-5eb6-4ebc-8c50-86b247c04aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:26.792011 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7beb6-5eb6-4ebc-8c50-86b247c04aca None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:26.792727 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7beb6-5eb6-4ebc-8c50-86b247c04aca None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:26.793946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7beb6-5eb6-4ebc-8c50-86b247c04aca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:26.794341 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7beb6-5eb6-4ebc-8c50-86b247c04aca None admin] RBAC: Adding query filter params (role.id=cd2effe8340d4be08a28d3a40db6979d, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=ff2db35b94c84ec7bba96117d23baf6b) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:26.794656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7beb6-5eb6-4ebc-8c50-86b247c04aca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:26.796082 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7beb6-5eb6-4ebc-8c50-86b247c04aca None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:26.807151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 388/768] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:32:26 2022] GET /identity/v3/role_assignments?user.id=ff2db35b94c84ec7bba96117d23baf6b&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=cd2effe8340d4be08a28d3a40db6979d => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:26.807151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020d917-003e-4912-8f3c-bf92d8229b09 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:26.807151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020d917-003e-4912-8f3c-bf92d8229b09 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:26.807151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020d917-003e-4912-8f3c-bf92d8229b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:26.832376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-1020d917-003e-4912-8f3c-bf92d8229b09 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:26.833662 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-1020d917-003e-4912-8f3c-bf92d8229b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:26.903209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad5912-73c5-47a6-8872-34f18a541904 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:26.932937 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 389/769] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:32:26.933864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020d917-003e-4912-8f3c-bf92d8229b09 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:26.959262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117cc89-8d3b-4e0c-9f27-d83e982bc57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:26.960500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117cc89-8d3b-4e0c-9f27-d83e982bc57e None admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:26.960500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117cc89-8d3b-4e0c-9f27-d83e982bc57e None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:26.960680 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117cc89-8d3b-4e0c-9f27-d83e982bc57e None admin] PATH_INFO: `/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/18be8c54c9644c5e9812eea09e60c11c/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:26.965589 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117cc89-8d3b-4e0c-9f27-d83e982bc57e None admin] RBAC: Authorizing `identity:create_grant(project_id=1c95aafd70e547d29c7647e6027faf2f, user_id=18be8c54c9644c5e9812eea09e60c11c, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:26.967093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117cc89-8d3b-4e0c-9f27-d83e982bc57e None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:26.988972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 381/770] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:32:26 2022] PUT /identity/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/18be8c54c9644c5e9812eea09e60c11c/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:32:27.053389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020d917-003e-4912-8f3c-bf92d8229b09 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:27.073793 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:27.093218 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1528fc-b8be-460a-acbb-78dc03892489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:27.093864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1528fc-b8be-460a-acbb-78dc03892489 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:27.094148 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1528fc-b8be-460a-acbb-78dc03892489 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:27.094421 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1528fc-b8be-460a-acbb-78dc03892489 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:27.095016 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1528fc-b8be-460a-acbb-78dc03892489 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:27.097107 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1528fc-b8be-460a-acbb-78dc03892489 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:27.107200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-5f1528fc-b8be-460a-acbb-78dc03892489 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:32:27.107200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:27.107200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:32:27.107200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:32:27.107200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:32:27.107200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:32:27.107200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:32:27.107200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:27.107200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:32:27.107200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:27.107200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:27.107200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:27.107200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:27.107200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:27.107200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:27.107200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:27.107200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:27.108569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:27.108569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:27.108569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:27.108569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:27.108569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:27.108569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:27.108569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:32:27.108569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:32:27.108569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:32:27.108569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:32:27.108569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:27.108569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:27.108569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:27.108569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:27.108569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:27.108569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:27.110067 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:27.110067 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:27.110067 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:27.110067 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:27.110067 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:27.110067 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:27.110067 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:27.110067 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:27.110067 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:27.110067 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:27.110067 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:32:27.110067 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:27.110067 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:32:27.110067 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:27.110067 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 390/771] 10.222.0.58 () {56 vars in 1129 bytes} [Wed Aug 24 09:32:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:27.114988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117cc89-8d3b-4e0c-9f27-d83e982bc57e None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:27.211889 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:27.244212 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117cc89-8d3b-4e0c-9f27-d83e982bc57e None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:27.283052 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c4a51-6193-4da4-90c7-96a17389924a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:27.284535 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c4a51-6193-4da4-90c7-96a17389924a None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:27.284885 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c4a51-6193-4da4-90c7-96a17389924a None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:27.285229 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c4a51-6193-4da4-90c7-96a17389924a None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:27.285969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c4a51-6193-4da4-90c7-96a17389924a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:27.286345 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c4a51-6193-4da4-90c7-96a17389924a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:27.287768 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c4a51-6193-4da4-90c7-96a17389924a None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:27.292823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 382/772] 10.222.0.58 () {56 vars in 1124 bytes} [Wed Aug 24 09:32:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:27.298629 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1528fc-b8be-460a-acbb-78dc03892489 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:27.369182 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c4a51-6193-4da4-90c7-96a17389924a None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:27.447497 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1528fc-b8be-460a-acbb-78dc03892489 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:27.491635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c4a51-6193-4da4-90c7-96a17389924a None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:27.527033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f8578-7392-4748-9fb5-b3cff3c12882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:27.528428 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f8578-7392-4748-9fb5-b3cff3c12882 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:27.529213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f8578-7392-4748-9fb5-b3cff3c12882 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:27.529784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f8578-7392-4748-9fb5-b3cff3c12882 None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:27.531158 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f8578-7392-4748-9fb5-b3cff3c12882 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:27.531964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151aa76-2d98-400e-8809-a65ee5141598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:27.532838 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151aa76-2d98-400e-8809-a65ee5141598 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:27.533949 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f8578-7392-4748-9fb5-b3cff3c12882 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:27.534280 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151aa76-2d98-400e-8809-a65ee5141598 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:27.534570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151aa76-2d98-400e-8809-a65ee5141598 None admin] PATH_INFO: `/v3/services/network` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:27.535190 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151aa76-2d98-400e-8809-a65ee5141598 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:27.536286 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f8578-7392-4748-9fb5-b3cff3c12882 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:27.536559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151aa76-2d98-400e-8809-a65ee5141598 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:27.546788 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 391/773] 10.222.0.58 () {56 vars in 1124 bytes} [Wed Aug 24 09:32:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:27.554512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-3151aa76-2d98-400e-8809-a65ee5141598 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:32:27.554512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:27.554512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:32:27.554512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:32:27.554512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:32:27.554512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:32:27.554512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:32:27.554512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:27.554512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:32:27.554512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:27.554512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:27.554512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:27.554512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:27.554512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:27.554512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:27.554512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:27.554512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:27.555489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:27.555489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:27.555489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:27.555489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:27.555489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:27.555489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:27.555489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:32:27.555489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:32:27.555489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:32:27.555489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:32:27.555489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:27.555489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:27.555489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:27.555489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:27.555489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:27.555489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:27.556780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:27.556780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:27.556780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:27.556780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:27.556780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:27.556780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:27.556780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:27.556780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:27.556780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:27.556780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:27.556780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:32:27.556780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:27.556780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:32:27.556780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:27.556780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 383/774] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:27 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:32:27.558740 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f8578-7392-4748-9fb5-b3cff3c12882 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:27.567571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151aa76-2d98-400e-8809-a65ee5141598 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:27.589961 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:27.657897 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:27.727897 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f8578-7392-4748-9fb5-b3cff3c12882 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:27.765832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7a5d2-ea79-4203-b830-7716525a7bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:27.766490 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7a5d2-ea79-4203-b830-7716525a7bba None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:27.766758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7a5d2-ea79-4203-b830-7716525a7bba None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:27.767039 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7a5d2-ea79-4203-b830-7716525a7bba None admin] PATH_INFO: `/v3/endpoints` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:27.767850 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7a5d2-ea79-4203-b830-7716525a7bba None admin] RBAC: Adding query filter params (interface=public, service_id=356ef2cd49294cffaf2e08b6578af22c, region_id=RegionOne) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:27.768301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7a5d2-ea79-4203-b830-7716525a7bba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:27.769696 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7a5d2-ea79-4203-b830-7716525a7bba None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:27.777819 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 392/775] 10.222.0.58 () {56 vars in 1251 bytes} [Wed Aug 24 09:32:27 2022] GET /identity/v3/endpoints?service_id=356ef2cd49294cffaf2e08b6578af22c&interface=public®ion_id=RegionOne => generated 194 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:27.782906 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7a5d2-ea79-4203-b830-7716525a7bba None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:27.803794 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151aa76-2d98-400e-8809-a65ee5141598 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:27.864603 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9d4bd-537b-48f2-aa02-fda43f6e6454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:27.865216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9d4bd-537b-48f2-aa02-fda43f6e6454 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:27.865506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9d4bd-537b-48f2-aa02-fda43f6e6454 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:27.865783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9d4bd-537b-48f2-aa02-fda43f6e6454 None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:27.866419 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9d4bd-537b-48f2-aa02-fda43f6e6454 None admin] RBAC: Adding query filter params (name=network) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:27.866719 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9d4bd-537b-48f2-aa02-fda43f6e6454 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:27.868076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9d4bd-537b-48f2-aa02-fda43f6e6454 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:27.881637 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 384/776] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 09:32:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:27.886915 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9d4bd-537b-48f2-aa02-fda43f6e6454 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:27.989069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7a5d2-ea79-4203-b830-7716525a7bba None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:28.007945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:28.058714 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32370c2-dedb-4b80-b9f4-12913deef73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:28.059327 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32370c2-dedb-4b80-b9f4-12913deef73f None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:28.059604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32370c2-dedb-4b80-b9f4-12913deef73f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:28.059873 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32370c2-dedb-4b80-b9f4-12913deef73f None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:28.060704 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32370c2-dedb-4b80-b9f4-12913deef73f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:28.061872 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32370c2-dedb-4b80-b9f4-12913deef73f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:28.076378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 393/777] 10.222.0.58 () {56 vars in 1087 bytes} [Wed Aug 24 09:32:27 2022] GET /identity/v3/services => generated 772 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:28.159858 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:28.214067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9d4bd-537b-48f2-aa02-fda43f6e6454 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:28.258416 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916fb28-3124-4c1f-be67-41e9ae12550f None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:28.258717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916fb28-3124-4c1f-be67-41e9ae12550f None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:28.258906 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916fb28-3124-4c1f-be67-41e9ae12550f None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:28.260255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 394/778] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:28.266591 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393abe42-e00b-4723-9777-9e90aa02ba50 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:28.266871 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393abe42-e00b-4723-9777-9e90aa02ba50 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:28.267148 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393abe42-e00b-4723-9777-9e90aa02ba50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:28.281122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3d31b-2f39-4df8-952b-3a26ea6e2bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:28.282178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3d31b-2f39-4df8-952b-3a26ea6e2bcf None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:28.282704 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3d31b-2f39-4df8-952b-3a26ea6e2bcf None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:28.283807 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3d31b-2f39-4df8-952b-3a26ea6e2bcf None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:28.284684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3d31b-2f39-4df8-952b-3a26ea6e2bcf None admin] RBAC: Adding query filter params (type=network) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:28.285199 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3d31b-2f39-4df8-952b-3a26ea6e2bcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:28.287760 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3d31b-2f39-4df8-952b-3a26ea6e2bcf None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:28.295773 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-393abe42-e00b-4723-9777-9e90aa02ba50 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:28.296984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-393abe42-e00b-4723-9777-9e90aa02ba50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:28.298357 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 385/779] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 09:32:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:28.304618 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3d31b-2f39-4df8-952b-3a26ea6e2bcf None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:28.396070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 395/780] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:32:28.448473 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3d31b-2f39-4df8-952b-3a26ea6e2bcf None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:28.496889 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fe4b3-d3f2-4327-8009-b17c0964ed5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:28.497493 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fe4b3-d3f2-4327-8009-b17c0964ed5e None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:28.497775 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fe4b3-d3f2-4327-8009-b17c0964ed5e None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:28.498046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fe4b3-d3f2-4327-8009-b17c0964ed5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:28.498742 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fe4b3-d3f2-4327-8009-b17c0964ed5e None admin] RBAC: Adding query filter params (interface=public, service_id=984937e1c9d5434dbcd071aaeb629be5, region_id=RegionOne) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:28.499043 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fe4b3-d3f2-4327-8009-b17c0964ed5e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:28.500390 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fe4b3-d3f2-4327-8009-b17c0964ed5e None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:28.504918 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:28.513683 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 386/781] 10.222.0.58 () {56 vars in 1251 bytes} [Wed Aug 24 09:32:28 2022] GET /identity/v3/endpoints?service_id=984937e1c9d5434dbcd071aaeb629be5&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:28.520058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393abe42-e00b-4723-9777-9e90aa02ba50 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:28.657015 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393abe42-e00b-4723-9777-9e90aa02ba50 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:28.662507 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:28.704009 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ce750-5bbe-445b-8d66-63be2e06a290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:28.704622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ce750-5bbe-445b-8d66-63be2e06a290 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:28.704903 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ce750-5bbe-445b-8d66-63be2e06a290 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:28.706437 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ce750-5bbe-445b-8d66-63be2e06a290 None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:28.707336 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ce750-5bbe-445b-8d66-63be2e06a290 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:28.708700 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ce750-5bbe-445b-8d66-63be2e06a290 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:28.718229 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 396/782] 10.222.0.58 () {56 vars in 1087 bytes} [Wed Aug 24 09:32:28 2022] GET /identity/v3/services => generated 772 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:28.858186 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fe4b3-d3f2-4327-8009-b17c0964ed5e None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:28.999937 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fe4b3-d3f2-4327-8009-b17c0964ed5e None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:29.045225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4dded7-4818-49ae-a0f7-7d8193b9cbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:29.045914 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4dded7-4818-49ae-a0f7-7d8193b9cbd3 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:29.046195 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4dded7-4818-49ae-a0f7-7d8193b9cbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:29.046470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4dded7-4818-49ae-a0f7-7d8193b9cbd3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:29.059015 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4dded7-4818-49ae-a0f7-7d8193b9cbd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:32:29.064132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-da4dded7-4818-49ae-a0f7-7d8193b9cbd3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:29.064132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:29.064132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:29.064132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:29.064132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:29.064132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:29.064132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:29.064132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:29.064132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:29.064132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:29.064132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:29.064132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:29.064132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:32:29.064132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:32:29.064132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:32:29.064132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:32:29.065095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:32:29.065095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:32:29.065095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:32:29.065095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:32:29.065095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:29.065095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:29.065095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:29.065095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:29.065095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:29.065095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:29.065095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:29.065095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:29.065095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:29.065095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:29.065095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:29.065095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:29.066204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:29.066204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:29.066204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:29.066204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:29.066204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:32:29.066204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:32:29.066204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:32:29.066204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:32:29.066204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:32:29.066204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:32:29.066204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:29.066204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:29.066204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 387/783] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:32:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:29.073172 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ce750-5bbe-445b-8d66-63be2e06a290 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:29.186346 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d394b37-10ec-4a85-a6d0-9967d3026a03 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:29.186550 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d394b37-10ec-4a85-a6d0-9967d3026a03 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:29.186800 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d394b37-10ec-4a85-a6d0-9967d3026a03 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:29.188141 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 388/784] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:32:29.194206 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d0579-3314-4a0c-b797-4269704dcc54 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:29.194485 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d0579-3314-4a0c-b797-4269704dcc54 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:29.194758 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d0579-3314-4a0c-b797-4269704dcc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:29.195723 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ce750-5bbe-445b-8d66-63be2e06a290 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:29.220801 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-632d0579-3314-4a0c-b797-4269704dcc54 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:29.224386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-632d0579-3314-4a0c-b797-4269704dcc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:29.259312 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bf5b1-279b-4d30-b5e9-5a81bf834767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:29.259924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bf5b1-279b-4d30-b5e9-5a81bf834767 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:29.260205 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bf5b1-279b-4d30-b5e9-5a81bf834767 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:29.260483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bf5b1-279b-4d30-b5e9-5a81bf834767 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:29.261160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100bf5b1-279b-4d30-b5e9-5a81bf834767 None admin] RBAC: Adding query filter params (name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:29.261500 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100bf5b1-279b-4d30-b5e9-5a81bf834767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:29.262850 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100bf5b1-279b-4d30-b5e9-5a81bf834767 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:29.273659 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 397/785] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 09:32:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:29.280906 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bf5b1-279b-4d30-b5e9-5a81bf834767 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:29.341153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:29.358089 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:29.367240 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 389/786] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:32:29.395528 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d9afe-f0a9-4465-be77-5b9b6c90d6af None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:29.395829 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d9afe-f0a9-4465-be77-5b9b6c90d6af None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:29.396104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d9afe-f0a9-4465-be77-5b9b6c90d6af None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:29.397893 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 390/787] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:29.405094 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979f55d-98ee-4ebf-bdbf-c776d6712b83 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:29.405406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979f55d-98ee-4ebf-bdbf-c776d6712b83 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:29.405683 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979f55d-98ee-4ebf-bdbf-c776d6712b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:29.436565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-7979f55d-98ee-4ebf-bdbf-c776d6712b83 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:29.437726 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7979f55d-98ee-4ebf-bdbf-c776d6712b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:29.482715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bf5b1-279b-4d30-b5e9-5a81bf834767 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:29.542809 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 391/788] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:32:29.552096 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942d897-866e-4f13-9ad0-2e67f30d575f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:29.552744 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942d897-866e-4f13-9ad0-2e67f30d575f None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:29.553024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942d897-866e-4f13-9ad0-2e67f30d575f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:29.553296 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942d897-866e-4f13-9ad0-2e67f30d575f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:29.564247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942d897-866e-4f13-9ad0-2e67f30d575f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:29.566342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942d897-866e-4f13-9ad0-2e67f30d575f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:29.588711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-a942d897-866e-4f13-9ad0-2e67f30d575f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:29.588711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:29.588711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:29.588711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:29.588711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:29.588711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:29.588711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:29.588711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:29.588711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:29.588711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:29.588711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:29.588711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:29.588711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:29.588711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:29.588711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:29.588711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:29.589717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:29.589717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:29.589717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:29.589717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:29.589717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:29.589717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:29.589717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:29.589717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:29.589717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:29.589717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:29.589717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:29.589717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:29.589717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:29.589717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:29.589717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:29.589717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:29.589717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:29.590597 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:29.590597 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:29.590597 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:29.593571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 398/789] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:29.596285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979f55d-98ee-4ebf-bdbf-c776d6712b83 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:29.708401 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942d897-866e-4f13-9ad0-2e67f30d575f None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:29.723339 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979f55d-98ee-4ebf-bdbf-c776d6712b83 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:29.746521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:29.770207 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5d171-f07a-4f94-b377-1542d3c98b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:29.771333 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5d171-f07a-4f94-b377-1542d3c98b93 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:29.771946 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5d171-f07a-4f94-b377-1542d3c98b93 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:29.772242 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5d171-f07a-4f94-b377-1542d3c98b93 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:29.772889 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5d171-f07a-4f94-b377-1542d3c98b93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:29.773216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5d171-f07a-4f94-b377-1542d3c98b93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:29.774589 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5d171-f07a-4f94-b377-1542d3c98b93 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:29.794368 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 392/790] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:29.800910 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5d171-f07a-4f94-b377-1542d3c98b93 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:29.834162 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:29.847870 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942d897-866e-4f13-9ad0-2e67f30d575f None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:29.886257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2005528-dc16-4353-8556-03ff073dea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:29.887745 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2005528-dc16-4353-8556-03ff073dea11 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:29.888249 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2005528-dc16-4353-8556-03ff073dea11 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:29.888724 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2005528-dc16-4353-8556-03ff073dea11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:29.901157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2005528-dc16-4353-8556-03ff073dea11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:32:29.906216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-a2005528-dc16-4353-8556-03ff073dea11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:32:29.906216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:29.906216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:29.906216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:29.906216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:29.906216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:29.906216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:29.906216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:29.906216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:29.906216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:29.906216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:29.906216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:29.906216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:32:29.906216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:32:29.906216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:32:29.906216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:32:29.907099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:32:29.907099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:32:29.907099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:32:29.907099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:32:29.907099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:29.907099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:29.907099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:29.907099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:29.907099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:29.907099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:29.907099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:29.907099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:29.907099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:29.907099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:29.907099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:29.907099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:29.907964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:29.907964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:29.907964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:29.907964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:29.907964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:32:29.907964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:32:29.907964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:32:29.907964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:32:29.907964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:32:29.907964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:32:29.907964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:32:29.907964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:29.910965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 399/791] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:32:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:29.917053 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2005528-dc16-4353-8556-03ff073dea11 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:30.016882 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5d171-f07a-4f94-b377-1542d3c98b93 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:30.038849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2005528-dc16-4353-8556-03ff073dea11 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:30.055469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e5d2e-63a9-4a62-9b76-e8724c40d712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:30.055951 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e5d2e-63a9-4a62-9b76-e8724c40d712 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:30.056233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e5d2e-63a9-4a62-9b76-e8724c40d712 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:30.056510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e5d2e-63a9-4a62-9b76-e8724c40d712 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:30.065498 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e5d2e-63a9-4a62-9b76-e8724c40d712 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:30.066958 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e5d2e-63a9-4a62-9b76-e8724c40d712 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:30.079076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-2a8e5d2e-63a9-4a62-9b76-e8724c40d712 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:32:30.079076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:30.079076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:30.079076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:30.079076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:30.079076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:30.079076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:30.079076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:30.079076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:30.079076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:30.079076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:30.079076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:30.079076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:30.079076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:30.079076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:30.079076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:30.080048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:30.080048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:30.080048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:30.080048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:30.080048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:30.080048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:30.080048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:30.080048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:30.080048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:30.080048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:30.080048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:30.080048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:30.080048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:30.080048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:30.080048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:30.080048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:30.080048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:30.080048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:30.081497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:30.081497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:30.081497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:30.081497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:30.081497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:30.081497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:30.081497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:30.081497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:30.081497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:32:30.081497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:30.081497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 393/792] 10.222.0.58 () {56 vars in 1117 bytes} [Wed Aug 24 09:32:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:30.081497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e5d2e-63a9-4a62-9b76-e8724c40d712 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:30.088411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7deade4-c574-43ff-bf1d-356cf1596afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:30.089597 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7deade4-c574-43ff-bf1d-356cf1596afb None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:30.090023 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7deade4-c574-43ff-bf1d-356cf1596afb None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:30.090465 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7deade4-c574-43ff-bf1d-356cf1596afb None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:30.091281 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7deade4-c574-43ff-bf1d-356cf1596afb None admin] RBAC: Adding query filter params (name=admin) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:30.091729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7deade4-c574-43ff-bf1d-356cf1596afb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:30.093863 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7deade4-c574-43ff-bf1d-356cf1596afb None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:30.106124 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 400/793] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:32:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:30.112030 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7deade4-c574-43ff-bf1d-356cf1596afb None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:30.117776 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:30.134746 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:30.208663 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e5d2e-63a9-4a62-9b76-e8724c40d712 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:30.256089 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b26000-e8db-4b7d-ab2f-b5bd070724d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:30.256833 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b26000-e8db-4b7d-ab2f-b5bd070724d5 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:30.257247 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b26000-e8db-4b7d-ab2f-b5bd070724d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:30.257684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b26000-e8db-4b7d-ab2f-b5bd070724d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:30.262666 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7deade4-c574-43ff-bf1d-356cf1596afb None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:30.269060 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b26000-e8db-4b7d-ab2f-b5bd070724d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:32:30.274506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-c0b26000-e8db-4b7d-ab2f-b5bd070724d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:32:30.274506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:30.274506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:30.274506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:30.274506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:30.274506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:30.274506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:30.274506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:30.274506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:30.274506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:30.274506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:30.274506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:30.274506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:32:30.274506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:32:30.274506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:32:30.274506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:32:30.275643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:32:30.275643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:32:30.275643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:32:30.275643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:32:30.275643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:30.275643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:30.275643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:30.275643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:30.275643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:30.275643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:30.275643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:30.275643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:30.275643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:30.275643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:30.275643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:30.275643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:30.276696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:30.276696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:30.276696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:30.276696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:30.276696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:32:30.276696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:32:30.276696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:32:30.276696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:32:30.276696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:32:30.276696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:32:30.276696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:32:30.276696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:30.283098 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 394/794] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:32:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:30.284561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b26000-e8db-4b7d-ab2f-b5bd070724d5 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:30.314981 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9b498-f6e3-490b-b552-b69ce532507e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:30.316317 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9b498-f6e3-490b-b552-b69ce532507e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:30.317011 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9b498-f6e3-490b-b552-b69ce532507e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:30.317450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9b498-f6e3-490b-b552-b69ce532507e None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:30.318594 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9b498-f6e3-490b-b552-b69ce532507e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:30.319048 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9b498-f6e3-490b-b552-b69ce532507e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:30.321227 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9b498-f6e3-490b-b552-b69ce532507e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:30.345021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 401/795] 10.222.0.58 () {56 vars in 1149 bytes} [Wed Aug 24 09:32:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:30.347017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9b498-f6e3-490b-b552-b69ce532507e None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:30.393037 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:30.397087 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b26000-e8db-4b7d-ab2f-b5bd070724d5 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:30.421094 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:30.436432 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02f8b1-187e-4573-b5ef-91560374ef16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:30.437193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02f8b1-187e-4573-b5ef-91560374ef16 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:30.437608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02f8b1-187e-4573-b5ef-91560374ef16 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:30.437982 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02f8b1-187e-4573-b5ef-91560374ef16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:30.450017 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02f8b1-187e-4573-b5ef-91560374ef16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:30.451636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d02f8b1-187e-4573-b5ef-91560374ef16 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:30.465841 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9b498-f6e3-490b-b552-b69ce532507e None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:30.467706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-2d02f8b1-187e-4573-b5ef-91560374ef16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:30.467706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:30.467706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:30.467706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:30.467706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:30.467706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:30.467706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:30.467706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:30.467706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:30.467706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:30.467706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:30.467706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:30.467706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:30.467706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:30.467706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:30.467706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:30.468821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:30.468821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:30.468821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:30.468821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:30.468821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:30.468821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:30.468821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:30.468821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:30.468821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:30.468821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:30.468821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:30.468821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:30.468821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:30.468821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:30.468821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:30.468821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:30.468821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:30.469730 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:30.469730 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:30.469730 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:30.473749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 395/796] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:30.474623 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02f8b1-187e-4573-b5ef-91560374ef16 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:30.508792 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058546c-d0f9-4f47-9a7b-d78137218fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:30.509399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058546c-d0f9-4f47-9a7b-d78137218fe1 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:30.509810 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058546c-d0f9-4f47-9a7b-d78137218fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:30.510091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058546c-d0f9-4f47-9a7b-d78137218fe1 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:30.510734 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058546c-d0f9-4f47-9a7b-d78137218fe1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:30.511031 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058546c-d0f9-4f47-9a7b-d78137218fe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:30.512382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058546c-d0f9-4f47-9a7b-d78137218fe1 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:30.520857 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 402/797] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:32:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:30.521607 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058546c-d0f9-4f47-9a7b-d78137218fe1 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:30.599925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02f8b1-187e-4573-b5ef-91560374ef16 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:30.626436 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058546c-d0f9-4f47-9a7b-d78137218fe1 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:30.639615 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0bb15-e7af-4a4d-9978-4c26af39a4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:30.640616 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0bb15-e7af-4a4d-9978-4c26af39a4a9 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:30.641096 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0bb15-e7af-4a4d-9978-4c26af39a4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:30.641577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0bb15-e7af-4a4d-9978-4c26af39a4a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:30.650327 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:30.655204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0bb15-e7af-4a4d-9978-4c26af39a4a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:30.657109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0bb15-e7af-4a4d-9978-4c26af39a4a9 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:30.661510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a5ba7-fcfd-40e7-aafc-c0ac4a3ab7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:30.662120 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a5ba7-fcfd-40e7-aafc-c0ac4a3ab7a5 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:30.662398 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a5ba7-fcfd-40e7-aafc-c0ac4a3ab7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:30.662668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a5ba7-fcfd-40e7-aafc-c0ac4a3ab7a5 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:30.663308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a5ba7-fcfd-40e7-aafc-c0ac4a3ab7a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:30.663630 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a5ba7-fcfd-40e7-aafc-c0ac4a3ab7a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:30.664952 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a5ba7-fcfd-40e7-aafc-c0ac4a3ab7a5 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:30.674959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-6ae0bb15-e7af-4a4d-9978-4c26af39a4a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:30.674959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:30.674959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:30.674959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:30.674959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:30.674959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:30.674959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:30.674959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:30.674959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:30.674959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:30.674959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:30.674959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:30.674959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:30.674959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:30.674959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:30.674959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:30.676157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:30.676157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:30.676157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:30.676157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:30.676157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:30.676157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:30.676157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:30.676157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:30.676157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:30.676157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:30.676157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:30.676157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:30.676157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:30.676157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:30.676157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:30.676157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:30.676157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:30.677031 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:30.677031 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:30.677031 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:30.684134 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 403/798] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:30.684134 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddef80-6d88-4c6c-9c8a-02e3987d31d6 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:30.684134 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddef80-6d88-4c6c-9c8a-02e3987d31d6 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:30.684435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 396/799] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:30.684514 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddef80-6d88-4c6c-9c8a-02e3987d31d6 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:30.684584 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0bb15-e7af-4a4d-9978-4c26af39a4a9 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:30.684757 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 404/800] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:30.685334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddef80-6d88-4c6c-9c8a-02e3987d31d6 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:30.690296 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:30.793994 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddef80-6d88-4c6c-9c8a-02e3987d31d6 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:30.802265 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0bb15-e7af-4a4d-9978-4c26af39a4a9 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:30.831614 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f4b2c-8256-4aae-ae26-9d73fecd2a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:30.832206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f4b2c-8256-4aae-ae26-9d73fecd2a88 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:30.832533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f4b2c-8256-4aae-ae26-9d73fecd2a88 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:30.832804 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f4b2c-8256-4aae-ae26-9d73fecd2a88 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:30.833531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f4b2c-8256-4aae-ae26-9d73fecd2a88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:30.833832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f4b2c-8256-4aae-ae26-9d73fecd2a88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:30.835176 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f4b2c-8256-4aae-ae26-9d73fecd2a88 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:30.839108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98abaf-dae2-4bb7-941a-fa2e8307e7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:30.839775 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98abaf-dae2-4bb7-941a-fa2e8307e7ec None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:30.840053 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98abaf-dae2-4bb7-941a-fa2e8307e7ec None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:30.840373 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98abaf-dae2-4bb7-941a-fa2e8307e7ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:30.847410 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 405/801] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:30.848042 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f4b2c-8256-4aae-ae26-9d73fecd2a88 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:30.856186 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98abaf-dae2-4bb7-941a-fa2e8307e7ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:30.857663 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98abaf-dae2-4bb7-941a-fa2e8307e7ec None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:30.873041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-dc98abaf-dae2-4bb7-941a-fa2e8307e7ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:30.873041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:30.873041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:30.873041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:30.873041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:30.873041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:30.873041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:30.873041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:30.873041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:30.873041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:30.873041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:30.873041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:30.873041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:30.873041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:30.873041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:30.873041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:30.874209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:30.874209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:30.874209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:30.874209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:30.874209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:30.874209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:30.874209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:30.874209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:30.874209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:30.874209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:30.874209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:30.874209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:30.874209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:30.874209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:30.874209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:30.874209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:30.874209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:30.875114 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:30.875114 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:30.875114 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:30.875114 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 397/802] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:30.875780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50858d0-9a0a-47ac-8338-359c7d32e2a2 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:30.875780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50858d0-9a0a-47ac-8338-359c7d32e2a2 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:30.876025 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50858d0-9a0a-47ac-8338-359c7d32e2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:30.894935 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-c50858d0-9a0a-47ac-8338-359c7d32e2a2 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:30.896126 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-c50858d0-9a0a-47ac-8338-359c7d32e2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:30.905326 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:30.958839 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:30.963001 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f4b2c-8256-4aae-ae26-9d73fecd2a88 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:30.978187 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 398/803] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:32:30.978863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50858d0-9a0a-47ac-8338-359c7d32e2a2 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:31.014238 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf5fbf-0e45-4df4-9434-61aa0e3686cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:31.016306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf5fbf-0e45-4df4-9434-61aa0e3686cc None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:31.016821 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf5fbf-0e45-4df4-9434-61aa0e3686cc None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:31.017294 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf5fbf-0e45-4df4-9434-61aa0e3686cc None admin] PATH_INFO: `/v3/users/swift` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:31.027094 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf5fbf-0e45-4df4-9434-61aa0e3686cc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:31.029730 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf5fbf-0e45-4df4-9434-61aa0e3686cc None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:31.045923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-f6cf5fbf-0e45-4df4-9434-61aa0e3686cc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:32:31.045923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:31.045923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:31.045923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:31.045923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:31.045923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:31.045923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:31.045923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:31.045923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:31.045923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:31.045923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:31.045923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:31.045923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:31.045923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:31.045923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:31.045923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:31.046864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:31.046864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:31.046864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:31.046864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:31.046864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:31.046864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:31.046864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:31.046864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:31.046864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:31.046864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:31.046864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:31.046864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:31.046864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:31.046864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:31.046864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:31.046864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:31.046864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:31.046864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:31.047789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:31.047789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:31.047789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:31.047789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:31.047789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:31.047789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:31.047789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:31.047789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:31.047789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:32:31.047789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:31.055583 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 406/804] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:32:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:31.055583 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf5fbf-0e45-4df4-9434-61aa0e3686cc None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:31.092421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50858d0-9a0a-47ac-8338-359c7d32e2a2 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:31.132234 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d54aa-596a-45e0-9a93-f43b8c1ef447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:31.132869 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d54aa-596a-45e0-9a93-f43b8c1ef447 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:31.133151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d54aa-596a-45e0-9a93-f43b8c1ef447 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:31.133427 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d54aa-596a-45e0-9a93-f43b8c1ef447 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:31.140470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d54aa-596a-45e0-9a93-f43b8c1ef447 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:31.141924 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d54aa-596a-45e0-9a93-f43b8c1ef447 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:31.154153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-1d2d54aa-596a-45e0-9a93-f43b8c1ef447 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:31.154153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:31.154153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:31.154153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:31.154153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:31.154153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:31.154153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:31.154153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:31.154153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:31.154153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:31.154153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:31.154153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:31.154153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:31.154153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:31.154153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:31.155218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:31.155218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:31.155218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:31.155218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:31.155218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:31.155218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:31.155218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:31.155218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:31.155218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:31.155218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:31.155218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:31.155218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:31.155218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:31.155218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:31.155218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:31.155218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:31.155218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:31.156462 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:31.156462 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:31.156462 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:31.156462 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:31.156462 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:31.156462 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:31.156462 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:31.156462 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:31.156462 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 399/805] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:31.156462 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d54aa-596a-45e0-9a93-f43b8c1ef447 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:31.186068 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf5fbf-0e45-4df4-9434-61aa0e3686cc None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:31.191215 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:31.208780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:31.229056 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fcc9c-4c24-4a1f-9044-9d770cacbfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:31.229738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fcc9c-4c24-4a1f-9044-9d770cacbfd3 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:31.229988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fcc9c-4c24-4a1f-9044-9d770cacbfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:31.230259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fcc9c-4c24-4a1f-9044-9d770cacbfd3 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:31.230898 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fcc9c-4c24-4a1f-9044-9d770cacbfd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:31.231195 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fcc9c-4c24-4a1f-9044-9d770cacbfd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:31.232548 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fcc9c-4c24-4a1f-9044-9d770cacbfd3 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:31.254400 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 407/806] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:31.254400 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1719bae-2d9c-47cf-856b-34d111648bd2 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:31.254400 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1719bae-2d9c-47cf-856b-34d111648bd2 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:31.254400 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1719bae-2d9c-47cf-856b-34d111648bd2 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:31.254400 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 408/807] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:31.254400 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1719bae-2d9c-47cf-856b-34d111648bd2 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:31.277279 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d54aa-596a-45e0-9a93-f43b8c1ef447 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:31.310479 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48e7f7-ec0a-4325-8917-6ff517c27a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:31.311001 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48e7f7-ec0a-4325-8917-6ff517c27a93 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:31.311272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48e7f7-ec0a-4325-8917-6ff517c27a93 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:31.311538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48e7f7-ec0a-4325-8917-6ff517c27a93 None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:31.312250 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48e7f7-ec0a-4325-8917-6ff517c27a93 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:31.312546 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48e7f7-ec0a-4325-8917-6ff517c27a93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:31.313987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48e7f7-ec0a-4325-8917-6ff517c27a93 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:31.332724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 400/808] 10.222.0.58 () {56 vars in 1135 bytes} [Wed Aug 24 09:32:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:31.333529 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48e7f7-ec0a-4325-8917-6ff517c27a93 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:31.358601 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1719bae-2d9c-47cf-856b-34d111648bd2 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:31.394724 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f7a92-60ce-4235-adc6-4df6019555fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:31.395314 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f7a92-60ce-4235-adc6-4df6019555fb None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:31.395588 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f7a92-60ce-4235-adc6-4df6019555fb None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:31.395864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f7a92-60ce-4235-adc6-4df6019555fb None admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:31.396540 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f7a92-60ce-4235-adc6-4df6019555fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:31.396838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f7a92-60ce-4235-adc6-4df6019555fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:31.398268 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f7a92-60ce-4235-adc6-4df6019555fb None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:31.409934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 409/809] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:31.410715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f7a92-60ce-4235-adc6-4df6019555fb None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:31.433599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48e7f7-ec0a-4325-8917-6ff517c27a93 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:31.435640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:31.436090 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:31.469352 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5971d9-b8a8-4505-8af6-8c2d1fb41759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:31.470005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5971d9-b8a8-4505-8af6-8c2d1fb41759 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:31.470285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5971d9-b8a8-4505-8af6-8c2d1fb41759 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:31.470566 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5971d9-b8a8-4505-8af6-8c2d1fb41759 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:31.478123 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5971d9-b8a8-4505-8af6-8c2d1fb41759 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:31.479702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5971d9-b8a8-4505-8af6-8c2d1fb41759 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:31.491176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-3c5971d9-b8a8-4505-8af6-8c2d1fb41759 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:32:31.491176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:31.491176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:31.491176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:31.491176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:31.491176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:31.491176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:31.491176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:31.491176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:31.491176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:31.491176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:31.491176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:31.491176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:31.491176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:31.491176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:31.491176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:31.492269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:31.492269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:31.492269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:31.492269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:31.492269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:31.492269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:31.492269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:31.492269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:31.492269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:31.492269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:31.492269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:31.492269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:31.492269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:31.492269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:31.492269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:31.492269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:31.492269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:31.492269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:31.493555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:31.493555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:31.493555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:31.493555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:31.493555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:31.493555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:31.493555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:31.493555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:31.493555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:32:31.493555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:31.496959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 401/810] 10.222.0.58 () {56 vars in 1093 bytes} [Wed Aug 24 09:32:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:31.498032 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e85762-6f20-4301-8649-7e788fb15bdc None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:31.498319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e85762-6f20-4301-8649-7e788fb15bdc None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:31.498595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e85762-6f20-4301-8649-7e788fb15bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:31.512414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f7a92-60ce-4235-adc6-4df6019555fb None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:31.515408 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-83e85762-6f20-4301-8649-7e788fb15bdc None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:31.516595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-83e85762-6f20-4301-8649-7e788fb15bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:31.546802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92649c-53ff-4fff-9d70-43fbee51b554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:31.547425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92649c-53ff-4fff-9d70-43fbee51b554 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:31.547703 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92649c-53ff-4fff-9d70-43fbee51b554 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:31.547977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92649c-53ff-4fff-9d70-43fbee51b554 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:31.548555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92649c-53ff-4fff-9d70-43fbee51b554 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:31.549954 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92649c-53ff-4fff-9d70-43fbee51b554 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:31.558471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-0c92649c-53ff-4fff-9d70-43fbee51b554 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:32:31.558471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:31.558471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:32:31.558471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:32:31.558471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:32:31.558471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:32:31.558471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:32:31.558471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:31.558471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:32:31.558471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:31.558471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:31.558471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:31.558471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:31.558471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:31.558471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:31.558471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:31.558471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:31.561702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:31.561702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:31.561702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:31.561702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:31.561702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:31.561702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:31.561702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:32:31.561702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:32:31.561702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:32:31.561702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:32:31.561702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:31.561702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:31.561702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:31.561702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:31.561702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:31.561702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:31.562542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:31.562542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:31.562542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:31.562542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:31.562542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:31.562542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:31.562542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:31.562542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:31.562542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:31.562542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:31.562542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:32:31.562542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:31.562542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 09:32:31.562542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:31.562542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 410/811] 10.222.0.58 () {56 vars in 1129 bytes} [Wed Aug 24 09:32:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:31.563355 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92649c-53ff-4fff-9d70-43fbee51b554 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:31.589815 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 402/812] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:32:31.590627 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e85762-6f20-4301-8649-7e788fb15bdc None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:31.658940 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:31.674341 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92649c-53ff-4fff-9d70-43fbee51b554 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:31.699631 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:31.708423 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e85762-6f20-4301-8649-7e788fb15bdc None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:31.714363 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdce3d-362f-4e30-9d5d-cee24c8cbce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:31.715143 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdce3d-362f-4e30-9d5d-cee24c8cbce7 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:31.715488 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdce3d-362f-4e30-9d5d-cee24c8cbce7 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:31.715833 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdce3d-362f-4e30-9d5d-cee24c8cbce7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:31.726706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdce3d-362f-4e30-9d5d-cee24c8cbce7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:31.728134 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cdce3d-362f-4e30-9d5d-cee24c8cbce7 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:31.743386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-b9cdce3d-362f-4e30-9d5d-cee24c8cbce7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:31.743386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:31.743386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:31.743386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:31.743386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:31.743386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:31.743386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:31.743386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:31.743386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:31.743386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:31.743386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:31.743386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:31.743386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:31.743386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:31.743386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:31.743386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:31.744382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:31.744382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:31.744382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:31.744382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:31.744382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:31.744382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:31.744382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:31.744382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:31.744382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:31.744382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:31.744382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:31.744382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:31.744382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:31.744382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:31.744382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:31.744382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:31.744382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:31.750240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:31.750240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:31.750240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:31.750240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 411/813] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:31.750240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdce3d-362f-4e30-9d5d-cee24c8cbce7 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:31.750538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a779ee-104b-46e6-8d56-c888d577bb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:31.750538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a779ee-104b-46e6-8d56-c888d577bb9d None admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:31.750538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a779ee-104b-46e6-8d56-c888d577bb9d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:31.750538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a779ee-104b-46e6-8d56-c888d577bb9d None admin] PATH_INFO: `/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/3ae62427d5914e67b5b4d0237ecccd06/roles/85dac7b70cf04091baaf69caabd27a8b` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:31.766267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a779ee-104b-46e6-8d56-c888d577bb9d None admin] RBAC: Authorizing `identity:create_grant(project_id=1c95aafd70e547d29c7647e6027faf2f, user_id=3ae62427d5914e67b5b4d0237ecccd06, role_id=85dac7b70cf04091baaf69caabd27a8b)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:31.768747 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a779ee-104b-46e6-8d56-c888d577bb9d None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:31.789527 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 403/814] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:32:31 2022] PUT /identity/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/3ae62427d5914e67b5b4d0237ecccd06/roles/85dac7b70cf04091baaf69caabd27a8b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:32:31.789527 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a779ee-104b-46e6-8d56-c888d577bb9d None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:31.858249 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdce3d-362f-4e30-9d5d-cee24c8cbce7 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:31.898070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118bd83-85d8-47bf-875f-df4ca98295c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:31.898690 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118bd83-85d8-47bf-875f-df4ca98295c5 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:31.898972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118bd83-85d8-47bf-875f-df4ca98295c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:31.899228 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118bd83-85d8-47bf-875f-df4ca98295c5 None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:31.899969 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118bd83-85d8-47bf-875f-df4ca98295c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:31.900266 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118bd83-85d8-47bf-875f-df4ca98295c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:31.901734 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118bd83-85d8-47bf-875f-df4ca98295c5 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:31.912155 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:31.922570 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 412/815] 10.222.0.58 () {56 vars in 1133 bytes} [Wed Aug 24 09:32:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:31.924601 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118bd83-85d8-47bf-875f-df4ca98295c5 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:31.925713 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a779ee-104b-46e6-8d56-c888d577bb9d None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:31.973634 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297993a-5d94-4a35-8662-f863f8a87ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:31.974242 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297993a-5d94-4a35-8662-f863f8a87ffc None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:31.974516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297993a-5d94-4a35-8662-f863f8a87ffc None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:31.974783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297993a-5d94-4a35-8662-f863f8a87ffc None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:31.975411 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297993a-5d94-4a35-8662-f863f8a87ffc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:31.975709 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297993a-5d94-4a35-8662-f863f8a87ffc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:31.977056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297993a-5d94-4a35-8662-f863f8a87ffc None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:31.985649 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 404/816] 10.222.0.58 () {56 vars in 1124 bytes} [Wed Aug 24 09:32:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:31.985649 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297993a-5d94-4a35-8662-f863f8a87ffc None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:31.997914 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:32.047050 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118bd83-85d8-47bf-875f-df4ca98295c5 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:32.087948 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75aa83f-e22f-41b8-8fab-757f73fc6f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:32.088558 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aa83f-e22f-41b8-8fab-757f73fc6f4d None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:32.088839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aa83f-e22f-41b8-8fab-757f73fc6f4d None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:32.089116 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aa83f-e22f-41b8-8fab-757f73fc6f4d None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:32.089808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75aa83f-e22f-41b8-8fab-757f73fc6f4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:32.090116 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75aa83f-e22f-41b8-8fab-757f73fc6f4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:32.091480 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75aa83f-e22f-41b8-8fab-757f73fc6f4d None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:32.094690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297993a-5d94-4a35-8662-f863f8a87ffc None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:32.103947 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 413/817] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:32.104760 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75aa83f-e22f-41b8-8fab-757f73fc6f4d None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:32.137699 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29045b51-5a98-4056-83aa-7ec23535e6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:32.138258 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29045b51-5a98-4056-83aa-7ec23535e6ba None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:32.138538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29045b51-5a98-4056-83aa-7ec23535e6ba None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:32.138815 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29045b51-5a98-4056-83aa-7ec23535e6ba None admin] PATH_INFO: `/v3/services/network` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:32.139398 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29045b51-5a98-4056-83aa-7ec23535e6ba None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:32.140881 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29045b51-5a98-4056-83aa-7ec23535e6ba None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:32.150879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-29045b51-5a98-4056-83aa-7ec23535e6ba None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:32:32.150879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:32.150879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:32:32.150879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:32:32.150879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:32:32.150879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:32:32.150879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:32:32.150879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:32.150879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:32:32.150879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:32.150879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:32.150879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:32.150879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:32.150879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:32.150879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:32.150879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:32.150879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:32.151883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:32.151883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:32.151883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:32.151883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:32.151883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:32.151883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:32.151883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:32:32.151883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:32:32.151883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:32:32.151883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:32:32.151883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:32.151883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:32.151883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:32.151883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:32.151883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:32.151883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:32.152701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:32.152701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:32.152701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:32.152701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:32.152701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:32.152701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:32.152701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:32.152701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:32.152701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:32.152701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:32.152701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:32:32.152701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:32.152701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 09:32:32.152701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:32.152701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 405/818] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:31 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:32.153527 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29045b51-5a98-4056-83aa-7ec23535e6ba None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:32.174715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:32.220445 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75aa83f-e22f-41b8-8fab-757f73fc6f4d None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:32.230507 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:32.262204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968fe80-c156-447c-90db-1791ad623933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:32.262813 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968fe80-c156-447c-90db-1791ad623933 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:32.263093 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968fe80-c156-447c-90db-1791ad623933 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:32.263366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968fe80-c156-447c-90db-1791ad623933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:32.269011 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29045b51-5a98-4056-83aa-7ec23535e6ba None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:32.305152 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae646b-6ccc-4807-ba08-fe4b4405f128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:32.305821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae646b-6ccc-4807-ba08-fe4b4405f128 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:32.306096 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae646b-6ccc-4807-ba08-fe4b4405f128 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:32.306363 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae646b-6ccc-4807-ba08-fe4b4405f128 None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:32.306983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae646b-6ccc-4807-ba08-fe4b4405f128 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:32.307281 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae646b-6ccc-4807-ba08-fe4b4405f128 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:32.309056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae646b-6ccc-4807-ba08-fe4b4405f128 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:32.315190 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 406/819] 10.222.0.58 () {56 vars in 1124 bytes} [Wed Aug 24 09:32:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:32.315999 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae646b-6ccc-4807-ba08-fe4b4405f128 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:32.342456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968fe80-c156-447c-90db-1791ad623933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:32.343941 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968fe80-c156-447c-90db-1791ad623933 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:32.407809 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:32.426238 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae646b-6ccc-4807-ba08-fe4b4405f128 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:32.455791 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 414/820] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:32:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:32:32.457109 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968fe80-c156-447c-90db-1791ad623933 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:32.466523 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8011a0-f1d6-40a9-be7e-8cb8dd583a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:32.467272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8011a0-f1d6-40a9-be7e-8cb8dd583a69 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:32.467554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8011a0-f1d6-40a9-be7e-8cb8dd583a69 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:32.467826 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8011a0-f1d6-40a9-be7e-8cb8dd583a69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:32.472104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:32.477289 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8011a0-f1d6-40a9-be7e-8cb8dd583a69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:32.479265 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8011a0-f1d6-40a9-be7e-8cb8dd583a69 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:32.491782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-2f8011a0-f1d6-40a9-be7e-8cb8dd583a69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:32.491782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:32.491782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:32.491782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:32.491782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:32.491782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:32.491782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:32.491782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:32.491782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:32.491782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:32.491782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:32.491782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:32.491782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:32.491782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:32.491782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:32.492639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:32.492639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:32.492639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:32.492639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:32.492639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:32.492639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:32.492639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:32.492639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:32.492639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:32.492639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:32.492639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:32.492639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:32.492639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:32.492639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:32.492639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:32.492639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:32.492639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:32.493537 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:32.493537 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:32.493537 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:32.493537 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:32.493537 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:32.493537 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:32.493537 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:32.493537 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:32.497865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 407/821] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:32.498679 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8011a0-f1d6-40a9-be7e-8cb8dd583a69 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:32.565910 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968fe80-c156-447c-90db-1791ad623933 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:32.601474 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd316e52-9b73-4357-a934-382571c40725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:32.602082 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd316e52-9b73-4357-a934-382571c40725 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:32.602354 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd316e52-9b73-4357-a934-382571c40725 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:32.602628 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd316e52-9b73-4357-a934-382571c40725 None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:32.603243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd316e52-9b73-4357-a934-382571c40725 None admin] RBAC: Adding query filter params (name=network) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:32.603545 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd316e52-9b73-4357-a934-382571c40725 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:32.604890 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd316e52-9b73-4357-a934-382571c40725 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:32.606575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8011a0-f1d6-40a9-be7e-8cb8dd583a69 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:32.609639 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 415/822] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 09:32:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:32.610585 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd316e52-9b73-4357-a934-382571c40725 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:32.638075 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:32.651732 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ddbeb2-337a-4259-b60a-4e2004ce9ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:32.652338 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddbeb2-337a-4259-b60a-4e2004ce9ada None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:32.652615 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddbeb2-337a-4259-b60a-4e2004ce9ada None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:32.652888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddbeb2-337a-4259-b60a-4e2004ce9ada None admin] PATH_INFO: `/v3/endpoints` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:32.653578 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ddbeb2-337a-4259-b60a-4e2004ce9ada None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:32.654941 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ddbeb2-337a-4259-b60a-4e2004ce9ada None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:32.685579 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 408/823] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:32:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:32:32.685579 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ddbeb2-337a-4259-b60a-4e2004ce9ada None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:32.730139 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd316e52-9b73-4357-a934-382571c40725 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:32.760172 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:32.794148 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e41c4-d1c5-4359-9a6a-862ef8cddfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:32.795239 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e41c4-d1c5-4359-9a6a-862ef8cddfcd None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:32.795531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e41c4-d1c5-4359-9a6a-862ef8cddfcd None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:32.795808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e41c4-d1c5-4359-9a6a-862ef8cddfcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:32.812795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e41c4-d1c5-4359-9a6a-862ef8cddfcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:32.814676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e41c4-d1c5-4359-9a6a-862ef8cddfcd None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:32.826700 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ddbeb2-337a-4259-b60a-4e2004ce9ada None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:32.831669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-748e41c4-d1c5-4359-9a6a-862ef8cddfcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:32.831669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:32.831669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:32.831669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:32.831669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:32.831669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:32.831669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:32.831669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:32.831669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:32.831669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:32.831669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:32.831669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:32.831669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:32.831669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:32.831669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:32.831669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:32.832763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:32.832763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:32.832763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:32.832763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:32.832763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:32.832763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:32.832763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:32.832763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:32.832763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:32.832763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:32.832763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:32.832763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:32.832763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:32.832763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:32.832763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:32.832763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:32.832763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:32.833923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:32.833923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:32.833923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:32.835470 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 416/824] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:32.836387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e41c4-d1c5-4359-9a6a-862ef8cddfcd None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:32.874982 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6bfbc-59ed-4389-b813-582dc457184f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:32.875642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6bfbc-59ed-4389-b813-582dc457184f None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:32.875953 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6bfbc-59ed-4389-b813-582dc457184f None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:32.876344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6bfbc-59ed-4389-b813-582dc457184f None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:32.877960 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6bfbc-59ed-4389-b813-582dc457184f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:32.877960 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6bfbc-59ed-4389-b813-582dc457184f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:32.880032 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6bfbc-59ed-4389-b813-582dc457184f None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:32.898693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 409/825] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:32.899627 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6bfbc-59ed-4389-b813-582dc457184f None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:32.928538 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:32.964193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e41c4-d1c5-4359-9a6a-862ef8cddfcd None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:33.003236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5609c-9f37-433a-83a4-554cc5066795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:33.003841 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5609c-9f37-433a-83a4-554cc5066795 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:33.004118 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5609c-9f37-433a-83a4-554cc5066795 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:33.004387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5609c-9f37-433a-83a4-554cc5066795 None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:33.005073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5609c-9f37-433a-83a4-554cc5066795 None admin] RBAC: Adding query filter params (type=network) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:33.005421 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5609c-9f37-433a-83a4-554cc5066795 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:33.007325 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5609c-9f37-433a-83a4-554cc5066795 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:33.017001 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 417/826] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 09:32:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:33.017001 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5609c-9f37-433a-83a4-554cc5066795 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:33.040230 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6bfbc-59ed-4389-b813-582dc457184f None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:33.055303 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:33.078730 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87c87e-198a-4228-b083-5778a609edd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:33.079381 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87c87e-198a-4228-b083-5778a609edd0 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:33.079590 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87c87e-198a-4228-b083-5778a609edd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:33.079913 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87c87e-198a-4228-b083-5778a609edd0 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:33.080754 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87c87e-198a-4228-b083-5778a609edd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:33.081239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87c87e-198a-4228-b083-5778a609edd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:33.082629 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87c87e-198a-4228-b083-5778a609edd0 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:33.098989 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 410/827] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:33.100731 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87c87e-198a-4228-b083-5778a609edd0 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:33.142445 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5609c-9f37-433a-83a4-554cc5066795 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:33.187152 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033615bc-96f4-4615-a623-2898d6ff79bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:33.188065 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033615bc-96f4-4615-a623-2898d6ff79bb None admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:33.188492 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033615bc-96f4-4615-a623-2898d6ff79bb None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:33.188942 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033615bc-96f4-4615-a623-2898d6ff79bb None admin] PATH_INFO: `/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/ff2db35b94c84ec7bba96117d23baf6b/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:33.192560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033615bc-96f4-4615-a623-2898d6ff79bb None admin] RBAC: Authorizing `identity:create_grant(project_id=1c95aafd70e547d29c7647e6027faf2f, user_id=ff2db35b94c84ec7bba96117d23baf6b, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:33.194783 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033615bc-96f4-4615-a623-2898d6ff79bb None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:33.197817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:33.216851 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 418/828] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:32:33 2022] PUT /identity/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/ff2db35b94c84ec7bba96117d23baf6b/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:32:33.217927 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87c87e-198a-4228-b083-5778a609edd0 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:33.218183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033615bc-96f4-4615-a623-2898d6ff79bb None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:33.265307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a1e9e-ffe0-48c6-90d2-3b4f6f4250d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:33.269655 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a1e9e-ffe0-48c6-90d2-3b4f6f4250d5 None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:33.269655 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a1e9e-ffe0-48c6-90d2-3b4f6f4250d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:33.269655 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a1e9e-ffe0-48c6-90d2-3b4f6f4250d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:33.269655 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a1e9e-ffe0-48c6-90d2-3b4f6f4250d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:33.270098 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a1e9e-ffe0-48c6-90d2-3b4f6f4250d5 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:33.312839 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 411/829] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:32:33 2022] POST /identity/v3/endpoints => generated 337 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:32:33.414151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033615bc-96f4-4615-a623-2898d6ff79bb None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:33.473382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65edccc-f90c-46c8-9b59-86a5e2a3d6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:33.474370 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65edccc-f90c-46c8-9b59-86a5e2a3d6cd None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:33.474720 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65edccc-f90c-46c8-9b59-86a5e2a3d6cd None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:33.475063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65edccc-f90c-46c8-9b59-86a5e2a3d6cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:33.483140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65edccc-f90c-46c8-9b59-86a5e2a3d6cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:33.484719 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65edccc-f90c-46c8-9b59-86a5e2a3d6cd None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:33.498072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-c65edccc-f90c-46c8-9b59-86a5e2a3d6cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:33.498072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:33.498072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:33.498072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:33.498072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:33.498072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:33.498072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:33.498072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:33.498072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:33.498072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:33.498072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:33.498072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:33.498072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:33.498072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:33.498072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:33.499193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:33.499193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:33.499193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:33.499193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:33.499193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:33.499193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:33.499193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:33.499193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:33.499193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:33.499193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:33.499193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:33.499193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:33.499193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:33.499193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:33.499193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:33.499193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:33.499193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:33.500366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:33.500366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:33.500366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:33.500366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:33.500366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:33.500366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:33.500366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:33.500366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:33.503153 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 419/830] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:33.510064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a1e9e-ffe0-48c6-90d2-3b4f6f4250d5 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:33.543287 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:33.622672 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a1e9e-ffe0-48c6-90d2-3b4f6f4250d5 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:33.664953 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f04f38-9e72-446e-b4b5-7cd874dd34e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:33.665702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f04f38-9e72-446e-b4b5-7cd874dd34e9 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:33.666058 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f04f38-9e72-446e-b4b5-7cd874dd34e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:33.666399 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f04f38-9e72-446e-b4b5-7cd874dd34e9 None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:33.667185 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f04f38-9e72-446e-b4b5-7cd874dd34e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:33.667559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f04f38-9e72-446e-b4b5-7cd874dd34e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:33.669061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f04f38-9e72-446e-b4b5-7cd874dd34e9 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:33.688170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 412/831] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:33.690213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65edccc-f90c-46c8-9b59-86a5e2a3d6cd None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:33.753694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:33.825710 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65edccc-f90c-46c8-9b59-86a5e2a3d6cd None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:33.831011 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85310390-0fd3-42a9-ae88-7cc8f78757d8 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:33.831295 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85310390-0fd3-42a9-ae88-7cc8f78757d8 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:33.831656 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85310390-0fd3-42a9-ae88-7cc8f78757d8 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:33.833273 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 413/832] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:33.838656 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb061a6-7316-482e-8678-5dc43ad649be None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:33.838941 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb061a6-7316-482e-8678-5dc43ad649be None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:33.839269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb061a6-7316-482e-8678-5dc43ad649be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:33.862563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-5bb061a6-7316-482e-8678-5dc43ad649be None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:33.864006 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-5bb061a6-7316-482e-8678-5dc43ad649be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:33.875626 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac71bd0-5515-43ab-84d1-874b9568349a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:33.876241 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac71bd0-5515-43ab-84d1-874b9568349a None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:33.876523 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac71bd0-5515-43ab-84d1-874b9568349a None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:33.876801 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac71bd0-5515-43ab-84d1-874b9568349a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:33.877806 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac71bd0-5515-43ab-84d1-874b9568349a None admin] RBAC: Adding query filter params (role.id=cd2effe8340d4be08a28d3a40db6979d, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=18be8c54c9644c5e9812eea09e60c11c) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:33.878119 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac71bd0-5515-43ab-84d1-874b9568349a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:33.879563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac71bd0-5515-43ab-84d1-874b9568349a None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:33.886261 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 420/833] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:32:33 2022] GET /identity/v3/role_assignments?user.id=18be8c54c9644c5e9812eea09e60c11c&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=cd2effe8340d4be08a28d3a40db6979d => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:33.947460 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 414/834] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:32:34.221735 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac71bd0-5515-43ab-84d1-874b9568349a None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:34.331539 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac71bd0-5515-43ab-84d1-874b9568349a None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:34.345993 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:34.367313 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a34f38-dc6a-4899-b060-658922171a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:34.367951 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a34f38-dc6a-4899-b060-658922171a11 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:34.368232 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a34f38-dc6a-4899-b060-658922171a11 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:34.368509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a34f38-dc6a-4899-b060-658922171a11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:34.380352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a34f38-dc6a-4899-b060-658922171a11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:32:34.385586 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-64a34f38-dc6a-4899-b060-658922171a11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:34.385586 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:34.385586 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:34.385586 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:34.385586 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:34.385586 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:34.385586 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:34.385586 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:34.385586 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:34.385586 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:34.385586 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:34.385586 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:34.385586 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:32:34.385586 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:32:34.385586 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:32:34.385586 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:32:34.386473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:32:34.386473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:32:34.386473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:32:34.386473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:32:34.386473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:34.386473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:34.386473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:34.386473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:34.386473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:34.386473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:34.386473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:34.386473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:34.386473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:34.386473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:34.386473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:34.386473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:34.387278 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:34.387278 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:34.387278 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:34.387278 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:34.387278 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:32:34.387278 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:32:34.387278 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:32:34.387278 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:32:34.387278 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:32:34.387278 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:32:34.387278 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:32:34.387278 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:34.387278 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 421/835] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:32:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:34.393551 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb061a6-7316-482e-8678-5dc43ad649be None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:34.421865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:34.506965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb061a6-7316-482e-8678-5dc43ad649be None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:34.543740 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca01d6-87d3-4d08-a756-3477e91ce0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:34.544349 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca01d6-87d3-4d08-a756-3477e91ce0e4 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:34.544632 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca01d6-87d3-4d08-a756-3477e91ce0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:34.544910 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca01d6-87d3-4d08-a756-3477e91ce0e4 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:34.545668 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca01d6-87d3-4d08-a756-3477e91ce0e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:34.545978 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca01d6-87d3-4d08-a756-3477e91ce0e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:34.547343 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca01d6-87d3-4d08-a756-3477e91ce0e4 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:34.556352 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 415/836] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 09:32:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:34.562023 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a34f38-dc6a-4899-b060-658922171a11 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:34.672843 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a34f38-dc6a-4899-b060-658922171a11 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:34.707496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f63e6-9ce9-49cd-927a-34b3f62090f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:34.708186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f63e6-9ce9-49cd-927a-34b3f62090f3 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:34.708471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f63e6-9ce9-49cd-927a-34b3f62090f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:34.708750 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f63e6-9ce9-49cd-927a-34b3f62090f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:34.720160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f63e6-9ce9-49cd-927a-34b3f62090f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:34.722183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f63e6-9ce9-49cd-927a-34b3f62090f3 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:34.737304 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-532f63e6-9ce9-49cd-927a-34b3f62090f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:34.737304 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:34.737304 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:34.737304 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:34.737304 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:34.737304 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:34.737304 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:34.737304 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:34.737304 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:34.737304 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:34.737304 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:34.737304 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:34.737304 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:34.737304 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:34.737304 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:34.737304 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:34.738299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:34.738299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:34.738299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:34.738299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:34.738299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:34.738299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:34.738299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:34.738299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:34.738299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:34.738299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:34.738299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:34.738299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:34.738299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:34.738299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:34.738299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:34.738299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:34.738299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:34.739191 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:34.739191 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:34.739191 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:34.739191 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 422/837] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:34.744789 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca01d6-87d3-4d08-a756-3477e91ce0e4 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:34.837520 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:34.846245 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c69481-3c73-429e-a853-a67ea346a337 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:34.847726 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c69481-3c73-429e-a853-a67ea346a337 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:34.848212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c69481-3c73-429e-a853-a67ea346a337 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:34.850118 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 423/838] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:34.854903 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27a4b6-f12f-424e-870f-7acfd128154a None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:34.855188 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27a4b6-f12f-424e-870f-7acfd128154a None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:34.855463 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27a4b6-f12f-424e-870f-7acfd128154a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:34.865567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca01d6-87d3-4d08-a756-3477e91ce0e4 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:34.875340 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-0c27a4b6-f12f-424e-870f-7acfd128154a None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:34.876637 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-0c27a4b6-f12f-424e-870f-7acfd128154a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:34.902524 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:34.903161 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a12d8-e978-4e81-a2dc-bbf62593da99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:34.903780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a12d8-e978-4e81-a2dc-bbf62593da99 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:34.904217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a12d8-e978-4e81-a2dc-bbf62593da99 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:34.904621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a12d8-e978-4e81-a2dc-bbf62593da99 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:34.905285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a12d8-e978-4e81-a2dc-bbf62593da99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:34.905822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a12d8-e978-4e81-a2dc-bbf62593da99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:34.909647 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a12d8-e978-4e81-a2dc-bbf62593da99 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:34.928039 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 416/839] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:34.933831 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a12d8-e978-4e81-a2dc-bbf62593da99 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:34.956663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 424/840] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:32:35.053542 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a12d8-e978-4e81-a2dc-bbf62593da99 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:35.092262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fe761-db5f-49ed-88e3-fc7e51053dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:35.092818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fe761-db5f-49ed-88e3-fc7e51053dea None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:35.093101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fe761-db5f-49ed-88e3-fc7e51053dea None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:35.093375 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fe761-db5f-49ed-88e3-fc7e51053dea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:35.101398 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fe761-db5f-49ed-88e3-fc7e51053dea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:35.102870 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fe761-db5f-49ed-88e3-fc7e51053dea None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:35.105591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:35.116728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-1d4fe761-db5f-49ed-88e3-fc7e51053dea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:32:35.116728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:35.116728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:35.116728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:35.116728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:35.116728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:35.116728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:35.116728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:35.116728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:35.116728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:35.116728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:35.116728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:35.116728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:35.116728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:35.116728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:35.116728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:35.117724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:35.117724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:35.117724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:35.117724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:35.117724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:35.117724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:35.117724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:35.117724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:35.117724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:35.117724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:35.117724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:35.117724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:35.117724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:35.117724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:35.117724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:35.117724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:35.117724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:35.117724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:35.118675 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:35.118675 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:35.118675 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:35.118675 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:35.118675 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:35.118675 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:35.118675 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:35.118675 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:35.118675 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:32:35.118675 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:35.123023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 417/841] 10.222.0.58 () {56 vars in 1117 bytes} [Wed Aug 24 09:32:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:35.129840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27a4b6-f12f-424e-870f-7acfd128154a None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:35.231953 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27a4b6-f12f-424e-870f-7acfd128154a None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:35.257831 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fe761-db5f-49ed-88e3-fc7e51053dea None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:35.271943 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89334472-ccc9-444d-af37-4024ee58adf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:35.272837 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89334472-ccc9-444d-af37-4024ee58adf2 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:35.273123 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89334472-ccc9-444d-af37-4024ee58adf2 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:35.273397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89334472-ccc9-444d-af37-4024ee58adf2 None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:35.274337 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89334472-ccc9-444d-af37-4024ee58adf2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:35.274691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89334472-ccc9-444d-af37-4024ee58adf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:35.276900 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89334472-ccc9-444d-af37-4024ee58adf2 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:35.301022 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 425/842] 10.222.0.58 () {56 vars in 1149 bytes} [Wed Aug 24 09:32:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:35.306256 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89334472-ccc9-444d-af37-4024ee58adf2 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:35.341884 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:35.372536 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fe761-db5f-49ed-88e3-fc7e51053dea None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:35.415759 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4d819-d2b3-4220-9d7f-5f32328efc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:35.416558 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4d819-d2b3-4220-9d7f-5f32328efc57 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:35.416935 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89334472-ccc9-444d-af37-4024ee58adf2 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:35.417056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4d819-d2b3-4220-9d7f-5f32328efc57 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:35.417423 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4d819-d2b3-4220-9d7f-5f32328efc57 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:35.418144 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4d819-d2b3-4220-9d7f-5f32328efc57 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:35.420573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4d819-d2b3-4220-9d7f-5f32328efc57 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:35.432564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-3af4d819-d2b3-4220-9d7f-5f32328efc57 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:32:35.432564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:35.432564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:32:35.432564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:32:35.432564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:32:35.432564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:32:35.432564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:32:35.432564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:35.432564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:32:35.432564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:35.432564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:35.432564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:35.432564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:35.432564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:35.432564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:35.432564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:35.432564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:35.433837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:35.433837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:35.433837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:35.433837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:35.433837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:35.433837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:35.433837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:32:35.433837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:32:35.433837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:32:35.433837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:32:35.433837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:35.433837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:35.433837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:35.433837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:35.433837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:35.433837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:35.434883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:35.434883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:35.434883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:35.434883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:35.434883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:35.434883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:35.434883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:35.434883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:35.434883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:35.434883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:35.434883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:32:35.434883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:35.434883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:32:35.434883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:35.437555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 418/843] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 09:32:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:32:35.441938 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4d819-d2b3-4220-9d7f-5f32328efc57 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:35.459927 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2b03a-8b7a-40b9-a558-3d526bc13b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:35.460749 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2b03a-8b7a-40b9-a558-3d526bc13b1b None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:35.461129 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2b03a-8b7a-40b9-a558-3d526bc13b1b None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:35.461536 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2b03a-8b7a-40b9-a558-3d526bc13b1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:35.521935 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:35.537370 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2b03a-8b7a-40b9-a558-3d526bc13b1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:35.539600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2b03a-8b7a-40b9-a558-3d526bc13b1b None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:35.556050 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:35.561233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4d819-d2b3-4220-9d7f-5f32328efc57 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:35.600206 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c509635-b1e2-47b0-851a-aa3b07b5b35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:35.600808 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c509635-b1e2-47b0-851a-aa3b07b5b35c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:35.601085 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c509635-b1e2-47b0-851a-aa3b07b5b35c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:35.601357 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c509635-b1e2-47b0-851a-aa3b07b5b35c None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:35.602009 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c509635-b1e2-47b0-851a-aa3b07b5b35c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:35.602311 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c509635-b1e2-47b0-851a-aa3b07b5b35c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:35.603655 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c509635-b1e2-47b0-851a-aa3b07b5b35c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:35.612974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 419/844] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 09:32:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:35.612974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b117487-f9ab-4a77-90ca-fed5c65aa6a1 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:35.612974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b117487-f9ab-4a77-90ca-fed5c65aa6a1 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:35.612974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b117487-f9ab-4a77-90ca-fed5c65aa6a1 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:35.616210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 420/845] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:35.617291 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49ac46-032e-4bf8-89b8-a4b3067a851d None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:35.617595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49ac46-032e-4bf8-89b8-a4b3067a851d None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:35.618542 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49ac46-032e-4bf8-89b8-a4b3067a851d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:35.636653 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-0c49ac46-032e-4bf8-89b8-a4b3067a851d None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:35.637903 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-0c49ac46-032e-4bf8-89b8-a4b3067a851d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:35.652398 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 426/846] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:32:35 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:32:35.653946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2b03a-8b7a-40b9-a558-3d526bc13b1b None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:35.716446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 421/847] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:32:35.717678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49ac46-032e-4bf8-89b8-a4b3067a851d None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:35.775217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2b03a-8b7a-40b9-a558-3d526bc13b1b None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:35.791954 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:35.815423 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:35.815980 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9971582-9543-413a-8d3b-a9d4cd7ed63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:35.816986 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9971582-9543-413a-8d3b-a9d4cd7ed63f None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:35.817722 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9971582-9543-413a-8d3b-a9d4cd7ed63f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:35.818362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9971582-9543-413a-8d3b-a9d4cd7ed63f None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:35.819184 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9971582-9543-413a-8d3b-a9d4cd7ed63f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:35.819708 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9971582-9543-413a-8d3b-a9d4cd7ed63f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:35.821294 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9971582-9543-413a-8d3b-a9d4cd7ed63f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:35.826683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 427/848] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 09:32:35 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:35.857781 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49ac46-032e-4bf8-89b8-a4b3067a851d None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:35.898101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2be7b-e3d3-4c98-824c-e43932eca3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:35.898657 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2be7b-e3d3-4c98-824c-e43932eca3f5 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:35.898933 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2be7b-e3d3-4c98-824c-e43932eca3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:35.899205 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2be7b-e3d3-4c98-824c-e43932eca3f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:35.911416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2be7b-e3d3-4c98-824c-e43932eca3f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:35.912883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2be7b-e3d3-4c98-824c-e43932eca3f5 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:35.930434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-a1b2be7b-e3d3-4c98-824c-e43932eca3f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:35.930434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:35.930434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:35.930434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:35.930434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:35.930434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:35.930434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:35.930434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:35.930434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:35.930434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:35.930434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:35.930434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:35.930434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:35.930434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:35.930434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:35.930434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:35.931430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:35.931430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:35.931430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:35.931430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:35.931430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:35.931430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:35.931430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:35.931430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:35.931430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:35.931430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:35.931430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:35.931430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:35.931430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:35.931430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:35.931430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:35.931430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:35.931430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:35.932317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:35.932317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:35.932317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:35.932317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 422/849] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:35.937443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9971582-9543-413a-8d3b-a9d4cd7ed63f None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:35.961337 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe449a-519f-4418-86a0-63501d5c5952 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:35.961718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe449a-519f-4418-86a0-63501d5c5952 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:35.961911 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe449a-519f-4418-86a0-63501d5c5952 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:35.963526 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 423/850] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:35.968935 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0ef40-36a9-4de0-b5c4-b29f1b7e5bdd None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:35.969218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0ef40-36a9-4de0-b5c4-b29f1b7e5bdd None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:35.969503 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0ef40-36a9-4de0-b5c4-b29f1b7e5bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:35.990541 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-9da0ef40-36a9-4de0-b5c4-b29f1b7e5bdd None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:35.991767 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-9da0ef40-36a9-4de0-b5c4-b29f1b7e5bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:36.055688 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9971582-9543-413a-8d3b-a9d4cd7ed63f None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:36.073923 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 424/851] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:32:36.073923 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0ef40-36a9-4de0-b5c4-b29f1b7e5bdd None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:36.104339 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734c33d-a8be-4882-a61f-d8d1991ec115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:36.105197 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734c33d-a8be-4882-a61f-d8d1991ec115 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:36.105746 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734c33d-a8be-4882-a61f-d8d1991ec115 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:36.106229 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734c33d-a8be-4882-a61f-d8d1991ec115 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:36.107092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734c33d-a8be-4882-a61f-d8d1991ec115 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:36.107598 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734c33d-a8be-4882-a61f-d8d1991ec115 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:36.109419 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734c33d-a8be-4882-a61f-d8d1991ec115 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:36.122033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 428/852] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:36.123510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:36.130159 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734c33d-a8be-4882-a61f-d8d1991ec115 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:36.171945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:36.186810 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0ef40-36a9-4de0-b5c4-b29f1b7e5bdd None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:36.225126 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b2544-72ba-4fce-8c9f-359f91210d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:36.225126 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b2544-72ba-4fce-8c9f-359f91210d35 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:36.225126 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b2544-72ba-4fce-8c9f-359f91210d35 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:36.225126 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b2544-72ba-4fce-8c9f-359f91210d35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:36.235773 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b2544-72ba-4fce-8c9f-359f91210d35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:32:36.241335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-695b2544-72ba-4fce-8c9f-359f91210d35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:32:36.241335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:36.241335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:36.241335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:36.241335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:36.241335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:36.241335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:36.241335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:36.241335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:36.241335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:36.241335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:36.241335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:36.241335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:32:36.241335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:32:36.241335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:32:36.241335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:32:36.242504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:32:36.242504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:32:36.242504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:32:36.242504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:32:36.242504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:36.242504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:36.242504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:36.242504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:36.242504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:36.242504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:36.242504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:36.242504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:36.242504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:36.242504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:36.242504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:36.242504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:36.243583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:36.243583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:36.243583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:36.243583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:36.243583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:32:36.243583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:32:36.243583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:32:36.243583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:32:36.243583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:32:36.243583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:32:36.243583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:32:36.243583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:36.243583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 425/853] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:32:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:36.249176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b2544-72ba-4fce-8c9f-359f91210d35 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:36.259888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734c33d-a8be-4882-a61f-d8d1991ec115 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:36.309966 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d5933-2f0c-4225-bb73-84d448cd1564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:36.311087 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d5933-2f0c-4225-bb73-84d448cd1564 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:36.311572 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d5933-2f0c-4225-bb73-84d448cd1564 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:36.312121 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d5933-2f0c-4225-bb73-84d448cd1564 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:36.320690 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d5933-2f0c-4225-bb73-84d448cd1564 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:36.322603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d5933-2f0c-4225-bb73-84d448cd1564 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:36.335706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-740d5933-2f0c-4225-bb73-84d448cd1564 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:36.335706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:36.335706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:36.335706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:36.335706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:36.335706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:36.335706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:36.335706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:36.335706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:36.335706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:36.335706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:36.335706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:36.335706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:36.335706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:36.335706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:36.336640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:36.336640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:36.336640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:36.336640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:36.336640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:36.336640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:36.336640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:36.336640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:36.336640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:36.336640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:36.336640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:36.336640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:36.336640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:36.336640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:36.336640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:36.336640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:36.336640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:36.337533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:36.337533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:36.337533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:36.337533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:36.337533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:36.337533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:36.337533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:36.337533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:36.340094 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 429/854] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:36.343656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d5933-2f0c-4225-bb73-84d448cd1564 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:36.374194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:36.378108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b2544-72ba-4fce-8c9f-359f91210d35 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:36.418998 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa179419-eabe-4702-889b-3acf698ca0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:36.420293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa179419-eabe-4702-889b-3acf698ca0f4 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:36.420728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa179419-eabe-4702-889b-3acf698ca0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:36.421179 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa179419-eabe-4702-889b-3acf698ca0f4 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:36.422097 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa179419-eabe-4702-889b-3acf698ca0f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:36.422546 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa179419-eabe-4702-889b-3acf698ca0f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:36.424782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa179419-eabe-4702-889b-3acf698ca0f4 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:36.442316 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 426/855] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:32:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:36.443281 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa179419-eabe-4702-889b-3acf698ca0f4 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:36.458625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:36.463367 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d5933-2f0c-4225-bb73-84d448cd1564 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:36.501695 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7df3d9-166f-4aa6-b530-08cb96a53a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:36.502484 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df3d9-166f-4aa6-b530-08cb96a53a60 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:36.502776 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df3d9-166f-4aa6-b530-08cb96a53a60 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:36.503052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df3d9-166f-4aa6-b530-08cb96a53a60 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:36.503641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7df3d9-166f-4aa6-b530-08cb96a53a60 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:36.505004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7df3d9-166f-4aa6-b530-08cb96a53a60 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:36.513924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-9a7df3d9-166f-4aa6-b530-08cb96a53a60 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:32:36.513924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:36.513924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:32:36.513924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:32:36.513924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:32:36.513924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:32:36.513924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:32:36.513924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:36.513924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:32:36.513924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:36.513924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:36.513924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:36.513924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:36.513924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:36.513924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:36.513924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:36.514887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:36.514887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:36.514887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:36.514887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:36.514887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:36.514887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:36.514887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:36.514887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:32:36.514887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:32:36.514887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:32:36.514887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:32:36.514887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:36.514887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:36.514887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:36.514887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:36.514887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:36.514887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:36.516361 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:36.516361 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:36.516361 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:36.516361 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:36.516361 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:36.516361 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:36.516361 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:36.516361 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:36.516361 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:36.516361 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:36.516361 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:32:36.516361 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:36.516361 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:32:36.516361 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:36.516361 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 430/856] 10.222.0.58 () {56 vars in 1132 bytes} [Wed Aug 24 09:32:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:32:36.520739 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7df3d9-166f-4aa6-b530-08cb96a53a60 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:36.555750 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa179419-eabe-4702-889b-3acf698ca0f4 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:36.589961 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190be54-e081-41a6-8231-c442bfc48a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:36.590557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190be54-e081-41a6-8231-c442bfc48a2d None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:36.590836 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190be54-e081-41a6-8231-c442bfc48a2d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:36.591107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190be54-e081-41a6-8231-c442bfc48a2d None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:36.591783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190be54-e081-41a6-8231-c442bfc48a2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:36.592090 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190be54-e081-41a6-8231-c442bfc48a2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:36.593520 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2190be54-e081-41a6-8231-c442bfc48a2d None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:36.606070 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 427/857] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:36.606853 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190be54-e081-41a6-8231-c442bfc48a2d None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:36.633661 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7df3d9-166f-4aa6-b530-08cb96a53a60 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:36.634233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:36.670446 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122748a0-c8d3-4a02-a084-704f86f65405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:36.671664 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122748a0-c8d3-4a02-a084-704f86f65405 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:36.672161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122748a0-c8d3-4a02-a084-704f86f65405 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:36.672379 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122748a0-c8d3-4a02-a084-704f86f65405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:36.683268 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122748a0-c8d3-4a02-a084-704f86f65405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:36.684909 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122748a0-c8d3-4a02-a084-704f86f65405 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:36.700959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-122748a0-c8d3-4a02-a084-704f86f65405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:36.700959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:36.700959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:36.700959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:36.700959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:36.700959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:36.700959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:36.700959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:36.700959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:36.700959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:36.700959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:36.700959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:36.700959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:36.700959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:36.700959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:36.700959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:36.701977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:36.701977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:36.701977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:36.701977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:36.701977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:36.701977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:36.701977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:36.701977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:36.701977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:36.701977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:36.701977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:36.701977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:36.701977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:36.701977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:36.701977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:36.701977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:36.701977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:36.702847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:36.702847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:36.702847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:36.707337 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 431/858] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:36.708215 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122748a0-c8d3-4a02-a084-704f86f65405 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:36.716042 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190be54-e081-41a6-8231-c442bfc48a2d None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:36.724893 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:36.755831 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ef085-d0f6-432c-b247-cbc7092a50ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:36.756516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ef085-d0f6-432c-b247-cbc7092a50ac None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:36.756725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ef085-d0f6-432c-b247-cbc7092a50ac None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:36.756997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ef085-d0f6-432c-b247-cbc7092a50ac None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:36.757666 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ef085-d0f6-432c-b247-cbc7092a50ac None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:36.757973 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ef085-d0f6-432c-b247-cbc7092a50ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:36.759332 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ef085-d0f6-432c-b247-cbc7092a50ac None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:36.770137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 428/859] 10.222.0.58 () {56 vars in 1126 bytes} [Wed Aug 24 09:32:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:36.772533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ef085-d0f6-432c-b247-cbc7092a50ac None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:36.826665 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122748a0-c8d3-4a02-a084-704f86f65405 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:36.863554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70053193-2ff5-46db-a82e-4f3c53fdb099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:36.864158 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70053193-2ff5-46db-a82e-4f3c53fdb099 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:36.864438 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70053193-2ff5-46db-a82e-4f3c53fdb099 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:36.864711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70053193-2ff5-46db-a82e-4f3c53fdb099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:36.865423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70053193-2ff5-46db-a82e-4f3c53fdb099 None admin] RBAC: Adding query filter params (role.id=85dac7b70cf04091baaf69caabd27a8b, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=3ae62427d5914e67b5b4d0237ecccd06) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:36.865761 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70053193-2ff5-46db-a82e-4f3c53fdb099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:36.866715 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:36.867183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70053193-2ff5-46db-a82e-4f3c53fdb099 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:36.881886 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 432/860] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:32:36 2022] GET /identity/v3/role_assignments?user.id=3ae62427d5914e67b5b4d0237ecccd06&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=85dac7b70cf04091baaf69caabd27a8b => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:36.883404 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70053193-2ff5-46db-a82e-4f3c53fdb099 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:36.884439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ef085-d0f6-432c-b247-cbc7092a50ac None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:36.935231 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b4114-2877-42e8-8ee8-c5cb83342013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:36.935934 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b4114-2877-42e8-8ee8-c5cb83342013 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:36.936428 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b4114-2877-42e8-8ee8-c5cb83342013 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:36.937064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b4114-2877-42e8-8ee8-c5cb83342013 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:36.939366 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b4114-2877-42e8-8ee8-c5cb83342013 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:36.939905 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b4114-2877-42e8-8ee8-c5cb83342013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:36.942001 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b4114-2877-42e8-8ee8-c5cb83342013 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:36.965191 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 429/861] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:36.967057 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b4114-2877-42e8-8ee8-c5cb83342013 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:37.000497 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:37.037126 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70053193-2ff5-46db-a82e-4f3c53fdb099 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:37.087832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68163068-2e02-4fae-999d-e5aa411e91f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:37.088440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68163068-2e02-4fae-999d-e5aa411e91f1 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:37.089147 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68163068-2e02-4fae-999d-e5aa411e91f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:37.089436 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68163068-2e02-4fae-999d-e5aa411e91f1 None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:37.090109 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68163068-2e02-4fae-999d-e5aa411e91f1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:37.090413 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68163068-2e02-4fae-999d-e5aa411e91f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:37.092337 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68163068-2e02-4fae-999d-e5aa411e91f1 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:37.104958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 433/862] 10.222.0.58 () {56 vars in 1126 bytes} [Wed Aug 24 09:32:36 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:37.105162 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b4114-2877-42e8-8ee8-c5cb83342013 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:37.145155 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e822d7a-0604-423d-841c-5cd3acc2a88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:37.145902 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e822d7a-0604-423d-841c-5cd3acc2a88e None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:37.146183 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e822d7a-0604-423d-841c-5cd3acc2a88e None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:37.146453 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e822d7a-0604-423d-841c-5cd3acc2a88e None admin] PATH_INFO: `/v3/users/swift` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:37.157428 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e822d7a-0604-423d-841c-5cd3acc2a88e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:37.159080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e822d7a-0604-423d-841c-5cd3acc2a88e None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:37.171712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-0e822d7a-0604-423d-841c-5cd3acc2a88e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:32:37.171712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:37.171712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:37.171712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:37.171712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:37.171712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:37.171712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:37.171712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:37.171712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:37.171712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:37.171712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:37.171712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:37.171712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:37.171712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:37.171712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:37.171712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:37.172735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:37.172735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:37.172735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:37.172735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:37.172735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:37.172735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:37.172735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:37.172735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:37.172735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:37.172735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:37.172735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:37.172735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:37.172735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:37.172735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:37.172735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:37.172735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:37.172735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:37.172735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:37.173898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:37.173898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:37.173898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:37.173898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:37.173898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:37.173898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:37.173898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:37.173898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:37.173898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 09:32:37.173898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:37.175216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 430/863] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:32:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:32:37.179574 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68163068-2e02-4fae-999d-e5aa411e91f1 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:37.304441 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68163068-2e02-4fae-999d-e5aa411e91f1 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:37.345750 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e637a8-247b-4eb2-8e7d-1a8a26be7c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:37.346847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e637a8-247b-4eb2-8e7d-1a8a26be7c32 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:37.347331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e637a8-247b-4eb2-8e7d-1a8a26be7c32 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:37.347806 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e637a8-247b-4eb2-8e7d-1a8a26be7c32 None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:37.348782 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e637a8-247b-4eb2-8e7d-1a8a26be7c32 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:37.349287 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e637a8-247b-4eb2-8e7d-1a8a26be7c32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:37.351010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e637a8-247b-4eb2-8e7d-1a8a26be7c32 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:37.367163 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:37.371906 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 434/864] 10.222.0.58 () {56 vars in 1135 bytes} [Wed Aug 24 09:32:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:37.379741 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e822d7a-0604-423d-841c-5cd3acc2a88e None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:37.389836 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:37.498998 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e822d7a-0604-423d-841c-5cd3acc2a88e None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:37.536866 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9589a9-e6d7-48a3-957f-d8b5bc445878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:37.537879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9589a9-e6d7-48a3-957f-d8b5bc445878 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:37.538364 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9589a9-e6d7-48a3-957f-d8b5bc445878 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:37.538857 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9589a9-e6d7-48a3-957f-d8b5bc445878 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:37.612743 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9589a9-e6d7-48a3-957f-d8b5bc445878 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:37.614223 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9589a9-e6d7-48a3-957f-d8b5bc445878 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:37.626305 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:37.722554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 431/865] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:32:37 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:32:37.728247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e637a8-247b-4eb2-8e7d-1a8a26be7c32 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:37.829169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e71241-202e-43e7-b2db-ded65941005c None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:37.829360 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e71241-202e-43e7-b2db-ded65941005c None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:37.829668 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e71241-202e-43e7-b2db-ded65941005c None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:37.831327 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 432/866] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:37.836676 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75811d7b-0f02-4b0e-bdc6-c9f49d62875d None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:37.841242 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75811d7b-0f02-4b0e-bdc6-c9f49d62875d None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:37.844866 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75811d7b-0f02-4b0e-bdc6-c9f49d62875d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:37.846047 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e637a8-247b-4eb2-8e7d-1a8a26be7c32 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:37.871421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-75811d7b-0f02-4b0e-bdc6-c9f49d62875d None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:37.873039 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-75811d7b-0f02-4b0e-bdc6-c9f49d62875d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:37.887753 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbcd19-338d-4e70-8f4b-72f031918d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:37.888693 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbcd19-338d-4e70-8f4b-72f031918d6e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:37.889120 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbcd19-338d-4e70-8f4b-72f031918d6e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:37.889569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbcd19-338d-4e70-8f4b-72f031918d6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:37.901022 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbcd19-338d-4e70-8f4b-72f031918d6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:37.902726 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbcd19-338d-4e70-8f4b-72f031918d6e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:37.918925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-a1cbcd19-338d-4e70-8f4b-72f031918d6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:37.918925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:37.918925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:37.918925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:37.918925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:37.918925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:37.918925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:37.918925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:37.918925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:37.918925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:37.918925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:37.918925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:37.918925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:37.918925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:37.918925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:37.918925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:37.920054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:37.920054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:37.920054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:37.920054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:37.920054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:37.920054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:37.920054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:37.920054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:37.920054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:37.920054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:37.920054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:37.920054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:37.920054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:37.920054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:37.920054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:37.920054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:37.920054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:37.921128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:37.921128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:37.921128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:37.923006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 435/867] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:37.929490 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbcd19-338d-4e70-8f4b-72f031918d6e None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:37.952025 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 433/868] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:32:37.993171 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:38.044716 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbcd19-338d-4e70-8f4b-72f031918d6e None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:38.081616 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7ec86-8e5e-4e9f-a592-f934ac07ea79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:38.082150 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7ec86-8e5e-4e9f-a592-f934ac07ea79 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:38.082425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7ec86-8e5e-4e9f-a592-f934ac07ea79 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:38.082696 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7ec86-8e5e-4e9f-a592-f934ac07ea79 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:38.083337 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca7ec86-8e5e-4e9f-a592-f934ac07ea79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:38.083636 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca7ec86-8e5e-4e9f-a592-f934ac07ea79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:38.084987 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca7ec86-8e5e-4e9f-a592-f934ac07ea79 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:38.102229 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 436/869] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:38.103869 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75811d7b-0f02-4b0e-bdc6-c9f49d62875d None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:38.142339 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:38.216369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75811d7b-0f02-4b0e-bdc6-c9f49d62875d None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:38.226325 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7ec86-8e5e-4e9f-a592-f934ac07ea79 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:38.254464 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc96b6-68e5-4714-801c-8b10b2159173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:38.255248 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc96b6-68e5-4714-801c-8b10b2159173 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:38.255595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc96b6-68e5-4714-801c-8b10b2159173 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:38.255943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc96b6-68e5-4714-801c-8b10b2159173 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:38.263660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc96b6-68e5-4714-801c-8b10b2159173 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:38.265245 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc96b6-68e5-4714-801c-8b10b2159173 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:38.278966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-eacc96b6-68e5-4714-801c-8b10b2159173 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:38.278966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:38.278966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:38.278966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:38.278966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:38.278966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:38.278966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:38.278966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:38.278966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:38.278966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:38.278966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:38.278966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:38.278966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:38.278966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:38.278966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:38.279900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:38.279900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:38.279900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:38.279900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:38.279900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:38.279900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:38.279900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:38.279900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:38.279900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:38.279900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:38.279900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:38.279900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:38.279900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:38.279900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:38.279900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:38.279900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:38.279900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:38.280746 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:38.280746 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:38.280746 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:38.280746 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:38.280746 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:38.280746 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:38.280746 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:38.280746 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:38.280746 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 434/870] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:38.287311 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc96b6-68e5-4714-801c-8b10b2159173 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:38.368448 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7ec86-8e5e-4e9f-a592-f934ac07ea79 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:38.384826 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:38.396107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:38.405019 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc96b6-68e5-4714-801c-8b10b2159173 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:38.419145 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ab853-a9cf-48be-a07e-e9b8c3e00abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:38.420383 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ab853-a9cf-48be-a07e-e9b8c3e00abf None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:38.420761 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ab853-a9cf-48be-a07e-e9b8c3e00abf None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:38.421299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ab853-a9cf-48be-a07e-e9b8c3e00abf None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:38.421996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ab853-a9cf-48be-a07e-e9b8c3e00abf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:38.424108 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ab853-a9cf-48be-a07e-e9b8c3e00abf None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:38.441900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fc8b3-edff-416d-8a07-7494b4efe0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:38.442707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fc8b3-edff-416d-8a07-7494b4efe0d8 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:38.443171 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fc8b3-edff-416d-8a07-7494b4efe0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:38.443535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 437/871] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 09:32:38 2022] POST /identity/v3/services => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:32:38.449725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fc8b3-edff-416d-8a07-7494b4efe0d8 None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:38.450559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fc8b3-edff-416d-8a07-7494b4efe0d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:38.450875 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fc8b3-edff-416d-8a07-7494b4efe0d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:38.452344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fc8b3-edff-416d-8a07-7494b4efe0d8 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:38.472383 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 435/872] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:38.478497 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ab853-a9cf-48be-a07e-e9b8c3e00abf None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:38.602036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ab853-a9cf-48be-a07e-e9b8c3e00abf None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:38.639479 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7eee27-3981-4506-abf3-8c7f86422e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:38.640010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7eee27-3981-4506-abf3-8c7f86422e24 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:38.640417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7eee27-3981-4506-abf3-8c7f86422e24 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:38.640695 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7eee27-3981-4506-abf3-8c7f86422e24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:38.641419 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7eee27-3981-4506-abf3-8c7f86422e24 None admin] RBAC: Adding query filter params (role.id=cd2effe8340d4be08a28d3a40db6979d, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=ff2db35b94c84ec7bba96117d23baf6b) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:38.641811 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7eee27-3981-4506-abf3-8c7f86422e24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:38.643986 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7eee27-3981-4506-abf3-8c7f86422e24 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:38.650637 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 438/873] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:32:38 2022] GET /identity/v3/role_assignments?user.id=ff2db35b94c84ec7bba96117d23baf6b&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=cd2effe8340d4be08a28d3a40db6979d => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:39.057553 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf038a7a-9b33-499d-a9f2-800409312f7a None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:39.057553 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf038a7a-9b33-499d-a9f2-800409312f7a None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:39.057553 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf038a7a-9b33-499d-a9f2-800409312f7a None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:39.058718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 436/874] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:39.064072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50e6fc-1814-4bdf-bef3-1bca8fa26a77 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:39.065288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50e6fc-1814-4bdf-bef3-1bca8fa26a77 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:39.065442 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50e6fc-1814-4bdf-bef3-1bca8fa26a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:39.084875 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-cd50e6fc-1814-4bdf-bef3-1bca8fa26a77 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:39.086437 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-cd50e6fc-1814-4bdf-bef3-1bca8fa26a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:39.113803 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:39.131244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef97989-1d3c-4583-97eb-8996a1914aa7 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:39.131517 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef97989-1d3c-4583-97eb-8996a1914aa7 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:39.131806 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef97989-1d3c-4583-97eb-8996a1914aa7 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:39.133364 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 437/875] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:39.138540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976b383-ab71-424f-8f1f-3da5446baf2d None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:39.138827 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976b383-ab71-424f-8f1f-3da5446baf2d None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:39.139107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976b383-ab71-424f-8f1f-3da5446baf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:39.158376 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-b976b383-ab71-424f-8f1f-3da5446baf2d None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:39.159537 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b976b383-ab71-424f-8f1f-3da5446baf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:39.160310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 439/876] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:39 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:32:39.231691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 438/877] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:39 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:32:39.441072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50e6fc-1814-4bdf-bef3-1bca8fa26a77 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:39.527975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976b383-ab71-424f-8f1f-3da5446baf2d None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:39.545247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50e6fc-1814-4bdf-bef3-1bca8fa26a77 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:39.588611 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88094108-e8ab-493e-8090-a9258081b6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:39.590005 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88094108-e8ab-493e-8090-a9258081b6a1 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:39.590732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88094108-e8ab-493e-8090-a9258081b6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:39.591210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88094108-e8ab-493e-8090-a9258081b6a1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:39.605823 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88094108-e8ab-493e-8090-a9258081b6a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:32:39.613069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-88094108-e8ab-493e-8090-a9258081b6a1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:32:39.613069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:39.613069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:39.613069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:39.613069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:39.613069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:39.613069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:39.613069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:39.613069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:39.613069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:39.613069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:39.613069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:39.613069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:32:39.613069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:32:39.613069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:32:39.613069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:32:39.614122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:32:39.614122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:32:39.614122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:32:39.614122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:32:39.614122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:39.614122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:39.614122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:39.614122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:39.614122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:39.614122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:39.614122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:39.614122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:39.614122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:39.614122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:39.614122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:39.614122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:39.614925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:39.614925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:39.614925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:39.614925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:39.614925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:32:39.614925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:32:39.614925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:32:39.614925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:32:39.614925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:32:39.614925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:32:39.614925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:32:39.614925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:39.618015 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 440/878] 10.222.0.58 () {56 vars in 1120 bytes} [Wed Aug 24 09:32:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:39.623892 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88094108-e8ab-493e-8090-a9258081b6a1 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:39.631721 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:39.649110 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976b383-ab71-424f-8f1f-3da5446baf2d None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:39.651230 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:39.687062 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd12189-0e50-4c23-a0f6-67f860cc88d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:39.687977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd12189-0e50-4c23-a0f6-67f860cc88d5 None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:39.688193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd12189-0e50-4c23-a0f6-67f860cc88d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:39.688612 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd12189-0e50-4c23-a0f6-67f860cc88d5 None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:39.690022 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd12189-0e50-4c23-a0f6-67f860cc88d5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:39.691553 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd12189-0e50-4c23-a0f6-67f860cc88d5 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:39.719885 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 439/879] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 09:32:39 2022] POST /identity/v3/services => generated 269 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:32:39.747671 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88094108-e8ab-493e-8090-a9258081b6a1 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:39.795451 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5235df-a846-480b-b61e-cc1d76a8b2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:39.796467 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5235df-a846-480b-b61e-cc1d76a8b2ef None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:39.796895 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5235df-a846-480b-b61e-cc1d76a8b2ef None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:39.797316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5235df-a846-480b-b61e-cc1d76a8b2ef None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:39.798294 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5235df-a846-480b-b61e-cc1d76a8b2ef None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:39.799313 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5235df-a846-480b-b61e-cc1d76a8b2ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:39.801057 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5235df-a846-480b-b61e-cc1d76a8b2ef None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:39.811668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 441/880] 10.222.0.58 () {56 vars in 1115 bytes} [Wed Aug 24 09:32:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:39.818586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd12189-0e50-4c23-a0f6-67f860cc88d5 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:39.933003 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd12189-0e50-4c23-a0f6-67f860cc88d5 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:39.968946 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2112908-4de4-4cf2-bc68-22145f05c282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:39.969846 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2112908-4de4-4cf2-bc68-22145f05c282 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:39.970267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2112908-4de4-4cf2-bc68-22145f05c282 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:39.970730 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2112908-4de4-4cf2-bc68-22145f05c282 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:39.982047 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2112908-4de4-4cf2-bc68-22145f05c282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:39.983989 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2112908-4de4-4cf2-bc68-22145f05c282 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:39.991538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:40.000463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-c2112908-4de4-4cf2-bc68-22145f05c282 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:40.000463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:40.000463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:40.000463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:40.000463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:40.000463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:40.000463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:40.000463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:40.000463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:40.000463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:40.000463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:40.000463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:40.000463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:40.000463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:40.000463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:40.000463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:40.001555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:40.001555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:40.001555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:40.001555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:40.001555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:40.001555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:40.001555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:40.001555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:40.001555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:40.001555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:40.001555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:40.001555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:40.001555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:40.001555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:40.001555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:40.001555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:40.001555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:40.003342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:40.003342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:40.003342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:40.006358 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 440/881] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:40.012055 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5235df-a846-480b-b61e-cc1d76a8b2ef None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:40.100042 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:40.120619 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5235df-a846-480b-b61e-cc1d76a8b2ef None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:40.155222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd4ad1-4400-4839-a930-2e90057707ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:40.155823 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd4ad1-4400-4839-a930-2e90057707ae None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:40.156098 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd4ad1-4400-4839-a930-2e90057707ae None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:40.156369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd4ad1-4400-4839-a930-2e90057707ae None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:40.157013 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd4ad1-4400-4839-a930-2e90057707ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:40.157310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd4ad1-4400-4839-a930-2e90057707ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:40.159234 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd4ad1-4400-4839-a930-2e90057707ae None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:40.171617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 442/882] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:40.177830 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2112908-4de4-4cf2-bc68-22145f05c282 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:40.299368 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2112908-4de4-4cf2-bc68-22145f05c282 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:40.333819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56825bc6-1020-45bf-a419-f2833858340c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:40.334449 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56825bc6-1020-45bf-a419-f2833858340c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:40.334765 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56825bc6-1020-45bf-a419-f2833858340c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:40.335047 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56825bc6-1020-45bf-a419-f2833858340c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:40.343079 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56825bc6-1020-45bf-a419-f2833858340c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:40.344500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56825bc6-1020-45bf-a419-f2833858340c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:40.356511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-56825bc6-1020-45bf-a419-f2833858340c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:32:40.356511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:40.356511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:40.356511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:40.356511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:40.356511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:40.356511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:40.356511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:40.356511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:40.356511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:40.356511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:40.356511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:40.356511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:40.356511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:40.356511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:40.356511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:40.357571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:40.357571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:40.357571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:40.357571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:40.357571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:40.357571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:40.357571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:40.357571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:40.357571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:40.357571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:40.357571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:40.357571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:40.357571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:40.357571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:40.357571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:40.357571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:40.357571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:40.357571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:40.358845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:40.358845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:40.358845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:40.358845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:40.358845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:40.358845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:40.358845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:40.358845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:40.358845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:32:40.358845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:40.358845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 441/883] 10.222.0.58 () {56 vars in 1117 bytes} [Wed Aug 24 09:32:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:32:40.366049 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd4ad1-4400-4839-a930-2e90057707ae None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:40.476154 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd4ad1-4400-4839-a930-2e90057707ae None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:40.512139 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256794c7-8452-4723-85bf-17f34e472a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:40.512668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256794c7-8452-4723-85bf-17f34e472a48 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:40.512942 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256794c7-8452-4723-85bf-17f34e472a48 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:40.513211 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256794c7-8452-4723-85bf-17f34e472a48 None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:40.513990 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256794c7-8452-4723-85bf-17f34e472a48 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:40.514291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256794c7-8452-4723-85bf-17f34e472a48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:40.515703 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256794c7-8452-4723-85bf-17f34e472a48 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:40.519830 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd4979-9b4c-4c58-8397-dd5d8dc0f153 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:40.520108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd4979-9b4c-4c58-8397-dd5d8dc0f153 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:40.520426 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd4979-9b4c-4c58-8397-dd5d8dc0f153 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:40.522027 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 442/884] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:32:40.529830 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d2942-11f0-4195-b13e-5312469a44ea None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:40.530243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d2942-11f0-4195-b13e-5312469a44ea None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:40.530775 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d2942-11f0-4195-b13e-5312469a44ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:40.537799 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:40.542144 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 443/885] 10.222.0.58 () {56 vars in 1149 bytes} [Wed Aug 24 09:32:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:40.550290 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256794c7-8452-4723-85bf-17f34e472a48 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:40.556171 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-4c5d2942-11f0-4195-b13e-5312469a44ea None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:40.557438 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-4c5d2942-11f0-4195-b13e-5312469a44ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:40.637897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:40.642125 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 443/886] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:32:40.661175 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256794c7-8452-4723-85bf-17f34e472a48 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:40.661389 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d23252-838e-41f0-8cd5-d3c3d7a256dd None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:40.661705 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d23252-838e-41f0-8cd5-d3c3d7a256dd None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:40.661980 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d23252-838e-41f0-8cd5-d3c3d7a256dd None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:40.663554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 444/887] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:32:40.668290 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9aee7-9763-4356-bcc0-c9d1bfa42c15 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:40.668573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9aee7-9763-4356-bcc0-c9d1bfa42c15 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:40.668850 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9aee7-9763-4356-bcc0-c9d1bfa42c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:40.688260 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-5ad9aee7-9763-4356-bcc0-c9d1bfa42c15 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:40.689953 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-5ad9aee7-9763-4356-bcc0-c9d1bfa42c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:40.700038 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50038cdf-1f59-48d2-b638-0520bc5fa794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:40.700865 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50038cdf-1f59-48d2-b638-0520bc5fa794 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:40.701195 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50038cdf-1f59-48d2-b638-0520bc5fa794 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:40.701497 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50038cdf-1f59-48d2-b638-0520bc5fa794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:40.774995 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:40.779029 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50038cdf-1f59-48d2-b638-0520bc5fa794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:40.780655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50038cdf-1f59-48d2-b638-0520bc5fa794 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:40.793943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 445/888] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:32:40.899171 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 444/889] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:32:40 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:32:40.906354 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9aee7-9763-4356-bcc0-c9d1bfa42c15 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:40.918922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50038cdf-1f59-48d2-b638-0520bc5fa794 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:41.024207 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9aee7-9763-4356-bcc0-c9d1bfa42c15 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:41.042527 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:41.055457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:41.061648 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50038cdf-1f59-48d2-b638-0520bc5fa794 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:41.068312 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b572a90-bbbf-4cf1-98bc-81063020269c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:41.069229 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b572a90-bbbf-4cf1-98bc-81063020269c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:41.069752 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b572a90-bbbf-4cf1-98bc-81063020269c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:41.070750 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b572a90-bbbf-4cf1-98bc-81063020269c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:41.085572 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b572a90-bbbf-4cf1-98bc-81063020269c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:41.087019 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b572a90-bbbf-4cf1-98bc-81063020269c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:41.099049 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8140b-f67a-4c92-978e-bc24bcc4197d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:41.099666 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8140b-f67a-4c92-978e-bc24bcc4197d None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:41.099939 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8140b-f67a-4c92-978e-bc24bcc4197d None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:41.100204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8140b-f67a-4c92-978e-bc24bcc4197d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:41.100810 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8140b-f67a-4c92-978e-bc24bcc4197d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:41.102082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-1b572a90-bbbf-4cf1-98bc-81063020269c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:41.102082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:41.102082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:41.102082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:41.102082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:41.102082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:41.102082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:41.102082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:41.102082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:41.102082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:41.102082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:41.102082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:41.102082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:41.102082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:41.102082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:41.102082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:41.102992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:41.102992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:41.102992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:41.102992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:41.102992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:41.102992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:41.102992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:41.102992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:41.102992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:41.102992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:41.102992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:41.102992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:41.102992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:41.102992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:41.102992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:41.102992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:41.102992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:41.103897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:41.103897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:41.103897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:41.104086 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8140b-f67a-4c92-978e-bc24bcc4197d None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:41.104162 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 446/890] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:41.104162 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b572a90-bbbf-4cf1-98bc-81063020269c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:41.114550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-2fb8140b-f67a-4c92-978e-bc24bcc4197d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:32:41.114550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:41.114550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:32:41.114550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:32:41.114550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:32:41.114550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:32:41.114550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:32:41.114550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:41.114550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:32:41.114550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:41.114550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:41.114550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:41.114550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:41.114550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:41.114550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:41.114550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:41.114550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:41.115600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:41.115600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:41.115600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:41.115600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:41.115600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:41.115600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:41.115600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:32:41.115600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:32:41.115600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:32:41.115600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:32:41.115600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:41.115600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:41.115600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:41.115600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:41.115600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:41.115600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:41.116462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:41.116462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:41.116462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:41.116462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:41.116462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:41.116462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:41.116462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:41.116462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:41.116462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:41.116462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:41.116462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:32:41.116462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:41.116462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:32:41.116462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:41.116462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 445/891] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 09:32:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:32:41.117268 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8140b-f67a-4c92-978e-bc24bcc4197d None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:41.215001 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b572a90-bbbf-4cf1-98bc-81063020269c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:41.238788 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8140b-f67a-4c92-978e-bc24bcc4197d None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:41.255881 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80c58b-7b26-4079-be76-afded632c1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:41.256511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80c58b-7b26-4079-be76-afded632c1f4 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:41.256795 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80c58b-7b26-4079-be76-afded632c1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:41.257059 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80c58b-7b26-4079-be76-afded632c1f4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:41.257708 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d80c58b-7b26-4079-be76-afded632c1f4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:41.259066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d80c58b-7b26-4079-be76-afded632c1f4 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:41.268075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-8d80c58b-7b26-4079-be76-afded632c1f4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:32:41.268075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:41.268075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:32:41.268075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:32:41.268075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:32:41.268075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:32:41.268075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:32:41.268075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:41.268075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:32:41.268075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:41.268075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:41.268075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:41.268075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:41.268075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:41.268075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:41.268075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:41.268075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:41.269080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:41.269080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:41.269080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:41.269080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:41.269080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:41.269080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:41.269080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:32:41.269080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:32:41.269080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:32:41.269080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:32:41.269080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:41.269080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:41.269080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:41.269080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:41.269080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:41.269080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:41.270002 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:41.270002 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:41.270002 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:41.270002 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:41.270002 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:41.270002 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:41.270002 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:41.270002 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:41.270002 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:41.270002 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:41.270002 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:32:41.270002 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:41.270002 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:32:41.270002 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:41.270002 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 447/892] 10.222.0.58 () {56 vars in 1126 bytes} [Wed Aug 24 09:32:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:41.270793 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80c58b-7b26-4079-be76-afded632c1f4 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:41.281600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf0372-9d43-481d-99b8-ecfd9e44ae84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:41.282455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf0372-9d43-481d-99b8-ecfd9e44ae84 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:41.282455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf0372-9d43-481d-99b8-ecfd9e44ae84 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:41.282729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf0372-9d43-481d-99b8-ecfd9e44ae84 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:41.283655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf0372-9d43-481d-99b8-ecfd9e44ae84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:41.283963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf0372-9d43-481d-99b8-ecfd9e44ae84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:41.285450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf0372-9d43-481d-99b8-ecfd9e44ae84 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:41.297785 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 446/893] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:41.303156 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf0372-9d43-481d-99b8-ecfd9e44ae84 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:41.308289 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:41.327702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:41.382201 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80c58b-7b26-4079-be76-afded632c1f4 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:41.411120 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf0372-9d43-481d-99b8-ecfd9e44ae84 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:41.415588 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387ffde-48d2-4c83-a48c-b0085231a64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:41.416188 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387ffde-48d2-4c83-a48c-b0085231a64d None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:41.416463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387ffde-48d2-4c83-a48c-b0085231a64d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:41.416730 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387ffde-48d2-4c83-a48c-b0085231a64d None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:41.417353 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387ffde-48d2-4c83-a48c-b0085231a64d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:41.417680 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387ffde-48d2-4c83-a48c-b0085231a64d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:41.419041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387ffde-48d2-4c83-a48c-b0085231a64d None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:41.424114 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 448/894] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 09:32:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:41.425021 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387ffde-48d2-4c83-a48c-b0085231a64d None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:41.454298 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce7618-2234-4e77-819c-fa7682fa2baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:41.455059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce7618-2234-4e77-819c-fa7682fa2baa None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:41.455440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce7618-2234-4e77-819c-fa7682fa2baa None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:41.455766 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce7618-2234-4e77-819c-fa7682fa2baa None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:41.456360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce7618-2234-4e77-819c-fa7682fa2baa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:41.456666 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce7618-2234-4e77-819c-fa7682fa2baa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:41.458213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce7618-2234-4e77-819c-fa7682fa2baa None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:41.467869 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 447/895] 10.222.0.58 () {56 vars in 1122 bytes} [Wed Aug 24 09:32:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:41.467869 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce7618-2234-4e77-819c-fa7682fa2baa None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:41.528818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:41.532431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387ffde-48d2-4c83-a48c-b0085231a64d None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:41.563364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:41.569653 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819396b-62bd-40e0-8105-ed90fbe0f63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:41.570679 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819396b-62bd-40e0-8105-ed90fbe0f63a None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:41.570964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819396b-62bd-40e0-8105-ed90fbe0f63a None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:41.571239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819396b-62bd-40e0-8105-ed90fbe0f63a None admin] PATH_INFO: `/v3/projects/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:41.578325 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819396b-62bd-40e0-8105-ed90fbe0f63a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:41.579746 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819396b-62bd-40e0-8105-ed90fbe0f63a None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:41.580117 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce7618-2234-4e77-819c-fa7682fa2baa None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:41.591576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-6819396b-62bd-40e0-8105-ed90fbe0f63a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:41.591576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:41.591576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:41.591576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:41.591576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:41.591576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:41.591576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:41.591576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:41.591576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:41.591576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:41.591576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:41.591576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:41.591576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:41.591576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:41.591576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:41.592684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:41.592684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:41.592684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:41.592684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:41.592684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:41.592684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:41.592684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:41.592684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:41.592684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:41.592684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:41.592684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:41.592684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:41.592684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:41.592684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:41.592684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:41.592684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:41.592684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:41.594014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:41.594014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:41.594014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:41.594014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:41.594014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:41.594014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:41.594014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:41.594014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:41.594014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 449/896] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:41.594517 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819396b-62bd-40e0-8105-ed90fbe0f63a None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:41.623017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198cd4f-b01e-47fe-a038-5599e0d2f7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:41.623743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198cd4f-b01e-47fe-a038-5599e0d2f7e7 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:41.624088 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198cd4f-b01e-47fe-a038-5599e0d2f7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:41.624486 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198cd4f-b01e-47fe-a038-5599e0d2f7e7 None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:41.625112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198cd4f-b01e-47fe-a038-5599e0d2f7e7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:41.625414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198cd4f-b01e-47fe-a038-5599e0d2f7e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:41.627473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198cd4f-b01e-47fe-a038-5599e0d2f7e7 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:41.637581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 448/897] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 09:32:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:41.637581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198cd4f-b01e-47fe-a038-5599e0d2f7e7 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:41.708300 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819396b-62bd-40e0-8105-ed90fbe0f63a None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:41.746811 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e48ce9-5f17-4b3f-88ce-16db00ac071e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:41.747414 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e48ce9-5f17-4b3f-88ce-16db00ac071e None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:41.747692 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e48ce9-5f17-4b3f-88ce-16db00ac071e None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:41.747961 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e48ce9-5f17-4b3f-88ce-16db00ac071e None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:41.748605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e48ce9-5f17-4b3f-88ce-16db00ac071e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:41.748893 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e48ce9-5f17-4b3f-88ce-16db00ac071e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:41.750335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e48ce9-5f17-4b3f-88ce-16db00ac071e None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:41.753671 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198cd4f-b01e-47fe-a038-5599e0d2f7e7 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:41.765765 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 450/898] 10.222.0.58 () {56 vars in 1122 bytes} [Wed Aug 24 09:32:41 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:41.765765 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e48ce9-5f17-4b3f-88ce-16db00ac071e None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:41.792686 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:41.817977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5afadd-6a7c-4ce9-b538-241ca226ae44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:41.818626 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5afadd-6a7c-4ce9-b538-241ca226ae44 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:41.818909 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5afadd-6a7c-4ce9-b538-241ca226ae44 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:41.819206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5afadd-6a7c-4ce9-b538-241ca226ae44 None admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:41.819990 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5afadd-6a7c-4ce9-b538-241ca226ae44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:41.820299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5afadd-6a7c-4ce9-b538-241ca226ae44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:41.821784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5afadd-6a7c-4ce9-b538-241ca226ae44 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:41.838130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 449/899] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:41.842038 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992868ae-d34f-4153-8632-dedd8b535460 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:41.842452 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992868ae-d34f-4153-8632-dedd8b535460 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:41.842821 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992868ae-d34f-4153-8632-dedd8b535460 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:41.844250 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 450/900] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:41.845086 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992868ae-d34f-4153-8632-dedd8b535460 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:41.862004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:41.891269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e48ce9-5f17-4b3f-88ce-16db00ac071e None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:41.930701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fcd03-3e68-48b2-b8c5-16349d2577cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:41.931499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fcd03-3e68-48b2-b8c5-16349d2577cd None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:41.932374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fcd03-3e68-48b2-b8c5-16349d2577cd None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:41.932655 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fcd03-3e68-48b2-b8c5-16349d2577cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:41.933375 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fcd03-3e68-48b2-b8c5-16349d2577cd None admin] RBAC: Adding query filter params (interface=public, service_id=90b05a0a2cf24aada9de1ae2a07b330c, region_id=RegionOne) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:41.933710 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fcd03-3e68-48b2-b8c5-16349d2577cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:41.935090 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fcd03-3e68-48b2-b8c5-16349d2577cd None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:41.941765 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 451/901] 10.222.0.58 () {56 vars in 1251 bytes} [Wed Aug 24 09:32:41 2022] GET /identity/v3/endpoints?service_id=90b05a0a2cf24aada9de1ae2a07b330c&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:41.943092 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f87ab6-93e8-44a1-bd31-7768618a95e8 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:41.944144 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f87ab6-93e8-44a1-bd31-7768618a95e8 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:41.944532 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f87ab6-93e8-44a1-bd31-7768618a95e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:41.963406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-e3f87ab6-93e8-44a1-bd31-7768618a95e8 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:41.965062 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e3f87ab6-93e8-44a1-bd31-7768618a95e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:41.968123 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992868ae-d34f-4153-8632-dedd8b535460 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:42.006573 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be72b68-4a00-44ac-8753-5882be05389e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:42.007182 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be72b68-4a00-44ac-8753-5882be05389e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:42.007462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be72b68-4a00-44ac-8753-5882be05389e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:42.007732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be72b68-4a00-44ac-8753-5882be05389e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:42.008462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be72b68-4a00-44ac-8753-5882be05389e None admin] RBAC: Adding query filter params (role.id=82c00b0c6f4942a1b7b2c5b01d4846f3, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=3ae62427d5914e67b5b4d0237ecccd06) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:42.008767 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be72b68-4a00-44ac-8753-5882be05389e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:42.010226 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be72b68-4a00-44ac-8753-5882be05389e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:42.015934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 451/902] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:32:41 2022] GET /identity/v3/role_assignments?user.id=3ae62427d5914e67b5b4d0237ecccd06&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=82c00b0c6f4942a1b7b2c5b01d4846f3 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:42.016574 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be72b68-4a00-44ac-8753-5882be05389e None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:42.062886 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 452/903] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:32:42.110666 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:42.143416 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be72b68-4a00-44ac-8753-5882be05389e None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:42.181266 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72669cd9-a79b-4b07-a8f1-4f1f775eee7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:42.181962 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72669cd9-a79b-4b07-a8f1-4f1f775eee7d None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:42.182247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72669cd9-a79b-4b07-a8f1-4f1f775eee7d None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:42.182519 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72669cd9-a79b-4b07-a8f1-4f1f775eee7d None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:42.183125 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72669cd9-a79b-4b07-a8f1-4f1f775eee7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:42.184539 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72669cd9-a79b-4b07-a8f1-4f1f775eee7d None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:42.191526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 452/904] 10.222.0.58 () {56 vars in 1087 bytes} [Wed Aug 24 09:32:42 2022] GET /identity/v3/services => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:32:42.344616 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f87ab6-93e8-44a1-bd31-7768618a95e8 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:42.365076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:42.451585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f87ab6-93e8-44a1-bd31-7768618a95e8 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:42.488691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1ced2-c3be-4e6c-b33a-989ae40872ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:42.489811 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1ced2-c3be-4e6c-b33a-989ae40872ea None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:42.490317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1ced2-c3be-4e6c-b33a-989ae40872ea None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:42.490800 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1ced2-c3be-4e6c-b33a-989ae40872ea None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:42.491589 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1ced2-c3be-4e6c-b33a-989ae40872ea None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:42.493208 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1ced2-c3be-4e6c-b33a-989ae40872ea None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:42.502489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-31a1ced2-c3be-4e6c-b33a-989ae40872ea None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:32:42.502489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:42.502489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:32:42.502489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:32:42.502489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:32:42.502489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:32:42.502489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:32:42.502489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:42.502489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:32:42.502489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:42.502489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:42.502489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:42.502489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:42.502489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:42.502489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:42.502489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:42.503516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:42.503516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:42.503516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:42.503516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:42.503516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:42.503516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:42.503516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:42.503516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:32:42.503516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:32:42.503516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:32:42.503516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:32:42.503516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:42.503516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:42.503516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:42.503516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:42.503516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:42.503516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:42.504395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:42.504395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:42.504395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:42.504395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:42.504395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:42.504395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:42.504395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:42.504395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:42.504395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:42.504395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:42.504395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:32:42.504395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:42.504395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:32:42.504395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:42.511688 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 453/905] 10.222.0.58 () {56 vars in 1132 bytes} [Wed Aug 24 09:32:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:42.513260 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72669cd9-a79b-4b07-a8f1-4f1f775eee7d None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:42.623413 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72669cd9-a79b-4b07-a8f1-4f1f775eee7d None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:42.659887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed17a8-caab-4454-b1c0-9a97336f14d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:42.660896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed17a8-caab-4454-b1c0-9a97336f14d2 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:42.661380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed17a8-caab-4454-b1c0-9a97336f14d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:42.661883 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed17a8-caab-4454-b1c0-9a97336f14d2 None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:42.662736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed17a8-caab-4454-b1c0-9a97336f14d2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:42.663238 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed17a8-caab-4454-b1c0-9a97336f14d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:42.664808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed17a8-caab-4454-b1c0-9a97336f14d2 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:42.674104 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 453/906] 10.222.0.58 () {56 vars in 1126 bytes} [Wed Aug 24 09:32:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:42.676574 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1ced2-c3be-4e6c-b33a-989ae40872ea None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:42.760651 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:42.780075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1ced2-c3be-4e6c-b33a-989ae40872ea None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:42.815355 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c688c-5e5b-4855-bf95-db1623c0ad2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:42.815957 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c688c-5e5b-4855-bf95-db1623c0ad2e None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:42.816234 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c688c-5e5b-4855-bf95-db1623c0ad2e None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:42.816501 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c688c-5e5b-4855-bf95-db1623c0ad2e None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:42.817125 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c688c-5e5b-4855-bf95-db1623c0ad2e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:42.817422 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c688c-5e5b-4855-bf95-db1623c0ad2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:42.818793 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c688c-5e5b-4855-bf95-db1623c0ad2e None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:42.824127 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 454/907] 10.222.0.58 () {56 vars in 1126 bytes} [Wed Aug 24 09:32:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:42.829932 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed17a8-caab-4454-b1c0-9a97336f14d2 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:42.832886 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:42.973288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed17a8-caab-4454-b1c0-9a97336f14d2 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:43.015590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58568c-69ff-4f11-b7b7-24458b7f9c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:43.016206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58568c-69ff-4f11-b7b7-24458b7f9c9f None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:43.016482 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58568c-69ff-4f11-b7b7-24458b7f9c9f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:43.016749 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58568c-69ff-4f11-b7b7-24458b7f9c9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:43.017592 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58568c-69ff-4f11-b7b7-24458b7f9c9f None admin] RBAC: Adding query filter params (interface=public, service_id=72d528b5ad9e4ac6b3bccce988a65e87, region_id=RegionOne) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:43.017920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58568c-69ff-4f11-b7b7-24458b7f9c9f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:43.019273 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58568c-69ff-4f11-b7b7-24458b7f9c9f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:43.025448 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 454/908] 10.222.0.58 () {56 vars in 1251 bytes} [Wed Aug 24 09:32:42 2022] GET /identity/v3/endpoints?service_id=72d528b5ad9e4ac6b3bccce988a65e87&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:43.031221 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c688c-5e5b-4855-bf95-db1623c0ad2e None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:43.177311 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c688c-5e5b-4855-bf95-db1623c0ad2e None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:43.212952 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706f065-2bee-4f51-9419-864053a6aadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:43.214065 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706f065-2bee-4f51-9419-864053a6aadb None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:43.214647 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706f065-2bee-4f51-9419-864053a6aadb None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:43.215122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706f065-2bee-4f51-9419-864053a6aadb None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:43.215955 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706f065-2bee-4f51-9419-864053a6aadb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:43.217604 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706f065-2bee-4f51-9419-864053a6aadb None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:43.229198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 455/909] 10.222.0.58 () {56 vars in 1087 bytes} [Wed Aug 24 09:32:43 2022] GET /identity/v3/services => generated 1268 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:32:43.831104 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34dabf-a928-4136-80ad-b349223a4674 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:43.831669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34dabf-a928-4136-80ad-b349223a4674 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:43.831669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34dabf-a928-4136-80ad-b349223a4674 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:43.833456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 455/910] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:43.838914 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd9092-edb7-4953-a33f-7f11d1ae4adc None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:43.839374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd9092-edb7-4953-a33f-7f11d1ae4adc None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:43.839461 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd9092-edb7-4953-a33f-7f11d1ae4adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:43.857721 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-32cd9092-edb7-4953-a33f-7f11d1ae4adc None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:43.859175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-32cd9092-edb7-4953-a33f-7f11d1ae4adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:43.861263 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:43.933418 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 456/911] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:32:44.089350 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706c220-9c70-46d8-8fb4-e340089aa0ed None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:44.089818 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706c220-9c70-46d8-8fb4-e340089aa0ed None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:44.090192 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706c220-9c70-46d8-8fb4-e340089aa0ed None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:44.091901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 456/912] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:44.097163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf3a44-05b3-47f3-8459-a60c673bb039 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:44.097476 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf3a44-05b3-47f3-8459-a60c673bb039 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:44.097768 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf3a44-05b3-47f3-8459-a60c673bb039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:44.116911 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-10bf3a44-05b3-47f3-8459-a60c673bb039 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:44.118151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-10bf3a44-05b3-47f3-8459-a60c673bb039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:44.190291 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 457/913] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:32:44.204294 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706c220-9c70-46d8-8fb4-e340089aa0ed None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:44.265815 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3758f6c-8f18-484b-b1e0-bb708ba0d345 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:44.266144 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3758f6c-8f18-484b-b1e0-bb708ba0d345 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:44.266413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3758f6c-8f18-484b-b1e0-bb708ba0d345 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:44.268087 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 458/914] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:44.273380 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9052f-e36a-4380-a17d-05c7e4caef83 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:44.273872 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9052f-e36a-4380-a17d-05c7e4caef83 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:44.274323 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9052f-e36a-4380-a17d-05c7e4caef83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:44.288837 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:44.294373 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-35b9052f-e36a-4380-a17d-05c7e4caef83 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:44.295815 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-35b9052f-e36a-4380-a17d-05c7e4caef83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:44.330527 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706c220-9c70-46d8-8fb4-e340089aa0ed None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:44.371397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460802f0-cab1-4129-a172-b18d63bc7a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:44.371916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460802f0-cab1-4129-a172-b18d63bc7a36 None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:44.372197 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460802f0-cab1-4129-a172-b18d63bc7a36 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:44.372470 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460802f0-cab1-4129-a172-b18d63bc7a36 None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:44.373112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460802f0-cab1-4129-a172-b18d63bc7a36 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:44.374737 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460802f0-cab1-4129-a172-b18d63bc7a36 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:44.381869 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:44.388079 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 459/915] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:32:44.400731 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 457/916] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 09:32:44 2022] POST /identity/v3/services => generated 241 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:32:44.496333 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9052f-e36a-4380-a17d-05c7e4caef83 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:44.604256 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9052f-e36a-4380-a17d-05c7e4caef83 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:44.647181 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c061c-1fa8-4687-b103-82c2f744784c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:44.648154 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c061c-1fa8-4687-b103-82c2f744784c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:44.648665 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c061c-1fa8-4687-b103-82c2f744784c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:44.649149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c061c-1fa8-4687-b103-82c2f744784c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:44.659916 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c061c-1fa8-4687-b103-82c2f744784c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:32:44.663852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460802f0-cab1-4129-a172-b18d63bc7a36 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:44.665351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-189c061c-1fa8-4687-b103-82c2f744784c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:32:44.665351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:44.665351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:44.665351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:44.665351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:44.665351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:44.665351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:44.665351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:44.665351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:44.665351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:44.665351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:44.665351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:44.665351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:32:44.665351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:32:44.665351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:32:44.665351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:32:44.666317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:32:44.666317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:32:44.666317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:32:44.666317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:32:44.666317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:44.666317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:44.666317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:44.666317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:44.666317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:44.666317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:44.666317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:44.666317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:44.666317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:44.666317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:44.666317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:44.666317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:44.667189 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:44.667189 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:44.667189 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:44.667189 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:44.667189 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:32:44.667189 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:32:44.667189 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:32:44.667189 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:32:44.667189 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:32:44.667189 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:32:44.667189 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:32:44.667189 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:44.669791 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 460/917] 10.222.0.58 () {56 vars in 1120 bytes} [Wed Aug 24 09:32:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:44.675866 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c061c-1fa8-4687-b103-82c2f744784c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:44.739132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:44.773243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460802f0-cab1-4129-a172-b18d63bc7a36 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:44.787107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c061c-1fa8-4687-b103-82c2f744784c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:44.802330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:44.812304 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12585356-8a5e-4a1c-9582-0c71b8a500b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:44.813267 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12585356-8a5e-4a1c-9582-0c71b8a500b6 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:44.813642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12585356-8a5e-4a1c-9582-0c71b8a500b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:44.813974 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12585356-8a5e-4a1c-9582-0c71b8a500b6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:44.814794 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12585356-8a5e-4a1c-9582-0c71b8a500b6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:44.816404 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12585356-8a5e-4a1c-9582-0c71b8a500b6 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:44.826305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-12585356-8a5e-4a1c-9582-0c71b8a500b6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:32:44.826305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:44.826305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:32:44.826305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:32:44.826305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:32:44.826305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:32:44.826305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:32:44.826305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:44.826305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:32:44.826305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:44.826305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:44.826305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:44.826305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:44.826305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:44.826305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:44.826305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:44.826305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:44.827501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:44.827501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:44.827501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:44.827501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:44.827501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:44.827501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:44.827501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:32:44.827501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:32:44.827501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:32:44.827501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:32:44.827501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:44.827501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:44.827501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:44.827501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:44.827501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:44.827501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:44.828368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:44.828368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:44.828368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:44.828368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:44.828368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:44.828368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:44.828368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:44.828368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:44.828368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:44.828368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:44.828368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:32:44.828368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:44.828368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 09:32:44.828368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:44.829131 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d341bb-d96f-49e6-954d-4b6a1ca9358a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:44.829131 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d341bb-d96f-49e6-954d-4b6a1ca9358a None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:44.829131 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d341bb-d96f-49e6-954d-4b6a1ca9358a None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:44.829722 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d341bb-d96f-49e6-954d-4b6a1ca9358a None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:44.833485 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d341bb-d96f-49e6-954d-4b6a1ca9358a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:44.833485 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d341bb-d96f-49e6-954d-4b6a1ca9358a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:44.833485 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d341bb-d96f-49e6-954d-4b6a1ca9358a None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:44.834074 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 458/918] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 09:32:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:32:44.835001 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12585356-8a5e-4a1c-9582-0c71b8a500b6 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:44.841206 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 461/919] 10.222.0.58 () {56 vars in 1115 bytes} [Wed Aug 24 09:32:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:44.847894 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d341bb-d96f-49e6-954d-4b6a1ca9358a None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:44.946320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12585356-8a5e-4a1c-9582-0c71b8a500b6 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:44.956260 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d341bb-d96f-49e6-954d-4b6a1ca9358a None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:44.973740 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:44.986063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7092c4-ef48-44d5-a35c-38bfdceb6366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:44.986835 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7092c4-ef48-44d5-a35c-38bfdceb6366 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:44.987117 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7092c4-ef48-44d5-a35c-38bfdceb6366 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:44.987393 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7092c4-ef48-44d5-a35c-38bfdceb6366 None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:44.988027 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7092c4-ef48-44d5-a35c-38bfdceb6366 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:44.988330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7092c4-ef48-44d5-a35c-38bfdceb6366 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:44.989967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7092c4-ef48-44d5-a35c-38bfdceb6366 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:44.994625 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a0cce-c471-4b9e-8527-bc1925570ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:44.995334 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a0cce-c471-4b9e-8527-bc1925570ffd None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:44.995722 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a0cce-c471-4b9e-8527-bc1925570ffd None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:44.996058 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a0cce-c471-4b9e-8527-bc1925570ffd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:44.999631 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 459/920] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 09:32:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:45.000929 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7092c4-ef48-44d5-a35c-38bfdceb6366 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:45.007759 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a0cce-c471-4b9e-8527-bc1925570ffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:45.009286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a0cce-c471-4b9e-8527-bc1925570ffd None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:45.025278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-e63a0cce-c471-4b9e-8527-bc1925570ffd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:45.025278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:45.025278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:45.025278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:45.025278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:45.025278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:45.025278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:45.025278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:45.025278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:45.025278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:45.025278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:45.025278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:45.025278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:45.025278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:45.025278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:45.025278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:45.026307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:45.026307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:45.026307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:45.026307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:45.026307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:45.026307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:45.026307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:45.026307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:45.026307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:45.026307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:45.026307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:45.026307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:45.026307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:45.026307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:45.026307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:45.026307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:45.026307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:45.027287 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:45.027287 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:45.027287 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:45.027287 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 462/921] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:45.033732 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a0cce-c471-4b9e-8527-bc1925570ffd None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:45.065050 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:45.120308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7092c4-ef48-44d5-a35c-38bfdceb6366 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:45.157750 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a6e2f-7ad8-48ce-a929-23796920c85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:45.158960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a6e2f-7ad8-48ce-a929-23796920c85b None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:45.159347 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a6e2f-7ad8-48ce-a929-23796920c85b None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:45.159626 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a6e2f-7ad8-48ce-a929-23796920c85b None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:45.160265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a6e2f-7ad8-48ce-a929-23796920c85b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:45.160809 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a6e2f-7ad8-48ce-a929-23796920c85b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:45.162091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a6e2f-7ad8-48ce-a929-23796920c85b None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:45.170786 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a0cce-c471-4b9e-8527-bc1925570ffd None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:45.172359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 460/922] 10.222.0.58 () {56 vars in 1114 bytes} [Wed Aug 24 09:32:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:45.174337 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a6e2f-7ad8-48ce-a929-23796920c85b None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:45.210522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b80ab-356b-434e-805b-ee5da7396f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:45.211050 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b80ab-356b-434e-805b-ee5da7396f42 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:45.211362 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b80ab-356b-434e-805b-ee5da7396f42 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:45.211822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b80ab-356b-434e-805b-ee5da7396f42 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:45.212382 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b80ab-356b-434e-805b-ee5da7396f42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:45.212688 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b80ab-356b-434e-805b-ee5da7396f42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:45.214160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b80ab-356b-434e-805b-ee5da7396f42 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:45.228999 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 463/923] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:45.230541 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f7443-c37a-4d19-b1e1-0d0482a2b2d9 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:45.230974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f7443-c37a-4d19-b1e1-0d0482a2b2d9 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:45.231393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f7443-c37a-4d19-b1e1-0d0482a2b2d9 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:45.233282 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 464/924] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:45.235085 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f7443-c37a-4d19-b1e1-0d0482a2b2d9 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:45.265290 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:45.295351 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a6e2f-7ad8-48ce-a929-23796920c85b None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:45.312268 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:45.330821 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9296f-aac5-47fb-9cbf-3a9a708dee7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:45.331444 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9296f-aac5-47fb-9cbf-3a9a708dee7d None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:45.331705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9296f-aac5-47fb-9cbf-3a9a708dee7d None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:45.331977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9296f-aac5-47fb-9cbf-3a9a708dee7d None admin] PATH_INFO: `/v3/endpoints` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:45.332626 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9296f-aac5-47fb-9cbf-3a9a708dee7d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:45.334038 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9296f-aac5-47fb-9cbf-3a9a708dee7d None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:45.349354 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f7443-c37a-4d19-b1e1-0d0482a2b2d9 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:45.356188 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 461/925] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:32:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:32:45.367031 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481d900-e302-4b9a-aaf4-7680b9f5d356 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:45.367368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481d900-e302-4b9a-aaf4-7680b9f5d356 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:45.367589 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481d900-e302-4b9a-aaf4-7680b9f5d356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:45.399819 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-f481d900-e302-4b9a-aaf4-7680b9f5d356 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:45.401071 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f481d900-e302-4b9a-aaf4-7680b9f5d356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:45.403744 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d91ba2-3b6f-40f2-a1f8-f2b717d9e308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:45.404434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d91ba2-3b6f-40f2-a1f8-f2b717d9e308 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:45.404730 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d91ba2-3b6f-40f2-a1f8-f2b717d9e308 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:45.405029 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d91ba2-3b6f-40f2-a1f8-f2b717d9e308 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:45.414467 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d91ba2-3b6f-40f2-a1f8-f2b717d9e308 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:45.416018 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d91ba2-3b6f-40f2-a1f8-f2b717d9e308 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:45.430442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-b3d91ba2-3b6f-40f2-a1f8-f2b717d9e308 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:32:45.430442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:45.430442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:45.430442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:45.430442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:45.430442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:45.430442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:45.430442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:45.430442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:45.430442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:45.430442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:45.430442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:45.430442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:45.430442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:45.430442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:45.430442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:45.432175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:45.432175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:45.432175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:45.432175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:45.432175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:45.432175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:45.432175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:45.432175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:45.432175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:45.432175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:45.432175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:45.432175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:45.432175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:45.432175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:45.432175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:45.432175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:45.432175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:45.432175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:45.433093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:45.433093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:45.433093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:45.433093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:45.433093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:45.433093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:45.433093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:45.433093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:45.433093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:32:45.433093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:45.433093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 465/926] 10.222.0.58 () {56 vars in 1117 bytes} [Wed Aug 24 09:32:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:45.442560 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d91ba2-3b6f-40f2-a1f8-f2b717d9e308 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:45.489251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 462/927] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:32:45.535906 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:45.552406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d91ba2-3b6f-40f2-a1f8-f2b717d9e308 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:45.587712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379a4b1-361b-477b-9e55-68e385854957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:45.588331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379a4b1-361b-477b-9e55-68e385854957 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:45.588608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379a4b1-361b-477b-9e55-68e385854957 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:45.588880 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379a4b1-361b-477b-9e55-68e385854957 None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:45.589664 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379a4b1-361b-477b-9e55-68e385854957 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:45.589970 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379a4b1-361b-477b-9e55-68e385854957 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:45.591437 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379a4b1-361b-477b-9e55-68e385854957 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:45.613730 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 466/928] 10.222.0.58 () {56 vars in 1149 bytes} [Wed Aug 24 09:32:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:45.619376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481d900-e302-4b9a-aaf4-7680b9f5d356 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:45.725826 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481d900-e302-4b9a-aaf4-7680b9f5d356 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:45.728151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:45.761725 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b7111-dd72-4444-b87b-1e882eedf258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:45.762333 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b7111-dd72-4444-b87b-1e882eedf258 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:45.762608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b7111-dd72-4444-b87b-1e882eedf258 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:45.762877 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b7111-dd72-4444-b87b-1e882eedf258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:45.773969 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b7111-dd72-4444-b87b-1e882eedf258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:45.775396 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b7111-dd72-4444-b87b-1e882eedf258 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:45.780620 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379a4b1-361b-477b-9e55-68e385854957 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:45.791916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-6d5b7111-dd72-4444-b87b-1e882eedf258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:45.791916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:45.791916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:45.791916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:45.791916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:45.791916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:45.791916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:45.791916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:45.791916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:45.791916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:45.791916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:45.791916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:45.791916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:45.791916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:45.791916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:45.791916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:45.792891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:45.792891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:45.792891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:45.792891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:45.792891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:45.792891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:45.792891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:45.792891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:45.792891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:45.792891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:45.792891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:45.792891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:45.792891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:45.792891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:45.792891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:45.792891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:45.792891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:45.793820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:45.793820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:45.793820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:45.793820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 463/929] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:45.799119 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b7111-dd72-4444-b87b-1e882eedf258 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:45.900939 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379a4b1-361b-477b-9e55-68e385854957 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:45.928285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b7111-dd72-4444-b87b-1e882eedf258 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:45.939966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79141427-185c-4ceb-8eb8-553527f4cca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:45.940901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79141427-185c-4ceb-8eb8-553527f4cca8 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:45.941402 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79141427-185c-4ceb-8eb8-553527f4cca8 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:45.941941 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79141427-185c-4ceb-8eb8-553527f4cca8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:45.942735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79141427-185c-4ceb-8eb8-553527f4cca8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:45.944349 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79141427-185c-4ceb-8eb8-553527f4cca8 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:45.953581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-79141427-185c-4ceb-8eb8-553527f4cca8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:32:45.953581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:45.953581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:32:45.953581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:32:45.953581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:32:45.953581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:32:45.953581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:32:45.953581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:45.953581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:32:45.953581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:45.953581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:45.953581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:45.953581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:45.953581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:45.953581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:45.953581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:45.954547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:45.954547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:45.954547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:45.954547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:45.954547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:45.954547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:45.954547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:45.954547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:32:45.954547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:32:45.954547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:32:45.954547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:32:45.954547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:45.954547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:45.954547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:45.954547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:45.954547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:45.954547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:45.955983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:45.955983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:45.955983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:45.955983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:45.955983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:45.955983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:45.955983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:45.955983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:45.955983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:45.955983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:45.955983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:32:45.955983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:45.955983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 09:32:45.955983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:45.963591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 467/930] 10.222.0.58 () {56 vars in 1132 bytes} [Wed Aug 24 09:32:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:32:45.964752 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79141427-185c-4ceb-8eb8-553527f4cca8 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:45.966781 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f89e8a-99a5-45c1-b67c-1281f0520e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:45.967383 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f89e8a-99a5-45c1-b67c-1281f0520e00 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:45.967657 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f89e8a-99a5-45c1-b67c-1281f0520e00 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:45.967925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f89e8a-99a5-45c1-b67c-1281f0520e00 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:45.968570 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f89e8a-99a5-45c1-b67c-1281f0520e00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:45.968864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f89e8a-99a5-45c1-b67c-1281f0520e00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:45.972087 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f89e8a-99a5-45c1-b67c-1281f0520e00 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:45.976884 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:45.989553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 464/931] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:45.992467 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f89e8a-99a5-45c1-b67c-1281f0520e00 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:46.016125 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:46.089534 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79141427-185c-4ceb-8eb8-553527f4cca8 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:46.121834 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f89e8a-99a5-45c1-b67c-1281f0520e00 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:46.132804 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7d1ed-fed9-4ecf-ab16-061b522ef5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:46.133409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7d1ed-fed9-4ecf-ab16-061b522ef5a0 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:46.133733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7d1ed-fed9-4ecf-ab16-061b522ef5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:46.134434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7d1ed-fed9-4ecf-ab16-061b522ef5a0 None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:46.135089 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7d1ed-fed9-4ecf-ab16-061b522ef5a0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:46.135394 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7d1ed-fed9-4ecf-ab16-061b522ef5a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:46.137195 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7d1ed-fed9-4ecf-ab16-061b522ef5a0 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:46.149156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 468/932] 10.222.0.58 () {56 vars in 1126 bytes} [Wed Aug 24 09:32:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:46.150576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7d1ed-fed9-4ecf-ab16-061b522ef5a0 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:46.165939 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035486a1-1305-4602-a84b-2140c2c58e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:46.166573 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035486a1-1305-4602-a84b-2140c2c58e18 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:46.166846 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035486a1-1305-4602-a84b-2140c2c58e18 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:46.167113 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035486a1-1305-4602-a84b-2140c2c58e18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:46.175971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035486a1-1305-4602-a84b-2140c2c58e18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:46.177611 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035486a1-1305-4602-a84b-2140c2c58e18 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:46.192608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-035486a1-1305-4602-a84b-2140c2c58e18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:46.192608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:46.192608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:46.192608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:46.192608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:46.192608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:46.192608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:46.192608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:46.192608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:46.192608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:46.192608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:46.192608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:46.192608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:46.192608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:46.192608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:46.193743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:46.193743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:46.193743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:46.193743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:46.193743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:46.193743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:46.193743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:46.193743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:46.193743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:46.193743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:46.193743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:46.193743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:46.193743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:46.193743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:46.193743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:46.193743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:46.193743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:46.194656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:46.194656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:46.194656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:46.194656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:46.194656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:46.194656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:46.194656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:46.194656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:46.197535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 465/933] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:46.199296 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035486a1-1305-4602-a84b-2140c2c58e18 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:46.249612 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:46.294748 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7d1ed-fed9-4ecf-ab16-061b522ef5a0 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:46.295790 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:46.329028 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035486a1-1305-4602-a84b-2140c2c58e18 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:46.343432 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e034c66-17ba-4d46-a36b-1d1f8bfa12b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:46.344690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e034c66-17ba-4d46-a36b-1d1f8bfa12b8 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:46.345183 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e034c66-17ba-4d46-a36b-1d1f8bfa12b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:46.345950 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e034c66-17ba-4d46-a36b-1d1f8bfa12b8 None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:46.347166 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e034c66-17ba-4d46-a36b-1d1f8bfa12b8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:46.347957 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e034c66-17ba-4d46-a36b-1d1f8bfa12b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:46.349704 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e034c66-17ba-4d46-a36b-1d1f8bfa12b8 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:46.360686 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 469/934] 10.222.0.58 () {56 vars in 1126 bytes} [Wed Aug 24 09:32:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:46.363010 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e034c66-17ba-4d46-a36b-1d1f8bfa12b8 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:46.373678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0506abc-85de-4639-b1cb-628539f4fe68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:46.374293 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0506abc-85de-4639-b1cb-628539f4fe68 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:46.374567 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0506abc-85de-4639-b1cb-628539f4fe68 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:46.374841 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0506abc-85de-4639-b1cb-628539f4fe68 None admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:46.376008 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0506abc-85de-4639-b1cb-628539f4fe68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:46.376310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0506abc-85de-4639-b1cb-628539f4fe68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:46.378446 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0506abc-85de-4639-b1cb-628539f4fe68 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:46.399284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 466/935] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:46.400791 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0506abc-85de-4639-b1cb-628539f4fe68 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:46.505713 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e034c66-17ba-4d46-a36b-1d1f8bfa12b8 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:46.531759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0506abc-85de-4639-b1cb-628539f4fe68 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:46.546452 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cd568-3921-4dc7-9134-f82895d9e3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:46.546980 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cd568-3921-4dc7-9134-f82895d9e3bf None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:46.547258 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cd568-3921-4dc7-9134-f82895d9e3bf None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:46.547530 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cd568-3921-4dc7-9134-f82895d9e3bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:46.548193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3cd568-3921-4dc7-9134-f82895d9e3bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:46.550254 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3cd568-3921-4dc7-9134-f82895d9e3bf None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:46.555040 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:46.573610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 470/936] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:32:46 2022] POST /identity/v3/endpoints => generated 347 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:32:46.575277 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957489b-8282-407e-9ec4-dd19c2de4afd None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:46.575562 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957489b-8282-407e-9ec4-dd19c2de4afd None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:46.575839 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957489b-8282-407e-9ec4-dd19c2de4afd None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:46.577302 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 471/937] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:46.579901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:46.586433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c59d19-b01f-49bd-87b7-acaab6285e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:46.587583 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59d19-b01f-49bd-87b7-acaab6285e22 None admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:46.588269 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59d19-b01f-49bd-87b7-acaab6285e22 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:46.588586 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59d19-b01f-49bd-87b7-acaab6285e22 None admin] PATH_INFO: `/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/3ae62427d5914e67b5b4d0237ecccd06/roles/82c00b0c6f4942a1b7b2c5b01d4846f3` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:46.590880 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c59d19-b01f-49bd-87b7-acaab6285e22 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c95aafd70e547d29c7647e6027faf2f, user_id=3ae62427d5914e67b5b4d0237ecccd06, role_id=82c00b0c6f4942a1b7b2c5b01d4846f3)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:46.592263 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db039f7-1dd6-492f-be48-db0c6acce5c4 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:46.592467 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c59d19-b01f-49bd-87b7-acaab6285e22 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:46.593269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db039f7-1dd6-492f-be48-db0c6acce5c4 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:46.593788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db039f7-1dd6-492f-be48-db0c6acce5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:46.617494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 467/938] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:32:46 2022] PUT /identity/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/3ae62427d5914e67b5b4d0237ecccd06/roles/82c00b0c6f4942a1b7b2c5b01d4846f3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:32:46.632670 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-7db039f7-1dd6-492f-be48-db0c6acce5c4 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:46.634758 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7db039f7-1dd6-492f-be48-db0c6acce5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:46.771510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 472/939] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:32:47.062559 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c59d19-b01f-49bd-87b7-acaab6285e22 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:47.169172 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c59d19-b01f-49bd-87b7-acaab6285e22 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:47.205039 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14262df-0965-42d9-abf1-7c11a51ccc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:47.205700 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14262df-0965-42d9-abf1-7c11a51ccc9a None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:47.205985 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14262df-0965-42d9-abf1-7c11a51ccc9a None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:47.206260 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14262df-0965-42d9-abf1-7c11a51ccc9a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:47.206854 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14262df-0965-42d9-abf1-7c11a51ccc9a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:47.208215 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14262df-0965-42d9-abf1-7c11a51ccc9a None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:47.217063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-f14262df-0965-42d9-abf1-7c11a51ccc9a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:32:47.217063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:47.217063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:32:47.217063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:32:47.217063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:32:47.217063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:32:47.217063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:32:47.217063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:47.217063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:32:47.217063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:47.217063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:47.217063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:47.217063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:47.217063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:47.217063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:47.217063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:47.217063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:47.218066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:47.218066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:47.218066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:47.218066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:47.218066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:47.218066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:47.218066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:32:47.218066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:32:47.218066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:32:47.218066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:32:47.218066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:47.218066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:47.218066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:47.218066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:47.218066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:47.218066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:47.218881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:47.218881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:47.218881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:47.218881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:47.218881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:47.218881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:47.218881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:47.218881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:47.218881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:47.218881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:47.218881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:32:47.218881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:47.218881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:32:47.218881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:47.218881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 468/940] 10.222.0.58 () {56 vars in 1126 bytes} [Wed Aug 24 09:32:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:47.226367 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db039f7-1dd6-492f-be48-db0c6acce5c4 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:47.349411 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db039f7-1dd6-492f-be48-db0c6acce5c4 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:47.372842 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:47.387779 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd272e-ada6-45db-bd77-d39141e04276 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:47.388105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd272e-ada6-45db-bd77-d39141e04276 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:47.388341 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd272e-ada6-45db-bd77-d39141e04276 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:47.390199 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 469/941] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:47.390458 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3dafb-64e4-41df-b170-267677078aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:47.391066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3dafb-64e4-41df-b170-267677078aab None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:47.391345 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3dafb-64e4-41df-b170-267677078aab None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:47.391618 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3dafb-64e4-41df-b170-267677078aab None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:47.392277 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3dafb-64e4-41df-b170-267677078aab None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:47.392680 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3dafb-64e4-41df-b170-267677078aab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:47.394421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3dafb-64e4-41df-b170-267677078aab None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:47.395802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d253a-22af-481a-b766-cddfc104c71d None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:47.396092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d253a-22af-481a-b766-cddfc104c71d None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:47.396368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d253a-22af-481a-b766-cddfc104c71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:47.399818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 473/942] 10.222.0.58 () {56 vars in 1122 bytes} [Wed Aug 24 09:32:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:47.405227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3dafb-64e4-41df-b170-267677078aab None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:47.415999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-778d253a-22af-481a-b766-cddfc104c71d None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:47.417334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-778d253a-22af-481a-b766-cddfc104c71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:47.474007 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:47.494799 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 470/943] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:32:47.511693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3dafb-64e4-41df-b170-267677078aab None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:47.548343 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfe901-ee94-4693-9b53-91b82c7fe759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:47.549160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfe901-ee94-4693-9b53-91b82c7fe759 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:47.549732 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfe901-ee94-4693-9b53-91b82c7fe759 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:47.550021 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfe901-ee94-4693-9b53-91b82c7fe759 None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:47.550818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfe901-ee94-4693-9b53-91b82c7fe759 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:47.551127 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfe901-ee94-4693-9b53-91b82c7fe759 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:47.552496 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfe901-ee94-4693-9b53-91b82c7fe759 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:47.558192 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 474/944] 10.222.0.58 () {56 vars in 1122 bytes} [Wed Aug 24 09:32:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:47.565116 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d253a-22af-481a-b766-cddfc104c71d None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:47.669576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d253a-22af-481a-b766-cddfc104c71d None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:47.706982 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0452cd-6a5f-490b-84fa-79ef5c17f745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:47.707596 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0452cd-6a5f-490b-84fa-79ef5c17f745 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:47.707875 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0452cd-6a5f-490b-84fa-79ef5c17f745 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:47.708155 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0452cd-6a5f-490b-84fa-79ef5c17f745 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:47.708860 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0452cd-6a5f-490b-84fa-79ef5c17f745 None admin] RBAC: Adding query filter params (interface=public, service_id=748fd3c4e80144a49804a8727f7152c6, region_id=RegionOne) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:47.709164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0452cd-6a5f-490b-84fa-79ef5c17f745 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:47.710549 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0452cd-6a5f-490b-84fa-79ef5c17f745 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:47.716338 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 471/945] 10.222.0.58 () {56 vars in 1251 bytes} [Wed Aug 24 09:32:47 2022] GET /identity/v3/endpoints?service_id=748fd3c4e80144a49804a8727f7152c6&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:47.722291 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfe901-ee94-4693-9b53-91b82c7fe759 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:47.777520 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0452cd-6a5f-490b-84fa-79ef5c17f745 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:47.780832 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:47.849995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfe901-ee94-4693-9b53-91b82c7fe759 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:47.851051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:47.909089 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd6224-9b79-4986-9ead-c174c7a69944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:47.909856 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd6224-9b79-4986-9ead-c174c7a69944 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:47.910136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd6224-9b79-4986-9ead-c174c7a69944 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:47.910411 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd6224-9b79-4986-9ead-c174c7a69944 None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:47.911024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd6224-9b79-4986-9ead-c174c7a69944 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:47.913071 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd6224-9b79-4986-9ead-c174c7a69944 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:47.926103 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 475/946] 10.222.0.58 () {56 vars in 1087 bytes} [Wed Aug 24 09:32:47 2022] GET /identity/v3/services => generated 1497 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:32:47.930759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0452cd-6a5f-490b-84fa-79ef5c17f745 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:47.974043 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6532c-7e2f-4ae0-9b49-4c6be84931ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:47.974667 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6532c-7e2f-4ae0-9b49-4c6be84931ba None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:47.974955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6532c-7e2f-4ae0-9b49-4c6be84931ba None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:47.975275 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6532c-7e2f-4ae0-9b49-4c6be84931ba None admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:47.975948 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6532c-7e2f-4ae0-9b49-4c6be84931ba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:47.977414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6532c-7e2f-4ae0-9b49-4c6be84931ba None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:47.980573 dv-cinder-854271-2-smb devstack@keystone.service[82885]: WARNING keystone.server.flask.common [None req-51e6532c-7e2f-4ae0-9b49-4c6be84931ba None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 09:32:48.002200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.sql.core [None req-51e6532c-7e2f-4ae0-9b49-4c6be84931ba None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 09:32:48.002200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 09:32:48.002200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [parameters: {'id': '4270404264974af09f42b50acb7ae4eb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 09:32:48.002200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82885) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 09:32:48.020307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-51e6532c-7e2f-4ae0-9b49-4c6be84931ba None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4270404264974af09f42b50acb7ae4eb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4270404264974af09f42b50acb7ae4eb. Aug 24 09:32:48.020307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:48.020307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 09:32:48.020307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 09:32:48.020307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 09:32:48.020307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 09:32:48.020307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 09:32:48.020307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 09:32:48.020307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 09:32:48.020307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application conn.query(q) Aug 24 09:32:48.020307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 09:32:48.020307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 09:32:48.020307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 09:32:48.021221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application result.read() Aug 24 09:32:48.021221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 09:32:48.021221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 09:32:48.021221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 09:32:48.021221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 09:32:48.021221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 09:32:48.021221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 09:32:48.021221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 09:32:48.021221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 09:32:48.021221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 09:32:48.021221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:48.021221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 09:32:48.021221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:48.021221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:48.021221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 09:32:48.021221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 09:32:48.021221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 09:32:48.021221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 09:32:48.022638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 09:32:48.022638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application next(self.gen) Aug 24 09:32:48.022638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 09:32:48.022638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application yield resource Aug 24 09:32:48.022638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 09:32:48.022638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application next(self.gen) Aug 24 09:32:48.022638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 09:32:48.022638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 09:32:48.022638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 09:32:48.022638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 09:32:48.022638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 09:32:48.022638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise self.value Aug 24 09:32:48.022638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 09:32:48.022638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 09:32:48.022638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 09:32:48.022638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application session.commit() Aug 24 09:32:48.022638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 09:32:48.023784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 09:32:48.023784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 09:32:48.023784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 09:32:48.023784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 09:32:48.023784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self.session.flush() Aug 24 09:32:48.023784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 09:32:48.023784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 09:32:48.023784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 09:32:48.023784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 09:32:48.023784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 09:32:48.023784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application compat.raise_( Aug 24 09:32:48.023784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 09:32:48.023784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception Aug 24 09:32:48.023784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 09:32:48.023784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 09:32:48.023784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 09:32:48.023784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 09:32:48.025988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 09:32:48.025988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 09:32:48.025988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 09:32:48.025988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 09:32:48.025988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 09:32:48.025988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 09:32:48.025988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 09:32:48.025988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 09:32:48.025988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 09:32:48.025988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 09:32:48.025988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 09:32:48.025988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 09:32:48.025988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 09:32:48.025988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 09:32:48.025988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 09:32:48.028222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 09:32:48.028222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 09:32:48.028222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception Aug 24 09:32:48.028222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 09:32:48.028222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 09:32:48.028222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 09:32:48.028222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 09:32:48.028222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 09:32:48.028222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 09:32:48.028222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 09:32:48.028222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application conn.query(q) Aug 24 09:32:48.028222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 09:32:48.028222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 09:32:48.028222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 09:32:48.028222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application result.read() Aug 24 09:32:48.028222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 09:32:48.028222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 09:32:48.030433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 09:32:48.030433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 09:32:48.030433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 09:32:48.030433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 09:32:48.030433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 09:32:48.030433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 09:32:48.030433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 09:32:48.030433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 09:32:48.030433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [parameters: {'id': '4270404264974af09f42b50acb7ae4eb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 09:32:48.030433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 09:32:48.030433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:48.030433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:48.030433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:48.030433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:48.030433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 09:32:48.034052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 09:32:48.034052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 09:32:48.034052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 09:32:48.034052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 09:32:48.034052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:48.034052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:48.034052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:48.034052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:48.034052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:48.034052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:48.034052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:48.034052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:48.034052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:48.034052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:48.034052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:48.034052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:48.034052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:48.035504 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:48.035504 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 09:32:48.035504 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 09:32:48.035504 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:48.035504 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:48.035504 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 09:32:48.035504 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 09:32:48.035504 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4270404264974af09f42b50acb7ae4eb. Aug 24 09:32:48.035504 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:48.035504 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 472/947] 10.222.0.58 () {60 vars in 1140 bytes} [Wed Aug 24 09:32:47 2022] POST /identity/v3/projects => generated 262 bytes in 245 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:48.036072 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd6224-9b79-4986-9ead-c174c7a69944 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:48.151138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd6224-9b79-4986-9ead-c174c7a69944 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:48.167003 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:48.190201 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7304ef-e2c0-4b50-ab17-c3e57b04f1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:48.190752 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7304ef-e2c0-4b50-ab17-c3e57b04f1cb None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:48.191030 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7304ef-e2c0-4b50-ab17-c3e57b04f1cb None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:48.191302 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7304ef-e2c0-4b50-ab17-c3e57b04f1cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:48.198951 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7304ef-e2c0-4b50-ab17-c3e57b04f1cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:48.201145 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7304ef-e2c0-4b50-ab17-c3e57b04f1cb None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:48.212561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-4b7304ef-e2c0-4b50-ab17-c3e57b04f1cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:48.212561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:48.212561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:48.212561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:48.212561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:48.212561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:48.212561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:48.212561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:48.212561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:48.212561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:48.212561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:48.212561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:48.212561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:48.212561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:48.212561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:48.213457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:48.213457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:48.213457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:48.213457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:48.213457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:48.213457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:48.213457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:48.213457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:48.213457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:48.213457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:48.213457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:48.213457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:48.213457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:48.213457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:48.213457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:48.213457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:48.213457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:48.214373 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:48.214373 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:48.214373 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:48.214373 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:48.214373 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:48.214373 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:48.214373 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:48.214373 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:48.214373 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 476/948] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:48.222359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6532c-7e2f-4ae0-9b49-4c6be84931ba None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:48.354751 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6532c-7e2f-4ae0-9b49-4c6be84931ba None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:48.369007 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:48.402310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3a19c-0344-4901-b97b-6bb26ef0074f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:48.403341 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3a19c-0344-4901-b97b-6bb26ef0074f None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:48.403878 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3a19c-0344-4901-b97b-6bb26ef0074f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:48.404353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3a19c-0344-4901-b97b-6bb26ef0074f None admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:48.405302 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3a19c-0344-4901-b97b-6bb26ef0074f None admin] RBAC: Adding query filter params (name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:48.405893 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3a19c-0344-4901-b97b-6bb26ef0074f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:48.407744 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3a19c-0344-4901-b97b-6bb26ef0074f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:48.431140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 473/949] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 09:32:48 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:48.732566 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3fe38-59e0-434b-845f-42238760d650 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:48.733390 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3fe38-59e0-434b-845f-42238760d650 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:48.733390 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3fe38-59e0-434b-845f-42238760d650 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:48.735262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 477/950] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:48.742404 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9855eb-2101-4387-afc6-6265f959ee7d None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:48.743042 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9855eb-2101-4387-afc6-6265f959ee7d None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:48.743544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9855eb-2101-4387-afc6-6265f959ee7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:48.764023 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-cb9855eb-2101-4387-afc6-6265f959ee7d None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:48.765916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-cb9855eb-2101-4387-afc6-6265f959ee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:48.824217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26fa68-0ae7-408f-887a-1e0b7896f1a7 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:48.824550 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26fa68-0ae7-408f-887a-1e0b7896f1a7 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:48.824789 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26fa68-0ae7-408f-887a-1e0b7896f1a7 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:48.826409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 478/951] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:32:48.831547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270983b-8002-403e-a7dd-0d85f53d6f3d None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:48.831844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270983b-8002-403e-a7dd-0d85f53d6f3d None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:48.832107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270983b-8002-403e-a7dd-0d85f53d6f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:48.844874 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 474/952] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:32:48.851332 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-1270983b-8002-403e-a7dd-0d85f53d6f3d None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:48.852893 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-1270983b-8002-403e-a7dd-0d85f53d6f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:48.924496 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 479/953] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:32:49.126497 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9855eb-2101-4387-afc6-6265f959ee7d None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:49.200636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270983b-8002-403e-a7dd-0d85f53d6f3d None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:49.245561 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:49.261138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9855eb-2101-4387-afc6-6265f959ee7d None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:49.312356 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59423054-f579-4c8a-95a5-2dee0d39a7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:49.313710 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59423054-f579-4c8a-95a5-2dee0d39a7fd None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:49.315154 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59423054-f579-4c8a-95a5-2dee0d39a7fd None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:49.316159 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59423054-f579-4c8a-95a5-2dee0d39a7fd None admin] PATH_INFO: `/v3/services/compute` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:49.317271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59423054-f579-4c8a-95a5-2dee0d39a7fd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:49.319205 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59423054-f579-4c8a-95a5-2dee0d39a7fd None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:49.327285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270983b-8002-403e-a7dd-0d85f53d6f3d None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:49.329494 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:49.334169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-59423054-f579-4c8a-95a5-2dee0d39a7fd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:32:49.334169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:49.334169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:32:49.334169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:32:49.334169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:32:49.334169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:32:49.334169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:32:49.334169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:49.334169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:32:49.334169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:49.334169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:49.334169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:49.334169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:49.334169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:49.334169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:49.334169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:49.334169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:49.335330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:49.335330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:49.335330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:49.335330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:49.335330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:49.335330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:49.335330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:32:49.335330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:32:49.335330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:32:49.335330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:32:49.335330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:49.335330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:49.335330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:49.335330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:49.335330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:49.335330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:49.336236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:49.336236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:49.336236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:49.336236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:49.336236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:49.336236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:49.336236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:49.336236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:49.336236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:49.336236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:49.336236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:32:49.336236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:49.336236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:32:49.336236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:49.339656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 475/954] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:49.345694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59423054-f579-4c8a-95a5-2dee0d39a7fd None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:49.378997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673841b8-4b79-431f-8116-170c688e3e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:49.380946 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673841b8-4b79-431f-8116-170c688e3e94 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:49.381494 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673841b8-4b79-431f-8116-170c688e3e94 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:49.382424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673841b8-4b79-431f-8116-170c688e3e94 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:49.400269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673841b8-4b79-431f-8116-170c688e3e94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:32:49.407194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-673841b8-4b79-431f-8116-170c688e3e94 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:32:49.407194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:49.407194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:49.407194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:49.407194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:49.407194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:49.407194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:49.407194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:49.407194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:49.407194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:49.407194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:49.407194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:49.407194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:32:49.407194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:32:49.407194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:32:49.407194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:32:49.408198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:32:49.408198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:32:49.408198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:32:49.408198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:32:49.408198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:49.408198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:49.408198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:49.408198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:49.408198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:49.408198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:49.408198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:49.408198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:49.408198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:49.408198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:49.408198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:49.408198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:49.409024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:49.409024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:49.409024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:49.409024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:49.409024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:32:49.409024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:32:49.409024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:32:49.409024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:32:49.409024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:32:49.409024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:32:49.409024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:32:49.409024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:49.415871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 480/955] 10.222.0.58 () {56 vars in 1120 bytes} [Wed Aug 24 09:32:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:32:49.416740 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673841b8-4b79-431f-8116-170c688e3e94 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:49.473169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59423054-f579-4c8a-95a5-2dee0d39a7fd None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:49.510406 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa598922-d1b1-4191-9d02-aeacc1e3b158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:49.511372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa598922-d1b1-4191-9d02-aeacc1e3b158 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:49.511862 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa598922-d1b1-4191-9d02-aeacc1e3b158 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:49.512382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa598922-d1b1-4191-9d02-aeacc1e3b158 None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:49.513218 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa598922-d1b1-4191-9d02-aeacc1e3b158 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:49.513757 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa598922-d1b1-4191-9d02-aeacc1e3b158 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:49.515321 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa598922-d1b1-4191-9d02-aeacc1e3b158 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:49.521257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 476/956] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 09:32:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:49.527325 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa598922-d1b1-4191-9d02-aeacc1e3b158 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:49.535670 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673841b8-4b79-431f-8116-170c688e3e94 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:49.555861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:49.572831 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4e438-78e2-4905-9747-df3642e7e782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:49.573439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4e438-78e2-4905-9747-df3642e7e782 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:49.573748 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4e438-78e2-4905-9747-df3642e7e782 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:49.574023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4e438-78e2-4905-9747-df3642e7e782 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:49.574690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4e438-78e2-4905-9747-df3642e7e782 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:49.574996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4e438-78e2-4905-9747-df3642e7e782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:49.576483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4e438-78e2-4905-9747-df3642e7e782 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:49.585791 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 481/957] 10.222.0.58 () {56 vars in 1115 bytes} [Wed Aug 24 09:32:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:49.591340 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4e438-78e2-4905-9747-df3642e7e782 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:49.618877 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:49.645156 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa598922-d1b1-4191-9d02-aeacc1e3b158 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:49.686100 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19cc0e-6404-4657-99ee-4d46337004dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:49.687506 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19cc0e-6404-4657-99ee-4d46337004dd None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:49.688006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19cc0e-6404-4657-99ee-4d46337004dd None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:49.688446 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19cc0e-6404-4657-99ee-4d46337004dd None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:49.689544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19cc0e-6404-4657-99ee-4d46337004dd None admin] RBAC: Adding query filter params (type=compute) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:49.690095 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19cc0e-6404-4657-99ee-4d46337004dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:49.691720 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19cc0e-6404-4657-99ee-4d46337004dd None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:49.705776 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 477/958] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 09:32:49 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:49.713599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4e438-78e2-4905-9747-df3642e7e782 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:49.756287 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30074a6-1155-4db0-bd22-ae1cf7710a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:49.756930 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30074a6-1155-4db0-bd22-ae1cf7710a94 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:49.757212 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30074a6-1155-4db0-bd22-ae1cf7710a94 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:49.757518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30074a6-1155-4db0-bd22-ae1cf7710a94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:49.770634 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30074a6-1155-4db0-bd22-ae1cf7710a94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:49.772121 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30074a6-1155-4db0-bd22-ae1cf7710a94 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:49.789180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-c30074a6-1155-4db0-bd22-ae1cf7710a94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:49.789180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:49.789180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:49.789180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:49.789180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:49.789180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:49.789180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:49.789180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:49.789180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:49.789180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:49.789180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:49.789180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:49.789180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:49.789180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:49.789180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:49.789180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:49.790210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:49.790210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:49.790210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:49.790210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:49.790210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:49.790210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:49.790210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:49.790210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:49.790210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:49.790210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:49.790210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:49.790210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:49.790210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:49.790210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:49.790210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:49.790210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:49.790210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:49.791106 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:49.791106 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:49.791106 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:49.791106 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 482/959] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:32:49.797457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19cc0e-6404-4657-99ee-4d46337004dd None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:49.905519 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:49.919080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19cc0e-6404-4657-99ee-4d46337004dd None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:49.937755 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bc01b-1ce6-4547-8e8f-891797b3bc24 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:49.938099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bc01b-1ce6-4547-8e8f-891797b3bc24 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:49.938309 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bc01b-1ce6-4547-8e8f-891797b3bc24 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:49.940639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 483/960] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:49.947085 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ef5c8-dbf6-41d9-ac71-57da76d18d5d None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:49.947364 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ef5c8-dbf6-41d9-ac71-57da76d18d5d None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:49.947637 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ef5c8-dbf6-41d9-ac71-57da76d18d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:49.963864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11d176-d3cc-44d7-aebb-7164a70c5de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:49.964819 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11d176-d3cc-44d7-aebb-7164a70c5de7 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:49.965099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11d176-d3cc-44d7-aebb-7164a70c5de7 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:49.965371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11d176-d3cc-44d7-aebb-7164a70c5de7 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:49.966074 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11d176-d3cc-44d7-aebb-7164a70c5de7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:49.966377 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11d176-d3cc-44d7-aebb-7164a70c5de7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:49.967862 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11d176-d3cc-44d7-aebb-7164a70c5de7 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:49.968207 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-029ef5c8-dbf6-41d9-ac71-57da76d18d5d None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:49.969397 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-029ef5c8-dbf6-41d9-ac71-57da76d18d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:49.985496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 478/961] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:49.992035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11d176-d3cc-44d7-aebb-7164a70c5de7 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:50.047169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 484/962] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:32:50.113067 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11d176-d3cc-44d7-aebb-7164a70c5de7 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:50.149492 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330baeca-10e0-4f49-b685-2d3fca4ab4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:50.150189 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330baeca-10e0-4f49-b685-2d3fca4ab4b1 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:50.150475 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330baeca-10e0-4f49-b685-2d3fca4ab4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:50.150752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330baeca-10e0-4f49-b685-2d3fca4ab4b1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:50.158808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330baeca-10e0-4f49-b685-2d3fca4ab4b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:50.160247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330baeca-10e0-4f49-b685-2d3fca4ab4b1 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:50.172246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-330baeca-10e0-4f49-b685-2d3fca4ab4b1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:32:50.172246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:50.172246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:50.172246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:50.172246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:50.172246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:50.172246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:50.172246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:50.172246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:50.172246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:50.172246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:50.172246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:50.172246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:50.172246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:50.172246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:50.172246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:50.173181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:50.173181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:50.173181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:50.173181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:50.173181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:50.173181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:50.173181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:50.173181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:50.173181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:50.173181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:50.173181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:50.173181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:50.173181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:50.173181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:50.173181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:50.173181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:50.173181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:50.173181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:50.174655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:50.174655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:50.174655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:50.174655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:50.174655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:50.174655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:50.174655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:50.174655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:50.174655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 09:32:50.174655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:50.174655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 479/963] 10.222.0.58 () {56 vars in 1117 bytes} [Wed Aug 24 09:32:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:50.181573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ef5c8-dbf6-41d9-ac71-57da76d18d5d None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:50.191213 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:50.292280 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ef5c8-dbf6-41d9-ac71-57da76d18d5d None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:50.322108 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330baeca-10e0-4f49-b685-2d3fca4ab4b1 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:50.330566 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac18b4-9be7-4aff-a3bf-ed44f08bc1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:50.331450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac18b4-9be7-4aff-a3bf-ed44f08bc1e0 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:50.331963 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac18b4-9be7-4aff-a3bf-ed44f08bc1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:50.332434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac18b4-9be7-4aff-a3bf-ed44f08bc1e0 None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:50.333397 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac18b4-9be7-4aff-a3bf-ed44f08bc1e0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:50.333969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac18b4-9be7-4aff-a3bf-ed44f08bc1e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:50.335749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac18b4-9be7-4aff-a3bf-ed44f08bc1e0 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:50.338136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:50.355650 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 485/964] 10.222.0.58 () {56 vars in 1149 bytes} [Wed Aug 24 09:32:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:50.361957 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac18b4-9be7-4aff-a3bf-ed44f08bc1e0 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:50.442410 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:50.455350 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330baeca-10e0-4f49-b685-2d3fca4ab4b1 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:50.483778 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac18b4-9be7-4aff-a3bf-ed44f08bc1e0 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:50.494718 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3417e5-6bef-4a0b-8904-000e26351d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:50.495707 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3417e5-6bef-4a0b-8904-000e26351d00 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:50.496168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3417e5-6bef-4a0b-8904-000e26351d00 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:50.496627 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3417e5-6bef-4a0b-8904-000e26351d00 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:50.497419 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3417e5-6bef-4a0b-8904-000e26351d00 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:50.499248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3417e5-6bef-4a0b-8904-000e26351d00 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:50.508852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-db3417e5-6bef-4a0b-8904-000e26351d00 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:32:50.508852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:50.508852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:32:50.508852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:32:50.508852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:32:50.508852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:32:50.508852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:32:50.508852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:50.508852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:32:50.508852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:50.508852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:50.508852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:50.508852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:50.508852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:50.508852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:50.508852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:50.508852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:50.510160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:50.510160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:50.510160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:50.510160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:50.510160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:50.510160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:50.510160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:32:50.510160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:32:50.510160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:32:50.510160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:32:50.510160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:50.510160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:50.510160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:50.510160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:50.510160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:50.510160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:50.511018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:50.511018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:50.511018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:50.511018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:50.511018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:50.511018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:50.511018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:50.511018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:50.511018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:50.511018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:50.511018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:32:50.511018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:50.511018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:32:50.511018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:50.513717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 480/965] 10.222.0.58 () {56 vars in 1126 bytes} [Wed Aug 24 09:32:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:32:50.526039 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3417e5-6bef-4a0b-8904-000e26351d00 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:50.526226 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd14a7-1be0-466a-b193-91420ba8689e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:50.526226 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd14a7-1be0-466a-b193-91420ba8689e None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:50.526226 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd14a7-1be0-466a-b193-91420ba8689e None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:50.526226 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd14a7-1be0-466a-b193-91420ba8689e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:50.603985 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:50.605050 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd14a7-1be0-466a-b193-91420ba8689e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:50.606519 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd14a7-1be0-466a-b193-91420ba8689e None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:50.640419 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3417e5-6bef-4a0b-8904-000e26351d00 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:50.673689 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:50.681773 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdae1d-0193-4a5f-a823-6e719abaf381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:50.682365 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdae1d-0193-4a5f-a823-6e719abaf381 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:50.682638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdae1d-0193-4a5f-a823-6e719abaf381 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:50.682911 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdae1d-0193-4a5f-a823-6e719abaf381 None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:50.683538 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cdae1d-0193-4a5f-a823-6e719abaf381 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:50.683860 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cdae1d-0193-4a5f-a823-6e719abaf381 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:50.685178 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cdae1d-0193-4a5f-a823-6e719abaf381 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:50.695503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 481/966] 10.222.0.58 () {56 vars in 1122 bytes} [Wed Aug 24 09:32:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:50.696569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f346e0b-2a25-4e85-b054-78f1cc23bbf1 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:50.696854 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f346e0b-2a25-4e85-b054-78f1cc23bbf1 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:50.697126 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f346e0b-2a25-4e85-b054-78f1cc23bbf1 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:50.701578 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 482/967] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:50.701578 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f346e0b-2a25-4e85-b054-78f1cc23bbf1 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:50.722394 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 486/968] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:32:50 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 09:32:50.723725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d1a70-20b2-43e5-bc3a-759c58fd9a77 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:50.724076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d1a70-20b2-43e5-bc3a-759c58fd9a77 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:50.724414 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d1a70-20b2-43e5-bc3a-759c58fd9a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:50.742497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-1d4d1a70-20b2-43e5-bc3a-759c58fd9a77 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:50.743700 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-1d4d1a70-20b2-43e5-bc3a-759c58fd9a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:50.817560 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 487/969] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:32:50.819234 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d1a70-20b2-43e5-bc3a-759c58fd9a77 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:50.827675 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f346e0b-2a25-4e85-b054-78f1cc23bbf1 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:50.873862 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59433b4e-5e5b-40a2-970f-18ae8568091d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:50.874997 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59433b4e-5e5b-40a2-970f-18ae8568091d None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:50.875286 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59433b4e-5e5b-40a2-970f-18ae8568091d None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:50.875559 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59433b4e-5e5b-40a2-970f-18ae8568091d None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:50.876193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59433b4e-5e5b-40a2-970f-18ae8568091d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:50.876514 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59433b4e-5e5b-40a2-970f-18ae8568091d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:50.878399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59433b4e-5e5b-40a2-970f-18ae8568091d None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:50.885501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 483/970] 10.222.0.58 () {56 vars in 1122 bytes} [Wed Aug 24 09:32:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:50.885743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:50.891267 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59433b4e-5e5b-40a2-970f-18ae8568091d None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:50.942704 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:50.951049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d1a70-20b2-43e5-bc3a-759c58fd9a77 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:50.991005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a624de-b7b1-4058-bf96-f026abc360c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:50.991838 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a624de-b7b1-4058-bf96-f026abc360c4 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:50.992025 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a624de-b7b1-4058-bf96-f026abc360c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:50.992453 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a624de-b7b1-4058-bf96-f026abc360c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:51.005441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a624de-b7b1-4058-bf96-f026abc360c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:51.007026 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a624de-b7b1-4058-bf96-f026abc360c4 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:51.023559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-c2a624de-b7b1-4058-bf96-f026abc360c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:51.023559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:51.023559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:51.023559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:51.023559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:51.023559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:51.023559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:51.023559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:51.023559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:51.023559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:51.023559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:51.023559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:51.023559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:32:51.023559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:32:51.023559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:32:51.023559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:32:51.024554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:51.024554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:51.024554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:51.024554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:51.024554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:51.024554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:51.024554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:51.024554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:51.024554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:51.024554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:51.024554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:51.024554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:51.024554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:51.024554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:51.024554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:51.024554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:51.024554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:32:51.025442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:32:51.025442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:32:51.025442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:51.025442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 488/971] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:51.031073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a624de-b7b1-4058-bf96-f026abc360c4 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:51.048213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59433b4e-5e5b-40a2-970f-18ae8568091d None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:51.089537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfb140-9316-4cdb-b49b-71f7ab5222e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:51.090155 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfb140-9316-4cdb-b49b-71f7ab5222e2 None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:51.090439 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfb140-9316-4cdb-b49b-71f7ab5222e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:51.090714 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfb140-9316-4cdb-b49b-71f7ab5222e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:51.091716 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfb140-9316-4cdb-b49b-71f7ab5222e2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:51.093297 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfb140-9316-4cdb-b49b-71f7ab5222e2 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:51.121505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 484/972] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:32:50 2022] POST /identity/v3/endpoints => generated 349 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:32:51.121505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfb140-9316-4cdb-b49b-71f7ab5222e2 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:51.163908 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a624de-b7b1-4058-bf96-f026abc360c4 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:51.209939 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:51.215369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1a414-a7ea-4ec5-82b2-5023fe6bf702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:51.216852 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1a414-a7ea-4ec5-82b2-5023fe6bf702 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:51.217505 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1a414-a7ea-4ec5-82b2-5023fe6bf702 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:51.217840 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1a414-a7ea-4ec5-82b2-5023fe6bf702 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:51.218510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1a414-a7ea-4ec5-82b2-5023fe6bf702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:51.218816 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1a414-a7ea-4ec5-82b2-5023fe6bf702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:51.220302 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1a414-a7ea-4ec5-82b2-5023fe6bf702 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:51.242405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 489/973] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:51.245483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1a414-a7ea-4ec5-82b2-5023fe6bf702 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:51.252506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:51.281521 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfb140-9316-4cdb-b49b-71f7ab5222e2 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:51.337885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebda34-5a1b-4dcc-a683-f20e0c4f56fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:51.338748 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebda34-5a1b-4dcc-a683-f20e0c4f56fa None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:51.339026 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebda34-5a1b-4dcc-a683-f20e0c4f56fa None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:51.339316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebda34-5a1b-4dcc-a683-f20e0c4f56fa None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:51.340525 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cebda34-5a1b-4dcc-a683-f20e0c4f56fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:51.342274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cebda34-5a1b-4dcc-a683-f20e0c4f56fa None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:51.363244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.sql.core [None req-0cebda34-5a1b-4dcc-a683-f20e0c4f56fa None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 09:32:51.363244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 09:32:51.363244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [parameters: {'user_id': '56b4d07335364aab87571d78714f3852', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 09:32:51.363244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82885) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 09:32:51.372240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-0cebda34-5a1b-4dcc-a683-f20e0c4f56fa None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 09:32:51.372240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:51.372240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 09:32:51.372240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 09:32:51.372240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 09:32:51.372240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 09:32:51.372240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 09:32:51.372240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 09:32:51.372240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 09:32:51.372240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application conn.query(q) Aug 24 09:32:51.372240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 09:32:51.372240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 09:32:51.372240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 09:32:51.372240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application result.read() Aug 24 09:32:51.372240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 09:32:51.373114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 09:32:51.373114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 09:32:51.373114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 09:32:51.373114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 09:32:51.373114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 09:32:51.373114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 09:32:51.373114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 09:32:51.373114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 09:32:51.373114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:51.373114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 09:32:51.373114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:51.373114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:51.373114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 09:32:51.373114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 09:32:51.373114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 09:32:51.373114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 09:32:51.373114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 09:32:51.373114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application next(self.gen) Aug 24 09:32:51.374206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 09:32:51.374206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application yield resource Aug 24 09:32:51.374206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 09:32:51.374206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application next(self.gen) Aug 24 09:32:51.374206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 09:32:51.374206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 09:32:51.374206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 09:32:51.374206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 09:32:51.374206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 09:32:51.374206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise self.value Aug 24 09:32:51.374206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 09:32:51.374206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 09:32:51.374206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 09:32:51.374206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application session.commit() Aug 24 09:32:51.374206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 09:32:51.374206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 09:32:51.374206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 09:32:51.375958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 09:32:51.375958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 09:32:51.375958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self.session.flush() Aug 24 09:32:51.375958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 09:32:51.375958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 09:32:51.375958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 09:32:51.375958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 09:32:51.375958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 09:32:51.375958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application compat.raise_( Aug 24 09:32:51.375958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 09:32:51.375958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception Aug 24 09:32:51.375958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 09:32:51.375958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 09:32:51.375958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 09:32:51.375958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 09:32:51.375958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 09:32:51.375958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 09:32:51.377083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 09:32:51.377083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 09:32:51.377083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 09:32:51.377083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 09:32:51.377083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 09:32:51.377083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 09:32:51.377083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 09:32:51.377083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 09:32:51.377083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 09:32:51.377083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 09:32:51.377083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 09:32:51.377083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 09:32:51.377083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 09:32:51.377083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 09:32:51.377083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 09:32:51.377083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception Aug 24 09:32:51.383642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 09:32:51.383642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 09:32:51.383642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 09:32:51.383642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 09:32:51.383642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 09:32:51.383642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 09:32:51.383642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 09:32:51.383642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application conn.query(q) Aug 24 09:32:51.383642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 09:32:51.383642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 09:32:51.383642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 09:32:51.383642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application result.read() Aug 24 09:32:51.383642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 09:32:51.383642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 09:32:51.383642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 09:32:51.383642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 09:32:51.386687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 09:32:51.386687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 09:32:51.386687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 09:32:51.386687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 09:32:51.386687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 09:32:51.386687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 09:32:51.386687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [parameters: {'user_id': '56b4d07335364aab87571d78714f3852', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 09:32:51.386687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 09:32:51.386687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:51.386687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:51.386687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:51.386687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:51.386687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:51.386687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:51.386687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:51.387933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:51.387933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:51.387933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:51.387933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:51.387933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:51.387933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:51.387933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:51.387933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 09:32:51.387933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 09:32:51.387933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:51.387933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:51.387933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:51.387933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:51.387933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:51.387933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:51.387933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 09:32:51.387933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 09:32:51.389130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 09:32:51.389130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 09:32:51.389130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 09:32:51.389130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 09:32:51.389130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 09:32:51.389130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:51.389130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 485/974] 10.222.0.58 () {60 vars in 1131 bytes} [Wed Aug 24 09:32:51 2022] POST /identity/v3/users => generated 160 bytes in 254 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:51.389130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebda34-5a1b-4dcc-a683-f20e0c4f56fa None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:51.389702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1a414-a7ea-4ec5-82b2-5023fe6bf702 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:51.422900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030e0a4-7b38-4c8e-b675-24735a21ece2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:51.424448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030e0a4-7b38-4c8e-b675-24735a21ece2 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:51.424819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030e0a4-7b38-4c8e-b675-24735a21ece2 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:51.425191 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030e0a4-7b38-4c8e-b675-24735a21ece2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:51.432463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030e0a4-7b38-4c8e-b675-24735a21ece2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:51.434192 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030e0a4-7b38-4c8e-b675-24735a21ece2 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:51.445940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-2030e0a4-7b38-4c8e-b675-24735a21ece2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:51.445940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:51.445940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:51.445940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:51.445940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:51.445940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:51.445940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:51.445940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:51.445940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:51.445940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:51.445940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:51.445940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:51.445940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:32:51.445940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:32:51.445940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:32:51.447122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:32:51.447122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:51.447122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:51.447122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:51.447122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:51.447122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:51.447122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:51.447122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:51.447122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:51.447122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:51.447122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:51.447122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:51.447122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:51.447122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:51.447122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:51.447122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:51.447122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:51.448219 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:32:51.448219 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:32:51.448219 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:32:51.448219 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:32:51.448219 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:32:51.448219 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:32:51.448219 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:32:51.448219 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:51.449663 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 490/975] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:51.455986 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030e0a4-7b38-4c8e-b675-24735a21ece2 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:51.498375 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebda34-5a1b-4dcc-a683-f20e0c4f56fa None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:51.517493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:51.537058 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:51.540447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464f2e8-2532-4346-ab34-82c6894d53ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:51.541090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464f2e8-2532-4346-ab34-82c6894d53ad None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:51.541416 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464f2e8-2532-4346-ab34-82c6894d53ad None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:51.541747 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464f2e8-2532-4346-ab34-82c6894d53ad None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:51.551275 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464f2e8-2532-4346-ab34-82c6894d53ad None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:51.553089 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464f2e8-2532-4346-ab34-82c6894d53ad None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:51.566051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-b464f2e8-2532-4346-ab34-82c6894d53ad None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:32:51.566051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:51.566051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:51.566051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:51.566051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:51.566051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:51.566051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:51.566051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:51.566051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:51.566051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:51.566051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:51.566051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:51.566051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:32:51.566051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:32:51.566051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:32:51.566051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:32:51.567017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:51.567017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:51.567017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:32:51.567017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:51.567017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:32:51.567017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:32:51.567017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:51.567017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:51.567017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:51.567017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:51.567017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:51.567017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:51.567017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:51.567017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:51.567017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:51.567017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:51.567017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:51.567017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:51.567951 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:51.567951 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:51.567951 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:32:51.567951 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:32:51.567951 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:32:51.567951 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:32:51.567951 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:32:51.567951 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:32:51.567951 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 09:32:51.567951 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:51.572105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 486/976] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:32:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:51.573027 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464f2e8-2532-4346-ab34-82c6894d53ad None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:51.579504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030e0a4-7b38-4c8e-b675-24735a21ece2 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:51.617812 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06bc9a-bd38-4848-a2cf-d8a59d4bca24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:51.618578 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06bc9a-bd38-4848-a2cf-d8a59d4bca24 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:51.618876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06bc9a-bd38-4848-a2cf-d8a59d4bca24 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:51.619304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06bc9a-bd38-4848-a2cf-d8a59d4bca24 None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:51.620064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06bc9a-bd38-4848-a2cf-d8a59d4bca24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:51.620429 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06bc9a-bd38-4848-a2cf-d8a59d4bca24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:51.622093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06bc9a-bd38-4848-a2cf-d8a59d4bca24 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:51.636792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 491/977] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:32:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:51.643590 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06bc9a-bd38-4848-a2cf-d8a59d4bca24 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:51.682888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464f2e8-2532-4346-ab34-82c6894d53ad None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:51.719072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7920b-3870-4fcb-a664-4e018691e38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:51.719789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7920b-3870-4fcb-a664-4e018691e38c None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:51.720069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7920b-3870-4fcb-a664-4e018691e38c None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:51.720477 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7920b-3870-4fcb-a664-4e018691e38c None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:51.721301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7920b-3870-4fcb-a664-4e018691e38c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:51.721653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7920b-3870-4fcb-a664-4e018691e38c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:51.723080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7920b-3870-4fcb-a664-4e018691e38c None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:51.769105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06bc9a-bd38-4848-a2cf-d8a59d4bca24 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:51.769951 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 487/978] 10.222.0.58 () {56 vars in 1101 bytes} [Wed Aug 24 09:32:51 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:51.786954 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47076afe-3f9c-4d00-b7bf-386bc2fb1d14 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:51.787281 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47076afe-3f9c-4d00-b7bf-386bc2fb1d14 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:51.787506 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47076afe-3f9c-4d00-b7bf-386bc2fb1d14 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:51.789049 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 488/979] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:51.797214 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:51.800112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb73b8-2795-4866-ae9a-bacb2b33d2a0 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:51.800652 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb73b8-2795-4866-ae9a-bacb2b33d2a0 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:51.801138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb73b8-2795-4866-ae9a-bacb2b33d2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:51.812731 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93500015-6d37-4c76-b655-9d2ba40c64b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:51.813346 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93500015-6d37-4c76-b655-9d2ba40c64b5 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:51.813655 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93500015-6d37-4c76-b655-9d2ba40c64b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:51.813928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93500015-6d37-4c76-b655-9d2ba40c64b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:51.815024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93500015-6d37-4c76-b655-9d2ba40c64b5 None admin] RBAC: Adding query filter params (role.id=82c00b0c6f4942a1b7b2c5b01d4846f3, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=3ae62427d5914e67b5b4d0237ecccd06) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:51.815334 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93500015-6d37-4c76-b655-9d2ba40c64b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:51.816816 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93500015-6d37-4c76-b655-9d2ba40c64b5 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:51.824635 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-cadb73b8-2795-4866-ae9a-bacb2b33d2a0 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:51.826876 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-cadb73b8-2795-4866-ae9a-bacb2b33d2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:51.830115 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 492/980] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:32:51 2022] GET /identity/v3/role_assignments?user.id=3ae62427d5914e67b5b4d0237ecccd06&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=82c00b0c6f4942a1b7b2c5b01d4846f3 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:51.868514 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:51.915748 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 489/981] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:32:52.189961 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93500015-6d37-4c76-b655-9d2ba40c64b5 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:52.301024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93500015-6d37-4c76-b655-9d2ba40c64b5 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:52.340219 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e724e9a-df1e-4635-b125-1eda1825f3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:52.340825 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e724e9a-df1e-4635-b125-1eda1825f3ae None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:52.341102 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e724e9a-df1e-4635-b125-1eda1825f3ae None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:52.341373 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e724e9a-df1e-4635-b125-1eda1825f3ae None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:52.342064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e724e9a-df1e-4635-b125-1eda1825f3ae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:52.343416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e724e9a-df1e-4635-b125-1eda1825f3ae None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:52.363378 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 493/982] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 09:32:52 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:32:53.167965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90396928-3f29-479e-a635-82e7c133004a None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:53.168494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90396928-3f29-479e-a635-82e7c133004a None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:53.168571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90396928-3f29-479e-a635-82e7c133004a None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:53.170061 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 490/983] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:53.175139 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62102d-40e0-4434-9098-a88cb32faaa5 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:53.175525 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62102d-40e0-4434-9098-a88cb32faaa5 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:53.175692 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62102d-40e0-4434-9098-a88cb32faaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:53.193395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-9b62102d-40e0-4434-9098-a88cb32faaa5 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:53.194619 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-9b62102d-40e0-4434-9098-a88cb32faaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:53.245388 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:53.279413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 494/984] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:32:53.553516 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90396928-3f29-479e-a635-82e7c133004a None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:53.656535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90396928-3f29-479e-a635-82e7c133004a None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:53.690979 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289742d-85a0-4f7e-beaf-68654a3e9352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:53.691600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289742d-85a0-4f7e-beaf-68654a3e9352 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:53.691874 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289742d-85a0-4f7e-beaf-68654a3e9352 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:53.692143 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289742d-85a0-4f7e-beaf-68654a3e9352 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:53.692719 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289742d-85a0-4f7e-beaf-68654a3e9352 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:53.694095 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289742d-85a0-4f7e-beaf-68654a3e9352 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:53.702645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-6289742d-85a0-4f7e-beaf-68654a3e9352 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:32:53.702645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:53.702645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:32:53.702645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:32:53.702645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:32:53.702645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:32:53.702645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:32:53.702645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:53.702645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:32:53.702645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:53.702645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:53.702645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:53.702645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:53.702645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:53.702645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:53.702645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:53.702645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:53.703617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:53.703617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:53.703617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:53.703617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:53.703617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:53.703617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:53.703617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:32:53.703617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:32:53.703617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:32:53.703617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:32:53.703617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:53.703617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:53.703617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:53.703617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:53.703617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:53.703617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:53.704457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:53.704457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:53.704457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:53.704457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:53.704457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:53.704457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:53.704457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:53.704457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:53.704457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:53.704457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:53.704457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:32:53.704457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:53.704457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:32:53.704457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:53.704457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 491/985] 10.222.0.58 () {56 vars in 1126 bytes} [Wed Aug 24 09:32:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:53.711494 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62102d-40e0-4434-9098-a88cb32faaa5 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:53.809670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219200bc-559d-4a73-a7c0-23a5d69e12b3 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:53.809851 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219200bc-559d-4a73-a7c0-23a5d69e12b3 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:53.810123 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219200bc-559d-4a73-a7c0-23a5d69e12b3 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:53.811456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 492/986] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:32:53.816448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62102d-40e0-4434-9098-a88cb32faaa5 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:53.816959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d6b5d-0f1c-43fb-9c4a-ba1e75a39aab None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:53.817245 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d6b5d-0f1c-43fb-9c4a-ba1e75a39aab None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:53.817560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d6b5d-0f1c-43fb-9c4a-ba1e75a39aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:53.837103 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-376d6b5d-0f1c-43fb-9c4a-ba1e75a39aab None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:53.838437 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-376d6b5d-0f1c-43fb-9c4a-ba1e75a39aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:53.855239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd68f9e-b968-4728-9860-8c5498c79c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:53.855854 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd68f9e-b968-4728-9860-8c5498c79c95 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:53.856136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd68f9e-b968-4728-9860-8c5498c79c95 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:53.856406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd68f9e-b968-4728-9860-8c5498c79c95 None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:53.857039 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd68f9e-b968-4728-9860-8c5498c79c95 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:53.857342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd68f9e-b968-4728-9860-8c5498c79c95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:53.858988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd68f9e-b968-4728-9860-8c5498c79c95 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:53.865111 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 495/987] 10.222.0.58 () {56 vars in 1122 bytes} [Wed Aug 24 09:32:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:53.870780 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:53.871057 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd68f9e-b968-4728-9860-8c5498c79c95 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:53.911872 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:53.920996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 493/988] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:32:53.981143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd68f9e-b968-4728-9860-8c5498c79c95 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:54.016119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d88be-90c8-4679-bbb1-68282269c80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:54.016982 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d88be-90c8-4679-bbb1-68282269c80f None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:54.017911 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d88be-90c8-4679-bbb1-68282269c80f None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:54.018193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d88be-90c8-4679-bbb1-68282269c80f None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:54.019049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d88be-90c8-4679-bbb1-68282269c80f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:54.019357 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d88be-90c8-4679-bbb1-68282269c80f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:54.020820 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d88be-90c8-4679-bbb1-68282269c80f None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:54.029737 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 496/989] 10.222.0.58 () {56 vars in 1122 bytes} [Wed Aug 24 09:32:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:54.032138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d6b5d-0f1c-43fb-9c4a-ba1e75a39aab None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:54.134848 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d6b5d-0f1c-43fb-9c4a-ba1e75a39aab None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:54.169059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4cfb3-2b63-4fa7-8300-5603312ccf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:54.169737 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4cfb3-2b63-4fa7-8300-5603312ccf6b None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:54.169954 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4cfb3-2b63-4fa7-8300-5603312ccf6b None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:54.170211 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4cfb3-2b63-4fa7-8300-5603312ccf6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:54.170909 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4cfb3-2b63-4fa7-8300-5603312ccf6b None admin] RBAC: Adding query filter params (interface=admin, service_id=748fd3c4e80144a49804a8727f7152c6, region_id=RegionOne) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:54.171211 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4cfb3-2b63-4fa7-8300-5603312ccf6b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:54.172550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4cfb3-2b63-4fa7-8300-5603312ccf6b None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:54.182315 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 494/990] 10.222.0.58 () {56 vars in 1249 bytes} [Wed Aug 24 09:32:54 2022] GET /identity/v3/endpoints?service_id=748fd3c4e80144a49804a8727f7152c6&interface=admin®ion_id=RegionOne => generated 193 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:54.183427 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d88be-90c8-4679-bbb1-68282269c80f None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:54.211305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4cfb3-2b63-4fa7-8300-5603312ccf6b None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:54.249729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:54.292653 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:54.296011 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d88be-90c8-4679-bbb1-68282269c80f None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:54.334870 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ee5d6-c9cb-4bcf-b2d9-3b33421138e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:54.335543 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ee5d6-c9cb-4bcf-b2d9-3b33421138e1 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:54.335815 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ee5d6-c9cb-4bcf-b2d9-3b33421138e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:54.336115 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ee5d6-c9cb-4bcf-b2d9-3b33421138e1 None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:54.336706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ee5d6-c9cb-4bcf-b2d9-3b33421138e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:54.337359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4cfb3-2b63-4fa7-8300-5603312ccf6b None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:54.338106 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ee5d6-c9cb-4bcf-b2d9-3b33421138e1 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:54.345254 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 497/991] 10.222.0.58 () {56 vars in 1087 bytes} [Wed Aug 24 09:32:54 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:32:54.353100 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395703b-a0e5-4c5f-9f0f-418092e1df74 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:54.353440 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395703b-a0e5-4c5f-9f0f-418092e1df74 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:54.353708 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395703b-a0e5-4c5f-9f0f-418092e1df74 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:54.355258 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 498/992] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:32:54.361383 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea63ac-adb8-4957-baef-cb4c84abbfd5 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:54.361715 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea63ac-adb8-4957-baef-cb4c84abbfd5 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:54.361993 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea63ac-adb8-4957-baef-cb4c84abbfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:54.383450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-77ea63ac-adb8-4957-baef-cb4c84abbfd5 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:54.383783 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b55a20-ed78-4a85-9246-4ef5e7fd62d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:54.384364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b55a20-ed78-4a85-9246-4ef5e7fd62d3 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:54.384638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b55a20-ed78-4a85-9246-4ef5e7fd62d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:54.384737 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-77ea63ac-adb8-4957-baef-cb4c84abbfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:54.384955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b55a20-ed78-4a85-9246-4ef5e7fd62d3 None admin] PATH_INFO: `/v3/services/image` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:54.385512 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b55a20-ed78-4a85-9246-4ef5e7fd62d3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:54.387103 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b55a20-ed78-4a85-9246-4ef5e7fd62d3 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:54.399738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-b2b55a20-ed78-4a85-9246-4ef5e7fd62d3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:32:54.399738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:54.399738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:32:54.399738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:32:54.399738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:32:54.399738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:32:54.399738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:32:54.399738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:54.399738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:32:54.399738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:54.399738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:54.399738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:54.399738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:54.399738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:54.399738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:54.399738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:54.399738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:54.400817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:54.400817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:54.400817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:54.400817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:54.400817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:54.400817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:54.400817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:32:54.400817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:32:54.400817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:32:54.400817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:32:54.400817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:54.400817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:54.400817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:54.400817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:54.400817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:54.400817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:54.402461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:54.402461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:54.402461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:54.402461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:54.402461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:54.402461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:54.402461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:54.402461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:54.402461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:54.402461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:54.402461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:32:54.402461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:54.402461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:32:54.402461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:54.402461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 495/993] 10.222.0.58 () {56 vars in 1105 bytes} [Wed Aug 24 09:32:54 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:54.406891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b55a20-ed78-4a85-9246-4ef5e7fd62d3 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:54.464561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 499/994] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:54 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:32:54.508572 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:54.528275 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b55a20-ed78-4a85-9246-4ef5e7fd62d3 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:54.564956 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa20827-dfbb-4693-872f-d96528dae223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:54.565590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa20827-dfbb-4693-872f-d96528dae223 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:54.565873 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa20827-dfbb-4693-872f-d96528dae223 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:54.566147 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa20827-dfbb-4693-872f-d96528dae223 None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:54.566776 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa20827-dfbb-4693-872f-d96528dae223 None admin] RBAC: Adding query filter params (name=image) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:54.567078 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa20827-dfbb-4693-872f-d96528dae223 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:54.568440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa20827-dfbb-4693-872f-d96528dae223 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:54.578017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 496/995] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:54.579051 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea63ac-adb8-4957-baef-cb4c84abbfd5 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:54.678623 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:54.686482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea63ac-adb8-4957-baef-cb4c84abbfd5 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:54.728944 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace8d08-1f41-44d6-9350-61e0ddef9e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:54.729572 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace8d08-1f41-44d6-9350-61e0ddef9e8c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:54.729855 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace8d08-1f41-44d6-9350-61e0ddef9e8c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:54.730129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace8d08-1f41-44d6-9350-61e0ddef9e8c None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:54.730815 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace8d08-1f41-44d6-9350-61e0ddef9e8c None admin] RBAC: Adding query filter params (type=image) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:54.731123 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace8d08-1f41-44d6-9350-61e0ddef9e8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:54.732483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace8d08-1f41-44d6-9350-61e0ddef9e8c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:54.741545 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 500/996] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:54 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:54.742134 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa20827-dfbb-4693-872f-d96528dae223 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:54.856345 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa20827-dfbb-4693-872f-d96528dae223 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:54.894975 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e477c41-1769-4342-9973-cdfae49d19f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:54.895607 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e477c41-1769-4342-9973-cdfae49d19f5 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:54.895886 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e477c41-1769-4342-9973-cdfae49d19f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:54.896157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e477c41-1769-4342-9973-cdfae49d19f5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:54.896735 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e477c41-1769-4342-9973-cdfae49d19f5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:54.898137 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e477c41-1769-4342-9973-cdfae49d19f5 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:54.907021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-6e477c41-1769-4342-9973-cdfae49d19f5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:32:54.907021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:54.907021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:32:54.907021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:32:54.907021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:32:54.907021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:32:54.907021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:32:54.907021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:54.907021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:32:54.907021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:54.907021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:54.907021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:54.907021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:54.907021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:54.907021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:54.907021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:54.907021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:54.908045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:54.908045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:54.908045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:54.908045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:54.908045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:54.908045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:54.908045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:32:54.908045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:32:54.908045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:32:54.908045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:32:54.908045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:54.908045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:54.908045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:54.908045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:54.908045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:54.908045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:54.908861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:54.908861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:54.908861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:54.908861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:54.908861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:54.908861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:54.908861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:54.908861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:54.908861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:54.908861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:54.908861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:32:54.908861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:54.908861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:32:54.908861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:54.908861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 497/997] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:54.915303 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace8d08-1f41-44d6-9350-61e0ddef9e8c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:55.017808 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace8d08-1f41-44d6-9350-61e0ddef9e8c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:55.052887 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a2c13-2bda-4b51-9f26-188e881a1f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:55.053520 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a2c13-2bda-4b51-9f26-188e881a1f3b None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:55.053803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a2c13-2bda-4b51-9f26-188e881a1f3b None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:55.054074 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a2c13-2bda-4b51-9f26-188e881a1f3b None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:55.054705 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a2c13-2bda-4b51-9f26-188e881a1f3b None admin] RBAC: Adding query filter params (name=compute) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:55.055008 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a2c13-2bda-4b51-9f26-188e881a1f3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:55.056364 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a2c13-2bda-4b51-9f26-188e881a1f3b None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:55.065520 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 501/998] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 09:32:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:55.068005 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e477c41-1769-4342-9973-cdfae49d19f5 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:55.087308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:55.170768 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e477c41-1769-4342-9973-cdfae49d19f5 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:55.206523 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf871570-6380-4067-a038-c2215d1e16d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:55.207157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf871570-6380-4067-a038-c2215d1e16d2 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:55.207438 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf871570-6380-4067-a038-c2215d1e16d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:55.207708 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf871570-6380-4067-a038-c2215d1e16d2 None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:55.208339 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf871570-6380-4067-a038-c2215d1e16d2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:55.208640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf871570-6380-4067-a038-c2215d1e16d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:55.210026 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf871570-6380-4067-a038-c2215d1e16d2 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:55.219859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 498/999] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 09:32:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:55.221233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a2c13-2bda-4b51-9f26-188e881a1f3b None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:55.256515 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:55.334685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a2c13-2bda-4b51-9f26-188e881a1f3b None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:55.369798 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b0fc0-1f49-4a83-bd49-9dbb4b72a389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:55.370406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b0fc0-1f49-4a83-bd49-9dbb4b72a389 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:55.370685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b0fc0-1f49-4a83-bd49-9dbb4b72a389 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:55.370959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b0fc0-1f49-4a83-bd49-9dbb4b72a389 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:55.371654 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b0fc0-1f49-4a83-bd49-9dbb4b72a389 None admin] RBAC: Adding query filter params (interface=public, service_id=5433d596960a4df89bb41bb0debe08cf, region_id=RegionOne) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:55.371962 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b0fc0-1f49-4a83-bd49-9dbb4b72a389 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:55.373317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b0fc0-1f49-4a83-bd49-9dbb4b72a389 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:55.379331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 502/1000] 10.222.0.58 () {56 vars in 1251 bytes} [Wed Aug 24 09:32:55 2022] GET /identity/v3/endpoints?service_id=5433d596960a4df89bb41bb0debe08cf&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:55.384653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf871570-6380-4067-a038-c2215d1e16d2 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:55.471552 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:55.491757 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf871570-6380-4067-a038-c2215d1e16d2 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:55.525029 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d1001-efca-432d-a2c3-baa227a6e678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:55.525653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d1001-efca-432d-a2c3-baa227a6e678 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:55.525932 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d1001-efca-432d-a2c3-baa227a6e678 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:55.526205 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d1001-efca-432d-a2c3-baa227a6e678 None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:55.526799 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d1001-efca-432d-a2c3-baa227a6e678 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:55.528136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d1001-efca-432d-a2c3-baa227a6e678 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:55.541550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 499/1001] 10.222.0.58 () {56 vars in 1087 bytes} [Wed Aug 24 09:32:55 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:32:56.287229 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed644606-0a32-4d62-b5d8-5de75f514b60 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:56.287753 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed644606-0a32-4d62-b5d8-5de75f514b60 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:56.287753 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed644606-0a32-4d62-b5d8-5de75f514b60 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:56.289266 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 503/1002] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:56.294407 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030fde6-274b-485d-aca2-aa20128e90d5 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:56.294830 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030fde6-274b-485d-aca2-aa20128e90d5 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:56.295026 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030fde6-274b-485d-aca2-aa20128e90d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:56.313931 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-5030fde6-274b-485d-aca2-aa20128e90d5 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:56.315857 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-5030fde6-274b-485d-aca2-aa20128e90d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:56.393501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 500/1003] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:32:56.659392 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed644606-0a32-4d62-b5d8-5de75f514b60 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:56.666465 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec9c9e-9ef2-4e58-9282-07fa5275ea49 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:56.666761 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec9c9e-9ef2-4e58-9282-07fa5275ea49 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:56.667038 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec9c9e-9ef2-4e58-9282-07fa5275ea49 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:56.668520 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 501/1004] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:32:56.673620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737dfe5-5fc0-4b17-a233-5baa4b53b0dc None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:56.673781 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737dfe5-5fc0-4b17-a233-5baa4b53b0dc None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:56.674021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737dfe5-5fc0-4b17-a233-5baa4b53b0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:56.694495 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-2737dfe5-5fc0-4b17-a233-5baa4b53b0dc None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:56.695668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2737dfe5-5fc0-4b17-a233-5baa4b53b0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:56.756804 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:56.773856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 502/1005] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:32:56.774644 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed644606-0a32-4d62-b5d8-5de75f514b60 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:56.809364 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f875915-7fa7-4247-8b47-8e75e9da13e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:56.810009 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f875915-7fa7-4247-8b47-8e75e9da13e1 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:56.810287 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f875915-7fa7-4247-8b47-8e75e9da13e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:56.810555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f875915-7fa7-4247-8b47-8e75e9da13e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:56.811126 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f875915-7fa7-4247-8b47-8e75e9da13e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:56.812470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f875915-7fa7-4247-8b47-8e75e9da13e1 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:56.821099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-6f875915-7fa7-4247-8b47-8e75e9da13e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:32:56.821099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:56.821099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:32:56.821099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:32:56.821099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:32:56.821099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:32:56.821099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:32:56.821099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:56.821099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:32:56.821099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:56.821099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:56.821099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:56.821099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:56.821099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:56.821099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:56.821099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:56.821099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:56.822255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:56.822255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:56.822255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:56.822255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:56.822255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:56.822255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:56.822255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:32:56.822255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:32:56.822255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:32:56.822255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:32:56.822255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:56.822255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:56.822255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:56.822255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:56.822255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:56.822255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:56.823413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:56.823413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:56.823413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:56.823413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:56.823413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:56.823413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:56.823413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:56.823413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:56.823413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:56.823413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:56.823413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:32:56.823413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:56.823413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 09:32:56.823413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:32:56.825809 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 504/1006] 10.222.0.58 () {56 vars in 1126 bytes} [Wed Aug 24 09:32:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:56.827994 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737dfe5-5fc0-4b17-a233-5baa4b53b0dc None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:56.831723 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:56.928987 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737dfe5-5fc0-4b17-a233-5baa4b53b0dc None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:56.962551 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc757bd-0adb-43c4-8fd0-118a6c87344d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:56.963155 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc757bd-0adb-43c4-8fd0-118a6c87344d None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:56.963428 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc757bd-0adb-43c4-8fd0-118a6c87344d None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:56.963694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc757bd-0adb-43c4-8fd0-118a6c87344d None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:56.964310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc757bd-0adb-43c4-8fd0-118a6c87344d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:56.964609 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc757bd-0adb-43c4-8fd0-118a6c87344d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:56.965984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc757bd-0adb-43c4-8fd0-118a6c87344d None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:56.971591 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 503/1007] 10.222.0.58 () {56 vars in 1122 bytes} [Wed Aug 24 09:32:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:56.977061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f875915-7fa7-4247-8b47-8e75e9da13e1 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:57.044793 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc757bd-0adb-43c4-8fd0-118a6c87344d None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:57.084980 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f875915-7fa7-4247-8b47-8e75e9da13e1 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:57.122610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7c6f2-3bdc-4d0a-aa20-cc56403c7f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:57.123224 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7c6f2-3bdc-4d0a-aa20-cc56403c7f0a None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:57.123504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7c6f2-3bdc-4d0a-aa20-cc56403c7f0a None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:57.123755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:57.123879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7c6f2-3bdc-4d0a-aa20-cc56403c7f0a None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:57.124403 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7c6f2-3bdc-4d0a-aa20-cc56403c7f0a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:57.124709 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7c6f2-3bdc-4d0a-aa20-cc56403c7f0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:57.126156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7c6f2-3bdc-4d0a-aa20-cc56403c7f0a None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:57.136129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 505/1008] 10.222.0.58 () {56 vars in 1122 bytes} [Wed Aug 24 09:32:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:57.137137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7c6f2-3bdc-4d0a-aa20-cc56403c7f0a None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:57.155267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:57.168029 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc757bd-0adb-43c4-8fd0-118a6c87344d None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:57.206609 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b54e08-3be5-44e5-8667-026aaf5c992b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:57.207145 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b54e08-3be5-44e5-8667-026aaf5c992b None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:57.207427 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b54e08-3be5-44e5-8667-026aaf5c992b None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:57.207851 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b54e08-3be5-44e5-8667-026aaf5c992b None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:57.208500 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b54e08-3be5-44e5-8667-026aaf5c992b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:57.210693 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b54e08-3be5-44e5-8667-026aaf5c992b None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:57.233699 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 504/1009] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 09:32:57 2022] POST /identity/v3/services => generated 242 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:32:57.256222 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7c6f2-3bdc-4d0a-aa20-cc56403c7f0a None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:57.303167 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0dd94-a1a6-445a-9f2d-e274b00f27ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:57.303865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0dd94-a1a6-445a-9f2d-e274b00f27ce None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:57.304123 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0dd94-a1a6-445a-9f2d-e274b00f27ce None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:57.304332 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0dd94-a1a6-445a-9f2d-e274b00f27ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:57.304995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0dd94-a1a6-445a-9f2d-e274b00f27ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:57.306416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0dd94-a1a6-445a-9f2d-e274b00f27ce None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:57.329505 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 506/1010] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:32:57 2022] POST /identity/v3/endpoints => generated 325 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:32:57.465692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ab99e-5bbb-42a2-80d5-ba2b447af297 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:57.466187 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ab99e-5bbb-42a2-80d5-ba2b447af297 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:57.466187 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ab99e-5bbb-42a2-80d5-ba2b447af297 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:57.467505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 505/1011] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:57.474694 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07fb44-8f18-4421-b9d8-f1bab27a1ca2 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:57.475147 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07fb44-8f18-4421-b9d8-f1bab27a1ca2 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:57.475558 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07fb44-8f18-4421-b9d8-f1bab27a1ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:57.498879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-3e07fb44-8f18-4421-b9d8-f1bab27a1ca2 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:57.500566 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-3e07fb44-8f18-4421-b9d8-f1bab27a1ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:57.583246 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:57.602034 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 507/1012] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:57 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:32:57.924017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ab99e-5bbb-42a2-80d5-ba2b447af297 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:58.051257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ab99e-5bbb-42a2-80d5-ba2b447af297 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:58.084612 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:58.098237 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbacd7-4436-4d0b-9829-02b7b3e71593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:58.099073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbacd7-4436-4d0b-9829-02b7b3e71593 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:58.099352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbacd7-4436-4d0b-9829-02b7b3e71593 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:58.099626 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbacd7-4436-4d0b-9829-02b7b3e71593 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:58.100213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbacd7-4436-4d0b-9829-02b7b3e71593 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:58.101605 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbacd7-4436-4d0b-9829-02b7b3e71593 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:58.113544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-99bbacd7-4436-4d0b-9829-02b7b3e71593 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:32:58.113544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:58.113544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:32:58.113544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:32:58.113544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:32:58.113544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:32:58.113544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:32:58.113544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:58.113544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:32:58.113544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:58.113544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:58.113544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:58.113544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:58.113544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:58.113544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:58.113544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:58.113544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:58.114526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:58.114526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:58.114526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:58.114526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:58.114526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:58.114526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:58.114526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:32:58.114526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:32:58.114526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:32:58.114526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:32:58.114526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:58.114526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:58.114526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:58.114526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:58.114526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:58.114526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:58.115352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:58.115352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:58.115352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:58.115352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:58.115352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:58.115352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:58.115352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:58.115352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:58.115352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:58.115352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:58.115352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:32:58.115352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:58.115352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 09:32:58.115352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:58.116920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 506/1013] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:32:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:58.121361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07fb44-8f18-4421-b9d8-f1bab27a1ca2 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:58.243122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07fb44-8f18-4421-b9d8-f1bab27a1ca2 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:58.285394 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2210e8-6723-465f-9758-9b3d2da867b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:58.286039 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2210e8-6723-465f-9758-9b3d2da867b0 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:58.286316 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2210e8-6723-465f-9758-9b3d2da867b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:58.286648 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2210e8-6723-465f-9758-9b3d2da867b0 None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:58.287597 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2210e8-6723-465f-9758-9b3d2da867b0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:58.288159 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2210e8-6723-465f-9758-9b3d2da867b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:58.289784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2210e8-6723-465f-9758-9b3d2da867b0 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:58.301500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 508/1014] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 09:32:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:58.302925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbacd7-4436-4d0b-9829-02b7b3e71593 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:58.421704 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbacd7-4436-4d0b-9829-02b7b3e71593 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:58.459839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee71b78-5409-4164-9add-5b0579b6fae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:58.460309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee71b78-5409-4164-9add-5b0579b6fae9 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:58.460530 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee71b78-5409-4164-9add-5b0579b6fae9 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:58.460799 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee71b78-5409-4164-9add-5b0579b6fae9 None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:58.461455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee71b78-5409-4164-9add-5b0579b6fae9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:32:58.462724 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee71b78-5409-4164-9add-5b0579b6fae9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:58.463237 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee71b78-5409-4164-9add-5b0579b6fae9 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:58.469496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 507/1015] 10.222.0.58 () {56 vars in 1112 bytes} [Wed Aug 24 09:32:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:32:58.475696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2210e8-6723-465f-9758-9b3d2da867b0 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:58.543401 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:58.586802 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2210e8-6723-465f-9758-9b3d2da867b0 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:58.623439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e92ab-a1fa-4160-98bd-2ac2e9626a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:58.624044 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e92ab-a1fa-4160-98bd-2ac2e9626a90 None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:58.624325 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e92ab-a1fa-4160-98bd-2ac2e9626a90 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:58.624601 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e92ab-a1fa-4160-98bd-2ac2e9626a90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:58.625256 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e92ab-a1fa-4160-98bd-2ac2e9626a90 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:58.627343 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e92ab-a1fa-4160-98bd-2ac2e9626a90 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:58.652634 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 509/1016] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:32:58 2022] POST /identity/v3/endpoints => generated 334 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:32:59.312725 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bcf0a-9192-4d3e-aaeb-3e93d9e3dc2d None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:59.313011 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bcf0a-9192-4d3e-aaeb-3e93d9e3dc2d None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:59.313504 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bcf0a-9192-4d3e-aaeb-3e93d9e3dc2d None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:59.315436 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 508/1017] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:59.320821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf58835-6b9f-428d-aad8-3c3f63bb2d98 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:59.321108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf58835-6b9f-428d-aad8-3c3f63bb2d98 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:59.321381 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf58835-6b9f-428d-aad8-3c3f63bb2d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:59.339605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-aaf58835-6b9f-428d-aad8-3c3f63bb2d98 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:59.340797 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-aaf58835-6b9f-428d-aad8-3c3f63bb2d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:59.418851 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 510/1018] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:32:59.456779 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d09377-b698-4087-9be1-bea6cd8a54af None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:59.457099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d09377-b698-4087-9be1-bea6cd8a54af None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:59.457381 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d09377-b698-4087-9be1-bea6cd8a54af None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:59.458743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 509/1019] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:32:59.464051 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b407da3-a3f6-4560-b80e-6060d14d9fb2 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:59.464339 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b407da3-a3f6-4560-b80e-6060d14d9fb2 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:59.464617 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b407da3-a3f6-4560-b80e-6060d14d9fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:59.483254 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-5b407da3-a3f6-4560-b80e-6060d14d9fb2 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:32:59.484368 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-5b407da3-a3f6-4560-b80e-6060d14d9fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:32:59.519594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:59.557501 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 511/1020] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:32:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:32:59.690036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d09377-b698-4087-9be1-bea6cd8a54af None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:59.752546 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:59.800609 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d09377-b698-4087-9be1-bea6cd8a54af None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:59.825044 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b407da3-a3f6-4560-b80e-6060d14d9fb2 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:59.836469 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880cde4-6ac7-4966-bc5c-110c1a378bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:59.837372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880cde4-6ac7-4966-bc5c-110c1a378bac None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:59.837823 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880cde4-6ac7-4966-bc5c-110c1a378bac None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:59.838308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880cde4-6ac7-4966-bc5c-110c1a378bac None admin] PATH_INFO: `/v3/services/image` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:59.839072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880cde4-6ac7-4966-bc5c-110c1a378bac None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:59.840693 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880cde4-6ac7-4966-bc5c-110c1a378bac None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:59.850443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-0880cde4-6ac7-4966-bc5c-110c1a378bac None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:32:59.850443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:59.850443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:32:59.850443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:32:59.850443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:32:59.850443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:32:59.850443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:32:59.850443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:59.850443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:32:59.850443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:59.850443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:32:59.850443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:59.850443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:32:59.850443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:32:59.850443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:32:59.850443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:32:59.850443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:32:59.851556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:32:59.851556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:32:59.851556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:32:59.851556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:32:59.851556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:32:59.851556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:32:59.851556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:32:59.851556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:32:59.851556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:32:59.851556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:32:59.851556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:32:59.851556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:32:59.851556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:32:59.851556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:32:59.851556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:32:59.851556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:32:59.852411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:32:59.852411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:32:59.852411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:32:59.852411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:32:59.852411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:32:59.852411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:32:59.852411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:32:59.852411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:32:59.852411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:32:59.852411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:32:59.852411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:32:59.852411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:32:59.852411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:32:59.852411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:32:59.852411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 510/1021] 10.222.0.58 () {56 vars in 1105 bytes} [Wed Aug 24 09:32:59 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:32:59.857745 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880cde4-6ac7-4966-bc5c-110c1a378bac None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:59.938023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b407da3-a3f6-4560-b80e-6060d14d9fb2 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:59.971302 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880cde4-6ac7-4966-bc5c-110c1a378bac None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:32:59.976793 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285db8f7-b736-4f02-95ed-3275e9f2f91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:32:59.977414 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285db8f7-b736-4f02-95ed-3275e9f2f91c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:32:59.977714 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285db8f7-b736-4f02-95ed-3275e9f2f91c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:32:59.977986 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285db8f7-b736-4f02-95ed-3275e9f2f91c None admin] PATH_INFO: `/v3/domains/default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:32:59.979459 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285db8f7-b736-4f02-95ed-3275e9f2f91c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:32:59.981269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285db8f7-b736-4f02-95ed-3275e9f2f91c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:32:59.983579 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 512/1022] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:32:59.989533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285db8f7-b736-4f02-95ed-3275e9f2f91c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:32:59.994001 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:00.010259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adff68-a7a1-4599-96c8-14be4caaa822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:00.010790 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adff68-a7a1-4599-96c8-14be4caaa822 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:00.011066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adff68-a7a1-4599-96c8-14be4caaa822 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:00.011338 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adff68-a7a1-4599-96c8-14be4caaa822 None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:00.011968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adff68-a7a1-4599-96c8-14be4caaa822 None admin] RBAC: Adding query filter params (name=image) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:00.012326 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adff68-a7a1-4599-96c8-14be4caaa822 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:00.013676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adff68-a7a1-4599-96c8-14be4caaa822 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:00.019574 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 511/1023] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:32:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:00.025272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adff68-a7a1-4599-96c8-14be4caaa822 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:00.037442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:00.096392 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285db8f7-b736-4f02-95ed-3275e9f2f91c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:00.132637 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8e519-bd41-43f8-9616-7d7bb27afbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:00.133303 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8e519-bd41-43f8-9616-7d7bb27afbd9 None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:00.133612 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8e519-bd41-43f8-9616-7d7bb27afbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:00.133890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8e519-bd41-43f8-9616-7d7bb27afbd9 None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:00.134538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8e519-bd41-43f8-9616-7d7bb27afbd9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:00.135085 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adff68-a7a1-4599-96c8-14be4caaa822 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:00.136095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8e519-bd41-43f8-9616-7d7bb27afbd9 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:00.164295 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 513/1024] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 09:32:59 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:33:00.180461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aff4d4-1ba9-42be-9ee4-b535b6a168d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:00.181104 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aff4d4-1ba9-42be-9ee4-b535b6a168d0 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:00.181384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aff4d4-1ba9-42be-9ee4-b535b6a168d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:00.181687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aff4d4-1ba9-42be-9ee4-b535b6a168d0 None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:00.182341 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aff4d4-1ba9-42be-9ee4-b535b6a168d0 None admin] RBAC: Adding query filter params (type=image) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:00.182648 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aff4d4-1ba9-42be-9ee4-b535b6a168d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:00.184081 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aff4d4-1ba9-42be-9ee4-b535b6a168d0 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:00.190095 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 512/1025] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:33:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:33:00.196053 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8e519-bd41-43f8-9616-7d7bb27afbd9 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:00.357078 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:00.374188 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8e519-bd41-43f8-9616-7d7bb27afbd9 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:00.411671 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a66ed-ae5d-43d0-ad72-43e88a79a3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:00.412282 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a66ed-ae5d-43d0-ad72-43e88a79a3f2 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:00.412558 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a66ed-ae5d-43d0-ad72-43e88a79a3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:00.412829 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a66ed-ae5d-43d0-ad72-43e88a79a3f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:00.413566 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a66ed-ae5d-43d0-ad72-43e88a79a3f2 None admin] RBAC: Adding query filter params (interface=public, service_id=b1b884e810764df4b00b487bdeb86931, region_id=RegionOne) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:00.413876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a66ed-ae5d-43d0-ad72-43e88a79a3f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:00.415233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a66ed-ae5d-43d0-ad72-43e88a79a3f2 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:00.420518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 514/1026] 10.222.0.58 () {56 vars in 1251 bytes} [Wed Aug 24 09:33:00 2022] GET /identity/v3/endpoints?service_id=b1b884e810764df4b00b487bdeb86931&interface=public®ion_id=RegionOne => generated 194 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:00.426973 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aff4d4-1ba9-42be-9ee4-b535b6a168d0 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:00.479079 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:00.533880 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aff4d4-1ba9-42be-9ee4-b535b6a168d0 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:00.567768 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc75f0f-0144-441c-86b0-c84827ddf20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:00.568373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc75f0f-0144-441c-86b0-c84827ddf20e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:00.568652 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc75f0f-0144-441c-86b0-c84827ddf20e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:00.568923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc75f0f-0144-441c-86b0-c84827ddf20e None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:00.569553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc75f0f-0144-441c-86b0-c84827ddf20e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:00.570912 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc75f0f-0144-441c-86b0-c84827ddf20e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:00.585492 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 513/1027] 10.222.0.58 () {56 vars in 1087 bytes} [Wed Aug 24 09:33:00 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:33:00.767420 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d75be-9c91-4ccb-bd56-1bf01b5c987b None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:00.767908 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d75be-9c91-4ccb-bd56-1bf01b5c987b None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:00.767993 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d75be-9c91-4ccb-bd56-1bf01b5c987b None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:00.769442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 515/1028] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:33:00.774748 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94500b-6190-4233-8408-3673568b5f20 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:00.775168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94500b-6190-4233-8408-3673568b5f20 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:00.775361 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94500b-6190-4233-8408-3673568b5f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:00.793245 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-fd94500b-6190-4233-8408-3673568b5f20 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:00.794475 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-fd94500b-6190-4233-8408-3673568b5f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:00.869337 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 514/1029] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:33:01.137756 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d75be-9c91-4ccb-bd56-1bf01b5c987b None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:01.253356 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d75be-9c91-4ccb-bd56-1bf01b5c987b None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:01.287773 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a101ed5-140d-427b-8d26-9f5c13d8f399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:01.288727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a101ed5-140d-427b-8d26-9f5c13d8f399 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:01.289215 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a101ed5-140d-427b-8d26-9f5c13d8f399 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:01.289736 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a101ed5-140d-427b-8d26-9f5c13d8f399 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:01.301826 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a101ed5-140d-427b-8d26-9f5c13d8f399 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:33:01.307104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-9a101ed5-140d-427b-8d26-9f5c13d8f399 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:33:01.307104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:01.307104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:01.307104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:01.307104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:01.307104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:01.307104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:01.307104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:01.307104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:01.307104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:01.307104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:01.307104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:01.307104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:33:01.307104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:33:01.307104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:33:01.307104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:33:01.308112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:33:01.308112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:33:01.308112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:33:01.308112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:33:01.308112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:01.308112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:01.308112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:01.308112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:01.308112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:01.308112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:01.308112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:01.308112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:01.308112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:01.308112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:01.308112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:01.308112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:01.309023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:01.309023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:01.309023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:01.309023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:01.309023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:33:01.309023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:33:01.309023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:33:01.309023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:33:01.309023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:33:01.309023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:33:01.309023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:33:01.309023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:33:01.312547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 516/1030] 10.222.0.58 () {56 vars in 1120 bytes} [Wed Aug 24 09:33:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:33:01.317181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94500b-6190-4233-8408-3673568b5f20 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:01.360283 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:01.419445 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94500b-6190-4233-8408-3673568b5f20 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:01.454062 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bd05a-3462-41a2-a888-1124868f0b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:01.455449 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bd05a-3462-41a2-a888-1124868f0b07 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:01.455731 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bd05a-3462-41a2-a888-1124868f0b07 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:01.456004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bd05a-3462-41a2-a888-1124868f0b07 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:01.456670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bd05a-3462-41a2-a888-1124868f0b07 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:01.456987 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bd05a-3462-41a2-a888-1124868f0b07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:01.458362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bd05a-3462-41a2-a888-1124868f0b07 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:01.471711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 515/1031] 10.222.0.58 () {56 vars in 1115 bytes} [Wed Aug 24 09:33:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:01.473167 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a101ed5-140d-427b-8d26-9f5c13d8f399 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:01.492182 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:01.578932 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a101ed5-140d-427b-8d26-9f5c13d8f399 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:01.613813 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a73aba-ef6d-4011-9fe5-101829d95cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:01.614446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a73aba-ef6d-4011-9fe5-101829d95cbf None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:01.614728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a73aba-ef6d-4011-9fe5-101829d95cbf None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:01.615006 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a73aba-ef6d-4011-9fe5-101829d95cbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:01.625911 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a73aba-ef6d-4011-9fe5-101829d95cbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:01.628038 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a73aba-ef6d-4011-9fe5-101829d95cbf None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:01.642361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-d2a73aba-ef6d-4011-9fe5-101829d95cbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:33:01.642361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:01.642361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:01.642361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:01.642361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:01.642361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:01.642361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:01.642361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:01.642361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:01.642361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:01.642361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:01.642361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:01.642361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:33:01.642361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:33:01.642361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:33:01.642361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:33:01.643288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:01.643288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:01.643288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:01.643288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:01.643288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:01.643288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:01.643288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:01.643288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:01.643288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:01.643288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:01.643288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:01.643288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:01.643288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:01.643288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:01.643288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:01.643288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:01.643288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:33:01.644170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:33:01.644170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:33:01.644170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:33:01.648436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 517/1032] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:33:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:33:01.649832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bd05a-3462-41a2-a888-1124868f0b07 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:01.757613 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bd05a-3462-41a2-a888-1124868f0b07 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:01.759973 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:01.793712 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c73c1d-130e-4c16-a7df-ce112fe1b686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:01.794342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c73c1d-130e-4c16-a7df-ce112fe1b686 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:01.794594 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c73c1d-130e-4c16-a7df-ce112fe1b686 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:01.794845 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c73c1d-130e-4c16-a7df-ce112fe1b686 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:01.795489 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c73c1d-130e-4c16-a7df-ce112fe1b686 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:01.795789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c73c1d-130e-4c16-a7df-ce112fe1b686 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:01.797137 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c73c1d-130e-4c16-a7df-ce112fe1b686 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:01.814643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 516/1033] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:01.816333 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a73aba-ef6d-4011-9fe5-101829d95cbf None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:01.885381 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:01.921645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a73aba-ef6d-4011-9fe5-101829d95cbf None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:01.958944 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5467a4-1e89-44d2-b23b-123f2ed8ebe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:01.959573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5467a4-1e89-44d2-b23b-123f2ed8ebe2 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:01.959853 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5467a4-1e89-44d2-b23b-123f2ed8ebe2 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:01.960125 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5467a4-1e89-44d2-b23b-123f2ed8ebe2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:01.967774 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5467a4-1e89-44d2-b23b-123f2ed8ebe2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:01.969196 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5467a4-1e89-44d2-b23b-123f2ed8ebe2 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:01.980673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-ba5467a4-1e89-44d2-b23b-123f2ed8ebe2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:33:01.980673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:01.980673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:01.980673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:01.980673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:01.980673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:01.980673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:01.980673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:01.980673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:01.980673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:01.980673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:01.980673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:01.980673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:33:01.980673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:33:01.980673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:33:01.980673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:33:01.981635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:01.981635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:01.981635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:33:01.981635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:33:01.981635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:33:01.981635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:33:01.981635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:01.981635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:01.981635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:01.981635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:01.981635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:01.981635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:01.981635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:01.981635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:01.981635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:01.981635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:01.981635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:01.981635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:01.988289 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:01.988289 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:01.988289 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:33:01.988289 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:33:01.988289 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:33:01.988289 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:33:01.988289 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:33:01.988289 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:33:01.988289 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:33:01.988289 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:33:01.988289 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 518/1034] 10.222.0.58 () {56 vars in 1093 bytes} [Wed Aug 24 09:33:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:33:01.990388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c73c1d-130e-4c16-a7df-ce112fe1b686 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:02.096637 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c73c1d-130e-4c16-a7df-ce112fe1b686 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:02.131681 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6a4d7-938c-4175-b776-e893c3757961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:02.132288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6a4d7-938c-4175-b776-e893c3757961 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:02.132564 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6a4d7-938c-4175-b776-e893c3757961 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:02.132835 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6a4d7-938c-4175-b776-e893c3757961 None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:02.133582 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6a4d7-938c-4175-b776-e893c3757961 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:02.133945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6a4d7-938c-4175-b776-e893c3757961 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:02.135375 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6a4d7-938c-4175-b776-e893c3757961 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:02.141392 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7051d4d-1e4b-4e2e-8ccc-24b4d07d8354 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:02.141687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7051d4d-1e4b-4e2e-8ccc-24b4d07d8354 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:02.142612 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7051d4d-1e4b-4e2e-8ccc-24b4d07d8354 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:02.144081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 519/1035] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:33:02.149044 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726c3f1-41be-42ef-bab3-08c2111995f3 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:02.149323 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726c3f1-41be-42ef-bab3-08c2111995f3 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:02.149622 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726c3f1-41be-42ef-bab3-08c2111995f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:02.159440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 517/1036] 10.222.0.58 () {56 vars in 1133 bytes} [Wed Aug 24 09:33:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:02.161547 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6a4d7-938c-4175-b776-e893c3757961 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:02.172689 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-4726c3f1-41be-42ef-bab3-08c2111995f3 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:02.174426 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-4726c3f1-41be-42ef-bab3-08c2111995f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:02.188533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:02.250483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 520/1037] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:33:02.278908 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6a4d7-938c-4175-b776-e893c3757961 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:02.314412 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e88f16-1ae5-44e5-8803-a66b2bff02a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:02.315300 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e88f16-1ae5-44e5-8803-a66b2bff02a9 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:02.315608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e88f16-1ae5-44e5-8803-a66b2bff02a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:02.315884 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e88f16-1ae5-44e5-8803-a66b2bff02a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:02.384967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e88f16-1ae5-44e5-8803-a66b2bff02a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:02.386342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e88f16-1ae5-44e5-8803-a66b2bff02a9 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:02.409310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:02.491098 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 518/1038] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:33:02 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 09:33:02.492353 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726c3f1-41be-42ef-bab3-08c2111995f3 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:02.529824 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e88f16-1ae5-44e5-8803-a66b2bff02a9 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:02.551765 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:02.593845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726c3f1-41be-42ef-bab3-08c2111995f3 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:02.628851 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50375551-f5c7-44ab-bffa-389ce233c7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:02.629588 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50375551-f5c7-44ab-bffa-389ce233c7a7 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:02.629876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50375551-f5c7-44ab-bffa-389ce233c7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:02.630143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50375551-f5c7-44ab-bffa-389ce233c7a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:02.631623 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e88f16-1ae5-44e5-8803-a66b2bff02a9 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:02.640091 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50375551-f5c7-44ab-bffa-389ce233c7a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:02.641481 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50375551-f5c7-44ab-bffa-389ce233c7a7 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:02.654318 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:02.656447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-50375551-f5c7-44ab-bffa-389ce233c7a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:33:02.656447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:02.656447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:02.656447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:02.656447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:02.656447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:02.656447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:02.656447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:02.656447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:02.656447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:02.656447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:02.656447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:02.656447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:33:02.656447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:33:02.656447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:33:02.656447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:33:02.657500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:02.657500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:02.657500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:02.657500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:02.657500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:02.657500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:02.657500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:02.657500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:02.657500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:02.657500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:02.657500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:02.657500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:02.657500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:02.657500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:02.657500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:02.657500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:02.657500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:33:02.658574 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:33:02.658574 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:33:02.658574 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:33:02.658574 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 521/1039] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:33:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:33:02.659124 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39ce9c-1a64-4ef7-a234-3dfdaa0569e9 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:02.659465 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39ce9c-1a64-4ef7-a234-3dfdaa0569e9 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:02.659747 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39ce9c-1a64-4ef7-a234-3dfdaa0569e9 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:02.660974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 522/1040] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:33:02.663210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39ce9c-1a64-4ef7-a234-3dfdaa0569e9 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:02.672759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee709c-547c-476a-86c9-bba97c1ceb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:02.673438 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee709c-547c-476a-86c9-bba97c1ceb71 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:02.673742 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee709c-547c-476a-86c9-bba97c1ceb71 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:02.674019 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee709c-547c-476a-86c9-bba97c1ceb71 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:02.675112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee709c-547c-476a-86c9-bba97c1ceb71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:02.676533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee709c-547c-476a-86c9-bba97c1ceb71 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:02.678386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 519/1041] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:33:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:33:02.679396 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf938f7-a96b-40d9-a9ee-29777071173c None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:02.679674 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf938f7-a96b-40d9-a9ee-29777071173c None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:02.679947 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf938f7-a96b-40d9-a9ee-29777071173c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:02.697796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-dcf938f7-a96b-40d9-a9ee-29777071173c None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:02.698991 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-dcf938f7-a96b-40d9-a9ee-29777071173c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:02.767757 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39ce9c-1a64-4ef7-a234-3dfdaa0569e9 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:02.768348 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 520/1042] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:33:02.769176 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf938f7-a96b-40d9-a9ee-29777071173c None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:02.783248 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:02.813355 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad2cdc-b6cc-40f1-8bac-36ca2996a527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:02.814238 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad2cdc-b6cc-40f1-8bac-36ca2996a527 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:02.814528 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad2cdc-b6cc-40f1-8bac-36ca2996a527 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:02.814802 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad2cdc-b6cc-40f1-8bac-36ca2996a527 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:02.815454 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad2cdc-b6cc-40f1-8bac-36ca2996a527 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:02.815765 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad2cdc-b6cc-40f1-8bac-36ca2996a527 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:02.817169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad2cdc-b6cc-40f1-8bac-36ca2996a527 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:02.829584 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 523/1043] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:33:02.834932 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad2cdc-b6cc-40f1-8bac-36ca2996a527 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:02.886485 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf938f7-a96b-40d9-a9ee-29777071173c None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:02.908492 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:02.924225 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b172d97-c571-4a1a-b0ef-4e79afadd7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:02.924834 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b172d97-c571-4a1a-b0ef-4e79afadd7a3 None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:02.925116 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b172d97-c571-4a1a-b0ef-4e79afadd7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:02.925391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b172d97-c571-4a1a-b0ef-4e79afadd7a3 None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:02.926071 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b172d97-c571-4a1a-b0ef-4e79afadd7a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:02.927486 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b172d97-c571-4a1a-b0ef-4e79afadd7a3 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:02.949591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad2cdc-b6cc-40f1-8bac-36ca2996a527 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:02.961494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 521/1044] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 09:33:02 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:33:02.990711 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72918b8-bb2e-403f-91a6-be83144a9740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:02.991358 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72918b8-bb2e-403f-91a6-be83144a9740 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:02.991695 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72918b8-bb2e-403f-91a6-be83144a9740 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:02.991975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72918b8-bb2e-403f-91a6-be83144a9740 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:02.999961 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72918b8-bb2e-403f-91a6-be83144a9740 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:03.001766 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72918b8-bb2e-403f-91a6-be83144a9740 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:03.014499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-a72918b8-bb2e-403f-91a6-be83144a9740 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:33:03.014499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:03.014499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:03.014499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:03.014499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:03.014499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:03.014499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:03.014499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:03.014499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:03.014499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:03.014499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:03.014499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:03.014499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:33:03.014499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:33:03.014499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:33:03.015522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:33:03.015522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:03.015522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:03.015522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:03.015522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:03.015522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:03.015522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:03.015522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:03.015522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:03.015522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:03.015522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:03.015522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:03.015522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:03.015522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:03.015522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:03.015522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:03.015522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:03.016424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:33:03.016424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:33:03.016424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:33:03.016424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:33:03.016424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:33:03.016424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:33:03.016424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:33:03.016424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:33:03.021348 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 524/1045] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:33:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:33:03.022686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b172d97-c571-4a1a-b0ef-4e79afadd7a3 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:03.039129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72918b8-bb2e-403f-91a6-be83144a9740 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:03.075497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:03.142417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b172d97-c571-4a1a-b0ef-4e79afadd7a3 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:03.164819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72918b8-bb2e-403f-91a6-be83144a9740 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:03.183312 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b869238-6304-4231-b575-2390a0168cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:03.183920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b869238-6304-4231-b575-2390a0168cd8 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:03.184193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b869238-6304-4231-b575-2390a0168cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:03.184462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b869238-6304-4231-b575-2390a0168cd8 None admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:03.185151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b869238-6304-4231-b575-2390a0168cd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:03.185451 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b869238-6304-4231-b575-2390a0168cd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:03.186950 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b869238-6304-4231-b575-2390a0168cd8 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:03.200036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 522/1046] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:33:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:03.202175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597134df-0127-4ffb-9a51-57ddd55eabba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:03.202872 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597134df-0127-4ffb-9a51-57ddd55eabba None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:03.203210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597134df-0127-4ffb-9a51-57ddd55eabba None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:03.203541 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597134df-0127-4ffb-9a51-57ddd55eabba None admin] PATH_INFO: `/v3/services/image` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:03.204190 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597134df-0127-4ffb-9a51-57ddd55eabba None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:03.206312 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597134df-0127-4ffb-9a51-57ddd55eabba None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:03.206484 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b869238-6304-4231-b575-2390a0168cd8 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:03.217448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-597134df-0127-4ffb-9a51-57ddd55eabba None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:33:03.217448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:03.217448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:33:03.217448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:33:03.217448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:33:03.217448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:33:03.217448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:33:03.217448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:33:03.217448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:33:03.217448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:33:03.217448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:33:03.217448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:33:03.217448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:03.217448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:03.217448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:03.217448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:03.217448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:03.218678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:03.218678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:03.218678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:03.218678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:03.218678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:03.218678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:03.218678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:33:03.218678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:33:03.218678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:33:03.218678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:33:03.218678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:03.218678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:03.218678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:03.218678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:03.218678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:03.218678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:03.219707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:03.219707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:03.219707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:03.219707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:03.219707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:03.219707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:03.219707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:03.219707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:03.219707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:03.219707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:03.219707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:33:03.219707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:33:03.219707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 09:33:03.219707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:33:03.225076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 525/1047] 10.222.0.58 () {56 vars in 1105 bytes} [Wed Aug 24 09:33:03 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:33:03.228534 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597134df-0127-4ffb-9a51-57ddd55eabba None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:03.250465 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:03.330554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b869238-6304-4231-b575-2390a0168cd8 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:03.343023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:03.351195 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597134df-0127-4ffb-9a51-57ddd55eabba None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:03.367905 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314d4da-7f20-497a-bdf7-e876da248765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:03.368597 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314d4da-7f20-497a-bdf7-e876da248765 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:03.368779 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314d4da-7f20-497a-bdf7-e876da248765 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:03.369045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314d4da-7f20-497a-bdf7-e876da248765 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:03.369791 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314d4da-7f20-497a-bdf7-e876da248765 None admin] RBAC: Adding query filter params (role.id=82c00b0c6f4942a1b7b2c5b01d4846f3, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=18be8c54c9644c5e9812eea09e60c11c) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:03.370099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314d4da-7f20-497a-bdf7-e876da248765 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:03.371513 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314d4da-7f20-497a-bdf7-e876da248765 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:03.377522 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 523/1048] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:33:03 2022] GET /identity/v3/role_assignments?user.id=18be8c54c9644c5e9812eea09e60c11c&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=82c00b0c6f4942a1b7b2c5b01d4846f3 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:33:03.390284 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a0ac0-3766-4b0a-a315-ea128f8d1c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:03.390917 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a0ac0-3766-4b0a-a315-ea128f8d1c5d None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:03.391274 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a0ac0-3766-4b0a-a315-ea128f8d1c5d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:03.391556 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a0ac0-3766-4b0a-a315-ea128f8d1c5d None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:03.392836 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a0ac0-3766-4b0a-a315-ea128f8d1c5d None admin] RBAC: Adding query filter params (name=image) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:03.393144 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a0ac0-3766-4b0a-a315-ea128f8d1c5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:03.394738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a0ac0-3766-4b0a-a315-ea128f8d1c5d None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:03.400825 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 526/1049] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:33:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:03.406623 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314d4da-7f20-497a-bdf7-e876da248765 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:03.516454 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:03.520638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314d4da-7f20-497a-bdf7-e876da248765 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:03.557331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34032cdf-4230-4e36-9571-23bd473fc499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:03.557959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34032cdf-4230-4e36-9571-23bd473fc499 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:03.558236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34032cdf-4230-4e36-9571-23bd473fc499 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:03.558506 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34032cdf-4230-4e36-9571-23bd473fc499 None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:03.559132 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34032cdf-4230-4e36-9571-23bd473fc499 None admin] RBAC: Adding query filter params (type=image) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:03.559443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34032cdf-4230-4e36-9571-23bd473fc499 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:03.560776 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34032cdf-4230-4e36-9571-23bd473fc499 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:03.565850 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 524/1050] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:33:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:03.571276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a0ac0-3766-4b0a-a315-ea128f8d1c5d None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:03.672068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a0ac0-3766-4b0a-a315-ea128f8d1c5d None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:03.706246 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcb91d-0126-41f2-8f71-dabd701bb3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:03.706848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcb91d-0126-41f2-8f71-dabd701bb3fa None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:03.707130 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcb91d-0126-41f2-8f71-dabd701bb3fa None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:03.707398 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcb91d-0126-41f2-8f71-dabd701bb3fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:03.708061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcb91d-0126-41f2-8f71-dabd701bb3fa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:03.709413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcb91d-0126-41f2-8f71-dabd701bb3fa None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:03.733504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 527/1051] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:33:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:33:04.946533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e1240-61b5-469a-8fb8-3bff51454943 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:04.947154 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e1240-61b5-469a-8fb8-3bff51454943 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:04.947154 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e1240-61b5-469a-8fb8-3bff51454943 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:04.948588 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 525/1052] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:33:04.953618 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02cfb4-6a1d-455b-82cd-a3d0f88adb98 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:04.954007 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02cfb4-6a1d-455b-82cd-a3d0f88adb98 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:04.954200 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02cfb4-6a1d-455b-82cd-a3d0f88adb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:04.973359 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-ac02cfb4-6a1d-455b-82cd-a3d0f88adb98 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:04.974581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ac02cfb4-6a1d-455b-82cd-a3d0f88adb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:04.984749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:05.052750 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 528/1053] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:33:05.310372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff65cd-22f0-4b13-bc6c-2306ef198c2a None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:05.310702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff65cd-22f0-4b13-bc6c-2306ef198c2a None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:05.310923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff65cd-22f0-4b13-bc6c-2306ef198c2a None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:05.312312 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 526/1054] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:33:05.317573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae576e06-2a3d-41ec-8237-a82b01c61802 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:05.317863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae576e06-2a3d-41ec-8237-a82b01c61802 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:05.318135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae576e06-2a3d-41ec-8237-a82b01c61802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:05.319895 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff65cd-22f0-4b13-bc6c-2306ef198c2a None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:05.337705 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-ae576e06-2a3d-41ec-8237-a82b01c61802 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:05.338908 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ae576e06-2a3d-41ec-8237-a82b01c61802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:05.421126 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 529/1055] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:33:05.441648 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff65cd-22f0-4b13-bc6c-2306ef198c2a None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:05.476787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4ca47-f9b2-4cb4-af9a-49e0b700b3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:05.477339 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4ca47-f9b2-4cb4-af9a-49e0b700b3f3 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:05.477656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4ca47-f9b2-4cb4-af9a-49e0b700b3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:05.477928 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4ca47-f9b2-4cb4-af9a-49e0b700b3f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:05.488493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4ca47-f9b2-4cb4-af9a-49e0b700b3f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:33:05.493212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-41a4ca47-f9b2-4cb4-af9a-49e0b700b3f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:33:05.493212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:05.493212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:05.493212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:05.493212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:05.493212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:05.493212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:05.493212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:05.493212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:05.493212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:05.493212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:05.493212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:05.493212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:33:05.493212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:33:05.493212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:33:05.493212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:33:05.494151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:33:05.494151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:33:05.494151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:33:05.494151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:33:05.494151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:05.494151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:05.494151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:05.494151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:05.494151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:05.494151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:05.494151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:05.494151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:05.494151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:05.494151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:05.494151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:05.494151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:05.498423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:05.498423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:05.498423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:05.498423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:05.498423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:33:05.498423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:33:05.498423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:33:05.498423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:33:05.498423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:33:05.498423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:33:05.498423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:33:05.498423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:33:05.498423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 527/1056] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:33:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:33:05.500634 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae576e06-2a3d-41ec-8237-a82b01c61802 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:05.573876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:05.606361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae576e06-2a3d-41ec-8237-a82b01c61802 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:05.642813 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c40bd-52f9-42f6-85d4-f53c2dac4a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:05.643415 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c40bd-52f9-42f6-85d4-f53c2dac4a4d None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:05.643693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c40bd-52f9-42f6-85d4-f53c2dac4a4d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:05.643966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c40bd-52f9-42f6-85d4-f53c2dac4a4d None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:05.644627 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c40bd-52f9-42f6-85d4-f53c2dac4a4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:05.644930 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c40bd-52f9-42f6-85d4-f53c2dac4a4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:05.646313 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c40bd-52f9-42f6-85d4-f53c2dac4a4d None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:05.650797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d8d24-ba76-48ba-a1ff-a30e3493bf5b None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:05.651082 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d8d24-ba76-48ba-a1ff-a30e3493bf5b None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:05.651357 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d8d24-ba76-48ba-a1ff-a30e3493bf5b None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:05.652820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 528/1057] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:33:05.656564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 530/1058] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:33:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:05.657966 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f0ee2-6925-4447-9eec-f2f6a236ad9e None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:05.658254 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f0ee2-6925-4447-9eec-f2f6a236ad9e None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:05.658522 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f0ee2-6925-4447-9eec-f2f6a236ad9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:05.660864 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c40bd-52f9-42f6-85d4-f53c2dac4a4d None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:05.676357 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-b37f0ee2-6925-4447-9eec-f2f6a236ad9e None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:05.677567 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-b37f0ee2-6925-4447-9eec-f2f6a236ad9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:05.697237 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:05.748751 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 529/1059] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:33:05.749747 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f0ee2-6925-4447-9eec-f2f6a236ad9e None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:05.774959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c40bd-52f9-42f6-85d4-f53c2dac4a4d None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:05.804207 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:05.809626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654454f6-198b-4921-bd3c-d855d319d236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:05.810255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654454f6-198b-4921-bd3c-d855d319d236 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:05.810533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654454f6-198b-4921-bd3c-d855d319d236 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:05.810807 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654454f6-198b-4921-bd3c-d855d319d236 None admin] PATH_INFO: `/v3/users/3e3a8d9b61a5496e8b4c4baf33aec7ef` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:05.825122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654454f6-198b-4921-bd3c-d855d319d236 None admin] RBAC: Authorizing `identity:get_user(user_id=3e3a8d9b61a5496e8b4c4baf33aec7ef)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:05.826935 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654454f6-198b-4921-bd3c-d855d319d236 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:05.834071 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 531/1060] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:33:05 2022] GET /identity/v3/users/3e3a8d9b61a5496e8b4c4baf33aec7ef => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:33:05.835098 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654454f6-198b-4921-bd3c-d855d319d236 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:05.867957 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f0ee2-6925-4447-9eec-f2f6a236ad9e None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:05.904744 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b22cd6-a893-4a02-a0bd-4380aeb087fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:05.905375 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b22cd6-a893-4a02-a0bd-4380aeb087fe None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:05.905691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b22cd6-a893-4a02-a0bd-4380aeb087fe None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:05.905961 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b22cd6-a893-4a02-a0bd-4380aeb087fe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:05.921906 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b22cd6-a893-4a02-a0bd-4380aeb087fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:33:05.927792 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-68b22cd6-a893-4a02-a0bd-4380aeb087fe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:33:05.927792 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:05.927792 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:05.927792 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:05.927792 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:05.927792 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:05.927792 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:05.927792 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:05.927792 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:05.927792 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:05.927792 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:05.927792 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:05.927792 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:33:05.927792 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:33:05.927792 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:33:05.927792 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:33:05.928972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:33:05.928972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:33:05.928972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:33:05.928972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:33:05.928972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:05.928972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:05.928972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:05.928972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:05.928972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:05.928972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:05.928972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:05.928972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:05.928972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:05.928972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:05.928972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:05.928972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:05.929860 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:05.929860 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:05.929860 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:05.929860 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:05.929860 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:33:05.929860 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:33:05.929860 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:33:05.929860 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:33:05.929860 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:33:05.929860 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:33:05.929860 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:33:05.929860 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:33:05.929860 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 530/1061] 10.222.0.58 () {56 vars in 1120 bytes} [Wed Aug 24 09:33:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:33:05.934966 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b22cd6-a893-4a02-a0bd-4380aeb087fe None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:05.943853 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654454f6-198b-4921-bd3c-d855d319d236 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:05.954046 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:05.986124 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c2b82-e5f6-4b22-bd73-180236c0bae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:05.986823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c2b82-e5f6-4b22-bd73-180236c0bae9 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:05.987110 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c2b82-e5f6-4b22-bd73-180236c0bae9 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:05.987380 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c2b82-e5f6-4b22-bd73-180236c0bae9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:06.045692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b22cd6-a893-4a02-a0bd-4380aeb087fe None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:06.046665 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:06.058858 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c2b82-e5f6-4b22-bd73-180236c0bae9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:06.060298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c2b82-e5f6-4b22-bd73-180236c0bae9 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:06.081275 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7572d-7742-4012-83b0-677480580ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:06.081918 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7572d-7742-4012-83b0-677480580ddf None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:06.082201 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7572d-7742-4012-83b0-677480580ddf None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:06.082474 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7572d-7742-4012-83b0-677480580ddf None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:06.083139 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7572d-7742-4012-83b0-677480580ddf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:06.083443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7572d-7742-4012-83b0-677480580ddf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:06.084807 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7572d-7742-4012-83b0-677480580ddf None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:06.092799 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 531/1062] 10.222.0.58 () {56 vars in 1115 bytes} [Wed Aug 24 09:33:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:33:06.093610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7572d-7742-4012-83b0-677480580ddf None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:06.163943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 532/1063] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:33:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 09:33:06.164781 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c2b82-e5f6-4b22-bd73-180236c0bae9 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:06.169418 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:06.194243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7572d-7742-4012-83b0-677480580ddf None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:06.228180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a8bfd-9bf1-409c-a0f2-becc0a5a5aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:06.228789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a8bfd-9bf1-409c-a0f2-becc0a5a5aea None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:06.229066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a8bfd-9bf1-409c-a0f2-becc0a5a5aea None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:06.229339 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a8bfd-9bf1-409c-a0f2-becc0a5a5aea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:06.257135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:06.267426 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c2b82-e5f6-4b22-bd73-180236c0bae9 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:06.298079 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a8bfd-9bf1-409c-a0f2-becc0a5a5aea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:06.300121 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a8bfd-9bf1-409c-a0f2-becc0a5a5aea None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:06.302051 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e2de0-b734-4ed4-ba05-dfa629a730f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:06.302666 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e2de0-b734-4ed4-ba05-dfa629a730f5 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:06.302940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e2de0-b734-4ed4-ba05-dfa629a730f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:06.303203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e2de0-b734-4ed4-ba05-dfa629a730f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:06.313340 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e2de0-b734-4ed4-ba05-dfa629a730f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:06.315116 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356e2de0-b734-4ed4-ba05-dfa629a730f5 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:06.330193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-356e2de0-b734-4ed4-ba05-dfa629a730f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:33:06.330193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:06.330193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:06.330193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:06.330193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:06.330193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:06.330193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:06.330193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:06.330193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:06.330193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:06.330193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:06.330193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:06.330193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:33:06.330193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:33:06.330193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:33:06.330193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:33:06.331255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:06.331255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:06.331255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:06.331255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:06.331255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:06.331255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:06.331255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:06.331255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:06.331255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:06.331255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:06.331255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:06.331255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:06.331255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:06.331255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:06.331255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:06.331255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:06.331255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:33:06.332661 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:33:06.332661 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:33:06.332661 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:33:06.332661 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 533/1064] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:33:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:33:06.332661 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e2de0-b734-4ed4-ba05-dfa629a730f5 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:06.380182 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:06.403225 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 532/1065] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:33:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:33:06.404046 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a8bfd-9bf1-409c-a0f2-becc0a5a5aea None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:06.433703 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356e2de0-b734-4ed4-ba05-dfa629a730f5 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:06.476530 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c03088-2471-4e47-aac5-f6334333e486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:06.477157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c03088-2471-4e47-aac5-f6334333e486 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:06.477433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c03088-2471-4e47-aac5-f6334333e486 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:06.477740 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c03088-2471-4e47-aac5-f6334333e486 None admin] PATH_INFO: `/v3/projects/2ef2759ff4054381b71914bd8d47916e` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:06.478872 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c03088-2471-4e47-aac5-f6334333e486 None admin] RBAC: Authorizing `identity:get_project(project_id=2ef2759ff4054381b71914bd8d47916e)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:06.480302 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c03088-2471-4e47-aac5-f6334333e486 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:06.481981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 534/1066] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:33:06 2022] GET /identity/v3/projects/2ef2759ff4054381b71914bd8d47916e => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:06.482739 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c03088-2471-4e47-aac5-f6334333e486 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:06.497677 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:06.516231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a8bfd-9bf1-409c-a0f2-becc0a5a5aea None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:06.551237 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4dc2a-9826-46a2-85b5-b56705dbb70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:06.551761 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4dc2a-9826-46a2-85b5-b56705dbb70f None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:06.552038 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4dc2a-9826-46a2-85b5-b56705dbb70f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:06.552313 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4dc2a-9826-46a2-85b5-b56705dbb70f None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:06.552949 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4dc2a-9826-46a2-85b5-b56705dbb70f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:06.553249 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4dc2a-9826-46a2-85b5-b56705dbb70f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:06.554631 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4dc2a-9826-46a2-85b5-b56705dbb70f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:06.566811 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 533/1067] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:06.567603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4dc2a-9826-46a2-85b5-b56705dbb70f None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:06.587036 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c03088-2471-4e47-aac5-f6334333e486 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:06.602652 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:06.620141 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e462b3e-eb6f-4cf7-95de-a4e56b55ff7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:06.620764 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e462b3e-eb6f-4cf7-95de-a4e56b55ff7c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:06.621036 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e462b3e-eb6f-4cf7-95de-a4e56b55ff7c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:06.621304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e462b3e-eb6f-4cf7-95de-a4e56b55ff7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:06.632438 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e462b3e-eb6f-4cf7-95de-a4e56b55ff7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:06.633975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e462b3e-eb6f-4cf7-95de-a4e56b55ff7c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:06.648374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-2e462b3e-eb6f-4cf7-95de-a4e56b55ff7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:33:06.648374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:06.648374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:06.648374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:06.648374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:06.648374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:06.648374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:06.648374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:06.648374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:06.648374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:06.648374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:06.648374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:06.648374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:33:06.648374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:33:06.648374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:33:06.648374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:33:06.649424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:06.649424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:06.649424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:06.649424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:06.649424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:06.649424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:06.649424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:06.649424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:06.649424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:06.649424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:06.649424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:06.649424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:06.649424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:06.649424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:06.649424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:06.649424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:06.649424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:33:06.650737 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:33:06.650737 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:33:06.650737 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:33:06.650737 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 535/1068] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:33:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:33:06.650737 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e462b3e-eb6f-4cf7-95de-a4e56b55ff7c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:06.671499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4dc2a-9826-46a2-85b5-b56705dbb70f None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:06.705896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002eda40-e2d8-48fd-8f67-d93a082da479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:06.706501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eda40-e2d8-48fd-8f67-d93a082da479 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:06.706777 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eda40-e2d8-48fd-8f67-d93a082da479 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:06.707051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eda40-e2d8-48fd-8f67-d93a082da479 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:06.707770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002eda40-e2d8-48fd-8f67-d93a082da479 None admin] RBAC: Adding query filter params (role.id=cd2effe8340d4be08a28d3a40db6979d, scope.project.id=2ef2759ff4054381b71914bd8d47916e, user.id=3e3a8d9b61a5496e8b4c4baf33aec7ef) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:06.708075 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002eda40-e2d8-48fd-8f67-d93a082da479 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:06.709510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002eda40-e2d8-48fd-8f67-d93a082da479 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:06.710932 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:06.715270 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 534/1069] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:33:06 2022] GET /identity/v3/role_assignments?user.id=3e3a8d9b61a5496e8b4c4baf33aec7ef&scope.project.id=2ef2759ff4054381b71914bd8d47916e&role.id=cd2effe8340d4be08a28d3a40db6979d => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:06.716051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002eda40-e2d8-48fd-8f67-d93a082da479 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:06.756440 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e462b3e-eb6f-4cf7-95de-a4e56b55ff7c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:06.796750 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa704b-fb65-4659-8344-4e0fcee35a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:06.797400 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa704b-fb65-4659-8344-4e0fcee35a2e None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:06.797709 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa704b-fb65-4659-8344-4e0fcee35a2e None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:06.798541 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa704b-fb65-4659-8344-4e0fcee35a2e None admin] PATH_INFO: `/v3/users/nova` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:06.807435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa704b-fb65-4659-8344-4e0fcee35a2e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:06.809017 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa704b-fb65-4659-8344-4e0fcee35a2e None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:06.822593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-d2fa704b-fb65-4659-8344-4e0fcee35a2e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:33:06.822593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:06.822593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:06.822593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:06.822593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:06.822593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:06.822593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:06.822593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:06.822593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:06.822593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:06.822593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:06.822593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:06.822593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:33:06.822593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:33:06.822593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:33:06.822593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:33:06.823610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:06.823610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:06.823610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:33:06.823610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:33:06.823610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:33:06.823610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:33:06.823610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:06.823610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:06.823610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:06.823610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:06.823610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:06.823610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:06.823610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:06.823610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:06.823610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:06.823610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:06.823610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:06.823610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:06.824559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:06.824559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:06.824559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:33:06.824559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:33:06.824559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:33:06.824559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:33:06.824559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:33:06.824559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:33:06.824559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:33:06.824559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:33:06.824559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 536/1070] 10.222.0.58 () {56 vars in 1093 bytes} [Wed Aug 24 09:33:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:33:06.830020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa704b-fb65-4659-8344-4e0fcee35a2e None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:06.840217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:06.843738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002eda40-e2d8-48fd-8f67-d93a082da479 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:06.883747 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd547a73-8eca-41f5-a7fc-157540dd39b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:06.884364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd547a73-8eca-41f5-a7fc-157540dd39b8 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:06.884778 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd547a73-8eca-41f5-a7fc-157540dd39b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:06.885053 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd547a73-8eca-41f5-a7fc-157540dd39b8 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:06.885740 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd547a73-8eca-41f5-a7fc-157540dd39b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:06.886045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd547a73-8eca-41f5-a7fc-157540dd39b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:06.887404 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd547a73-8eca-41f5-a7fc-157540dd39b8 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:06.900149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 535/1071] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:06.944531 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa704b-fb65-4659-8344-4e0fcee35a2e None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:06.971555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:06.986091 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4f468-17ca-42db-be6f-8f2a5bae5865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:06.986762 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4f468-17ca-42db-be6f-8f2a5bae5865 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:06.987311 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4f468-17ca-42db-be6f-8f2a5bae5865 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:06.987311 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4f468-17ca-42db-be6f-8f2a5bae5865 None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:06.988021 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4f468-17ca-42db-be6f-8f2a5bae5865 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:06.988322 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4f468-17ca-42db-be6f-8f2a5bae5865 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:06.989795 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4f468-17ca-42db-be6f-8f2a5bae5865 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:07.014796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 537/1072] 10.222.0.58 () {56 vars in 1133 bytes} [Wed Aug 24 09:33:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:33:07.016251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd547a73-8eca-41f5-a7fc-157540dd39b8 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:07.124653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd547a73-8eca-41f5-a7fc-157540dd39b8 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:07.161380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f75d99-1556-47cc-aa1a-eaca22097167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:07.162059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f75d99-1556-47cc-aa1a-eaca22097167 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:07.162339 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f75d99-1556-47cc-aa1a-eaca22097167 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:07.162608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f75d99-1556-47cc-aa1a-eaca22097167 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:07.173503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f75d99-1556-47cc-aa1a-eaca22097167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:07.175194 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f75d99-1556-47cc-aa1a-eaca22097167 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:07.190653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-11f75d99-1556-47cc-aa1a-eaca22097167 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:33:07.190653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:07.190653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:07.190653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:07.190653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:07.190653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:07.190653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:07.190653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:07.190653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:07.190653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:07.190653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:07.190653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:07.190653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:33:07.190653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:33:07.190653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:33:07.190653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:33:07.191805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:07.191805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:07.191805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:07.191805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:07.191805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:07.191805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:07.191805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:07.191805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:07.191805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:07.191805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:07.191805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:07.191805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:07.191805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:07.191805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:07.191805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:07.191805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:07.191805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:33:07.193045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:33:07.193045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:33:07.193045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:33:07.193045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 536/1073] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:33:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:33:07.197623 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4f468-17ca-42db-be6f-8f2a5bae5865 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:07.301175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4f468-17ca-42db-be6f-8f2a5bae5865 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:07.334106 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bbc53-7725-4ee9-8a1e-3428033c8d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:07.334706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bbc53-7725-4ee9-8a1e-3428033c8d39 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:07.334984 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bbc53-7725-4ee9-8a1e-3428033c8d39 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:07.335258 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bbc53-7725-4ee9-8a1e-3428033c8d39 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:07.335901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bbc53-7725-4ee9-8a1e-3428033c8d39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:07.336201 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bbc53-7725-4ee9-8a1e-3428033c8d39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:07.337588 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7bbc53-7725-4ee9-8a1e-3428033c8d39 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:07.349484 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 538/1074] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:07.355147 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f75d99-1556-47cc-aa1a-eaca22097167 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:07.371385 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:07.456520 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f75d99-1556-47cc-aa1a-eaca22097167 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:07.490179 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f34216-f009-45b7-8781-481373774419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:07.490797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f34216-f009-45b7-8781-481373774419 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:07.491078 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f34216-f009-45b7-8781-481373774419 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:07.491353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f34216-f009-45b7-8781-481373774419 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:07.497898 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f34216-f009-45b7-8781-481373774419 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:07.499314 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f34216-f009-45b7-8781-481373774419 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:07.510503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-05f34216-f009-45b7-8781-481373774419 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:33:07.510503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:07.510503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:07.510503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:07.510503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:07.510503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:07.510503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:07.510503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:07.510503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:07.510503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:07.510503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:07.510503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:07.510503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:33:07.510503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:33:07.510503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:33:07.511395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:33:07.511395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:07.511395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:07.511395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:07.511395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:07.511395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:07.511395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:07.511395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:07.511395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:07.511395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:07.511395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:07.511395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:07.511395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:07.511395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:07.511395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:07.511395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:07.511395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:07.512310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:33:07.512310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:33:07.512310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:33:07.512310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:33:07.512310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:33:07.512310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:33:07.512310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:33:07.512310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:33:07.512310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 537/1075] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:33:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:33:07.517928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bbc53-7725-4ee9-8a1e-3428033c8d39 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:07.559399 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:07.617204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bbc53-7725-4ee9-8a1e-3428033c8d39 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:07.650371 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e00e0a-3aee-4749-b6a0-d7bc09b35cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:07.650969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e00e0a-3aee-4749-b6a0-d7bc09b35cc5 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:07.651248 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e00e0a-3aee-4749-b6a0-d7bc09b35cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:07.651520 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e00e0a-3aee-4749-b6a0-d7bc09b35cc5 None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:07.652209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e00e0a-3aee-4749-b6a0-d7bc09b35cc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:07.652516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e00e0a-3aee-4749-b6a0-d7bc09b35cc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:07.653971 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e00e0a-3aee-4749-b6a0-d7bc09b35cc5 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:07.666654 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 539/1076] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:33:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:07.672541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f34216-f009-45b7-8781-481373774419 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:07.743340 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:07.775114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f34216-f009-45b7-8781-481373774419 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:07.815756 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b746d83-762a-4e2d-b417-549bbf0d414c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:07.816416 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b746d83-762a-4e2d-b417-549bbf0d414c None admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:07.816696 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b746d83-762a-4e2d-b417-549bbf0d414c None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:07.816970 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b746d83-762a-4e2d-b417-549bbf0d414c None admin] PATH_INFO: `/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/18be8c54c9644c5e9812eea09e60c11c/roles/82c00b0c6f4942a1b7b2c5b01d4846f3` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:07.819138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b746d83-762a-4e2d-b417-549bbf0d414c None admin] RBAC: Authorizing `identity:create_grant(project_id=1c95aafd70e547d29c7647e6027faf2f, user_id=18be8c54c9644c5e9812eea09e60c11c, role_id=82c00b0c6f4942a1b7b2c5b01d4846f3)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:07.820559 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b746d83-762a-4e2d-b417-549bbf0d414c None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:07.833829 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 538/1077] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:33:07 2022] PUT /identity/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/18be8c54c9644c5e9812eea09e60c11c/roles/82c00b0c6f4942a1b7b2c5b01d4846f3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:33:08.651139 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee115477-a24b-4c60-9828-3c64e8c55522 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:08.651669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee115477-a24b-4c60-9828-3c64e8c55522 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:08.651669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee115477-a24b-4c60-9828-3c64e8c55522 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:08.653148 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 540/1078] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:33:08.658786 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf7e0d-73c2-40dd-978c-ba52c49873bf None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:08.659180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf7e0d-73c2-40dd-978c-ba52c49873bf None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:08.659324 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf7e0d-73c2-40dd-978c-ba52c49873bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:08.677549 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-2adf7e0d-73c2-40dd-978c-ba52c49873bf None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:08.678723 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2adf7e0d-73c2-40dd-978c-ba52c49873bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:08.743753 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 539/1079] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:33:09.011899 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee115477-a24b-4c60-9828-3c64e8c55522 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:09.111566 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:09.116711 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee115477-a24b-4c60-9828-3c64e8c55522 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:09.151250 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfd3f0-8e42-4ae1-8dbd-ef83f4b065bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:09.151880 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfd3f0-8e42-4ae1-8dbd-ef83f4b065bf None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:09.152157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfd3f0-8e42-4ae1-8dbd-ef83f4b065bf None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:09.152428 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfd3f0-8e42-4ae1-8dbd-ef83f4b065bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:09.164157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dfd3f0-8e42-4ae1-8dbd-ef83f4b065bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:33:09.168819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-b7dfd3f0-8e42-4ae1-8dbd-ef83f4b065bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:33:09.168819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:09.168819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:09.168819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:09.168819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:09.168819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:09.168819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:09.168819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:09.168819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:09.168819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:09.168819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:09.168819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:09.168819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:33:09.168819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:33:09.168819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:33:09.168819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:33:09.169943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:33:09.169943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:33:09.169943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:33:09.169943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:33:09.169943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:09.169943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:09.169943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:09.169943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:09.169943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:09.169943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:09.169943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:09.169943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:09.169943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:09.169943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:09.169943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:09.169943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:09.174587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:09.174587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:09.174587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:09.174587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:09.174587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:33:09.174587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:33:09.174587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:33:09.174587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:33:09.174587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:33:09.174587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:33:09.174587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:33:09.174587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:33:09.174587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 541/1080] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:33:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:33:09.176330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf7e0d-73c2-40dd-978c-ba52c49873bf None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:09.237903 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:09.277774 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf7e0d-73c2-40dd-978c-ba52c49873bf None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:09.311391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6b43a-b957-4f06-ada9-4aea8002881e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:09.311995 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6b43a-b957-4f06-ada9-4aea8002881e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:09.312274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6b43a-b957-4f06-ada9-4aea8002881e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:09.312547 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6b43a-b957-4f06-ada9-4aea8002881e None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:09.313214 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6b43a-b957-4f06-ada9-4aea8002881e None admin] RBAC: Adding query filter params (name=admin) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:09.314102 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6b43a-b957-4f06-ada9-4aea8002881e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:09.315460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6b43a-b957-4f06-ada9-4aea8002881e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:09.323465 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 540/1081] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:33:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:09.329955 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfd3f0-8e42-4ae1-8dbd-ef83f4b065bf None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:09.429205 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dfd3f0-8e42-4ae1-8dbd-ef83f4b065bf None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:09.463391 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3ca2c-0b68-4aa4-a72e-8af316319a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:09.464006 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3ca2c-0b68-4aa4-a72e-8af316319a5f None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:09.464285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3ca2c-0b68-4aa4-a72e-8af316319a5f None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:09.464556 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3ca2c-0b68-4aa4-a72e-8af316319a5f None admin] PATH_INFO: `/v3/users/3e3a8d9b61a5496e8b4c4baf33aec7ef` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:09.465706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3ca2c-0b68-4aa4-a72e-8af316319a5f None admin] RBAC: Authorizing `identity:get_user(user_id=3e3a8d9b61a5496e8b4c4baf33aec7ef)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:09.467124 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3ca2c-0b68-4aa4-a72e-8af316319a5f None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:09.468694 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 542/1082] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:33:09 2022] GET /identity/v3/users/3e3a8d9b61a5496e8b4c4baf33aec7ef => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:33:09.474523 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6b43a-b957-4f06-ada9-4aea8002881e None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:09.572838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6b43a-b957-4f06-ada9-4aea8002881e None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:09.595462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:09.606343 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee3567-97e5-486f-8d55-0d0cb456eadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:09.606971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee3567-97e5-486f-8d55-0d0cb456eadb None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:09.607244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee3567-97e5-486f-8d55-0d0cb456eadb None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:09.607514 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee3567-97e5-486f-8d55-0d0cb456eadb None admin] PATH_INFO: `/v3/projects/2ef2759ff4054381b71914bd8d47916e` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:09.608880 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee3567-97e5-486f-8d55-0d0cb456eadb None admin] RBAC: Authorizing `identity:get_project(project_id=2ef2759ff4054381b71914bd8d47916e)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:09.610318 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee3567-97e5-486f-8d55-0d0cb456eadb None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:09.612117 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 541/1083] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:33:09 2022] GET /identity/v3/projects/2ef2759ff4054381b71914bd8d47916e => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:09.618055 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3ca2c-0b68-4aa4-a72e-8af316319a5f None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:09.646767 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:09.719007 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3ca2c-0b68-4aa4-a72e-8af316319a5f None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:09.745703 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8cd621-1d45-41a1-a12c-5a5ce733b6a9 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:09.746205 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8cd621-1d45-41a1-a12c-5a5ce733b6a9 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:09.746280 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8cd621-1d45-41a1-a12c-5a5ce733b6a9 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:09.747581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 542/1084] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:33:09.752548 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c679f-e541-4193-9179-2dbb9e18d419 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:09.752834 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c679f-e541-4193-9179-2dbb9e18d419 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:09.753111 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c679f-e541-4193-9179-2dbb9e18d419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:09.754107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e0682-c59e-4633-bbd2-76c562bba04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:09.754766 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e0682-c59e-4633-bbd2-76c562bba04c None admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:09.755048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e0682-c59e-4633-bbd2-76c562bba04c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:09.755348 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e0682-c59e-4633-bbd2-76c562bba04c None admin] PATH_INFO: `/v3/projects/2ef2759ff4054381b71914bd8d47916e/users/3e3a8d9b61a5496e8b4c4baf33aec7ef/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:09.757243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e0682-c59e-4633-bbd2-76c562bba04c None admin] RBAC: Authorizing `identity:create_grant(project_id=2ef2759ff4054381b71914bd8d47916e, user_id=3e3a8d9b61a5496e8b4c4baf33aec7ef, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:09.758699 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e0682-c59e-4633-bbd2-76c562bba04c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:09.771304 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-f79c679f-e541-4193-9179-2dbb9e18d419 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:09.772291 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 543/1085] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:33:09 2022] PUT /identity/v3/projects/2ef2759ff4054381b71914bd8d47916e/users/3e3a8d9b61a5496e8b4c4baf33aec7ef/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:33:09.772571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f79c679f-e541-4193-9179-2dbb9e18d419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:09.847004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 543/1086] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:33:10.119656 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e0682-c59e-4633-bbd2-76c562bba04c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:10.211290 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:10.226188 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e0682-c59e-4633-bbd2-76c562bba04c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:10.264245 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a645b09-2bba-4b0a-b646-ba2272aeb2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:10.264870 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a645b09-2bba-4b0a-b646-ba2272aeb2a7 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:10.265150 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a645b09-2bba-4b0a-b646-ba2272aeb2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:10.265423 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a645b09-2bba-4b0a-b646-ba2272aeb2a7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:10.275503 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a645b09-2bba-4b0a-b646-ba2272aeb2a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:33:10.280163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-4a645b09-2bba-4b0a-b646-ba2272aeb2a7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:33:10.280163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:10.280163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:10.280163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:10.280163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:10.280163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:10.280163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:10.280163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:10.280163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:10.280163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:10.280163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:10.280163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:10.280163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:33:10.280163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:33:10.280163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:33:10.280163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:33:10.281080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:33:10.281080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:33:10.281080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:33:10.281080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:33:10.281080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:10.281080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:10.281080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:10.281080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:10.281080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:10.281080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:10.281080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:10.281080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:10.281080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:10.281080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:10.281080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:10.281080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:10.282927 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:10.282927 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:10.282927 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:10.282927 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:10.282927 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:33:10.282927 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:33:10.282927 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:33:10.282927 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:33:10.282927 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:33:10.282927 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:33:10.282927 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 09:33:10.282927 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:33:10.282927 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 544/1087] 10.222.0.58 () {56 vars in 1120 bytes} [Wed Aug 24 09:33:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:33:10.289642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c679f-e541-4193-9179-2dbb9e18d419 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:10.387275 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c679f-e541-4193-9179-2dbb9e18d419 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:10.409925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:10.421798 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bed3ae-5d00-43c4-8498-6c28357d51ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:10.422402 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bed3ae-5d00-43c4-8498-6c28357d51ee None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:10.422680 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bed3ae-5d00-43c4-8498-6c28357d51ee None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:10.423531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bed3ae-5d00-43c4-8498-6c28357d51ee None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:10.424132 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bed3ae-5d00-43c4-8498-6c28357d51ee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:10.424431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bed3ae-5d00-43c4-8498-6c28357d51ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:10.425798 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bed3ae-5d00-43c4-8498-6c28357d51ee None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:10.433542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 544/1088] 10.222.0.58 () {56 vars in 1115 bytes} [Wed Aug 24 09:33:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:10.440153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a645b09-2bba-4b0a-b646-ba2272aeb2a7 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:10.538865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a645b09-2bba-4b0a-b646-ba2272aeb2a7 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:10.572523 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ba653-c587-4544-9a9b-f2004322c34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:10.573131 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ba653-c587-4544-9a9b-f2004322c34c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:10.573405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ba653-c587-4544-9a9b-f2004322c34c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:10.573699 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ba653-c587-4544-9a9b-f2004322c34c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:10.583745 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ba653-c587-4544-9a9b-f2004322c34c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:10.585158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ba653-c587-4544-9a9b-f2004322c34c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:10.593516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:10.600499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-c28ba653-c587-4544-9a9b-f2004322c34c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:33:10.600499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:10.600499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:10.600499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:10.600499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:10.600499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:10.600499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:10.600499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:10.600499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:10.600499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:10.600499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:10.600499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:10.600499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:33:10.600499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:33:10.600499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:33:10.600499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:33:10.601435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:10.601435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:10.601435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:10.601435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:10.601435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:10.601435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:10.601435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:10.601435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:10.601435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:10.601435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:10.601435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:10.601435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:10.601435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:10.601435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:10.601435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:10.601435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:10.601435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:33:10.602351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:33:10.602351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:33:10.602351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:33:10.602351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 545/1089] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:33:10.607787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bed3ae-5d00-43c4-8498-6c28357d51ee None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:10.706332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bed3ae-5d00-43c4-8498-6c28357d51ee None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:10.739677 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88d64f-1ebe-44e0-85a4-d1e435d4016a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:10.740189 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88d64f-1ebe-44e0-85a4-d1e435d4016a None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:10.740456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88d64f-1ebe-44e0-85a4-d1e435d4016a None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:10.740730 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88d64f-1ebe-44e0-85a4-d1e435d4016a None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:10.741363 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88d64f-1ebe-44e0-85a4-d1e435d4016a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:10.741715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88d64f-1ebe-44e0-85a4-d1e435d4016a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:10.743036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88d64f-1ebe-44e0-85a4-d1e435d4016a None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:10.755130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 545/1090] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:10.760635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ba653-c587-4544-9a9b-f2004322c34c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:10.866583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ba653-c587-4544-9a9b-f2004322c34c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:10.898711 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7046c-d4da-4b99-a946-84d5398b1ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:10.899344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7046c-d4da-4b99-a946-84d5398b1ab3 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:10.899621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7046c-d4da-4b99-a946-84d5398b1ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:10.899890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7046c-d4da-4b99-a946-84d5398b1ab3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:10.910939 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7046c-d4da-4b99-a946-84d5398b1ab3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:10.911897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7046c-d4da-4b99-a946-84d5398b1ab3 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:10.923660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-dec7046c-d4da-4b99-a946-84d5398b1ab3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:33:10.923660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:10.923660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:10.923660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:10.923660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:10.923660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:10.923660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:10.923660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:10.923660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:10.923660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:10.923660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:10.923660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:10.923660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:33:10.923660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:33:10.923660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:33:10.923660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:33:10.924691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:10.924691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:10.924691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:33:10.924691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:33:10.924691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:33:10.924691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:33:10.924691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:10.924691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:10.924691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:10.924691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:10.924691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:10.924691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:10.924691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:10.924691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:10.924691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:10.924691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:10.924691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:10.924691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:10.925760 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:10.925760 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:10.925760 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:33:10.925760 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:33:10.925760 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:33:10.925760 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:33:10.925760 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:33:10.925760 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:33:10.925760 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 09:33:10.925760 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:33:10.925760 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 546/1091] 10.222.0.58 () {56 vars in 1093 bytes} [Wed Aug 24 09:33:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:33:10.930536 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88d64f-1ebe-44e0-85a4-d1e435d4016a None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:10.975948 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:11.029981 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88d64f-1ebe-44e0-85a4-d1e435d4016a None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:11.064176 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b17d69-2d02-4848-b708-5143a7b1f753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:11.064913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b17d69-2d02-4848-b708-5143a7b1f753 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:11.065194 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b17d69-2d02-4848-b708-5143a7b1f753 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:11.065487 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b17d69-2d02-4848-b708-5143a7b1f753 None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:11.066207 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b17d69-2d02-4848-b708-5143a7b1f753 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:11.066510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b17d69-2d02-4848-b708-5143a7b1f753 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:11.067913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b17d69-2d02-4848-b708-5143a7b1f753 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:11.085684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 546/1092] 10.222.0.58 () {56 vars in 1133 bytes} [Wed Aug 24 09:33:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:11.091326 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7046c-d4da-4b99-a946-84d5398b1ab3 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:11.150604 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:11.195732 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7046c-d4da-4b99-a946-84d5398b1ab3 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:11.232224 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f3938-f6ef-4ed6-937c-4e9c6ea5f48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:11.232836 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f3938-f6ef-4ed6-937c-4e9c6ea5f48f None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:11.233391 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f3938-f6ef-4ed6-937c-4e9c6ea5f48f None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:11.233700 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f3938-f6ef-4ed6-937c-4e9c6ea5f48f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:11.300988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f3938-f6ef-4ed6-937c-4e9c6ea5f48f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:11.302474 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f3938-f6ef-4ed6-937c-4e9c6ea5f48f None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:11.359653 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:11.401542 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 547/1093] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:33:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:33:11.407262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b17d69-2d02-4848-b708-5143a7b1f753 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:11.507794 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b17d69-2d02-4848-b708-5143a7b1f753 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:11.509227 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:11.543664 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bfd30-971f-441d-864b-31e47a597600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:11.544286 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bfd30-971f-441d-864b-31e47a597600 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:11.544561 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bfd30-971f-441d-864b-31e47a597600 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:11.544832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bfd30-971f-441d-864b-31e47a597600 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:11.554795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bfd30-971f-441d-864b-31e47a597600 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:11.556210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bfd30-971f-441d-864b-31e47a597600 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:11.570838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-f60bfd30-971f-441d-864b-31e47a597600 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:33:11.570838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:11.570838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:11.570838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:11.570838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:11.570838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:11.570838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:11.570838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:11.570838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:11.570838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:11.570838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:11.570838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:11.570838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:33:11.570838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:33:11.570838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:33:11.570838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:33:11.572010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:11.572010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:11.572010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:11.572010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:11.572010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:11.572010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:11.572010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:11.572010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:11.572010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:11.572010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:11.572010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:11.572010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:11.572010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:11.572010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:11.572010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:11.572010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:11.572010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:33:11.572901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:33:11.572901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:33:11.572901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:33:11.572901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 547/1094] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:33:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:33:11.577692 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f3938-f6ef-4ed6-937c-4e9c6ea5f48f None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:11.674804 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f3938-f6ef-4ed6-937c-4e9c6ea5f48f None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:11.676255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c9d17-1cf2-498b-b749-b088bb2077d1 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:11.676540 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c9d17-1cf2-498b-b749-b088bb2077d1 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:11.676820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c9d17-1cf2-498b-b749-b088bb2077d1 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:11.678202 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 548/1095] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:33:11.683141 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8ad2a-6b04-43fa-94d0-55d7699e10f4 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:11.683424 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8ad2a-6b04-43fa-94d0-55d7699e10f4 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:11.683699 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8ad2a-6b04-43fa-94d0-55d7699e10f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:11.701680 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-51c8ad2a-6b04-43fa-94d0-55d7699e10f4 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:11.702984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-51c8ad2a-6b04-43fa-94d0-55d7699e10f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:11.708214 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a15866-19c0-483c-98e1-1ed125271efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:11.708807 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a15866-19c0-483c-98e1-1ed125271efa None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:11.709085 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a15866-19c0-483c-98e1-1ed125271efa None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:11.709351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a15866-19c0-483c-98e1-1ed125271efa None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:11.710014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a15866-19c0-483c-98e1-1ed125271efa None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:11.710316 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a15866-19c0-483c-98e1-1ed125271efa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:11.711639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a15866-19c0-483c-98e1-1ed125271efa None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:11.723784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 548/1096] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:11.729095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a15866-19c0-483c-98e1-1ed125271efa None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:11.752596 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:11.772052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 549/1097] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:33:11.830487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a15866-19c0-483c-98e1-1ed125271efa None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:11.870108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432fcf2-13ab-4cca-8028-96bc38b669ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:11.870734 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432fcf2-13ab-4cca-8028-96bc38b669ba None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:11.871019 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432fcf2-13ab-4cca-8028-96bc38b669ba None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:11.871292 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432fcf2-13ab-4cca-8028-96bc38b669ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:11.877918 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432fcf2-13ab-4cca-8028-96bc38b669ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:11.879348 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432fcf2-13ab-4cca-8028-96bc38b669ba None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:11.890257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-e432fcf2-13ab-4cca-8028-96bc38b669ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:33:11.890257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:11.890257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:11.890257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:11.890257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:11.890257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:11.890257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:11.890257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:11.890257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:11.890257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:11.890257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:11.890257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:11.890257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:33:11.890257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:33:11.890257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:33:11.891272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:33:11.891272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:11.891272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:11.891272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:11.891272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:11.891272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:11.891272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:11.891272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:11.891272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:11.891272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:11.891272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:11.891272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:11.891272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:11.891272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:11.891272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:11.891272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:11.891272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:11.892959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:33:11.892959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:33:11.892959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:33:11.892959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:33:11.892959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:33:11.892959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:33:11.892959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:33:11.892959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:33:11.892959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 549/1098] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:33:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:33:11.897759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8ad2a-6b04-43fa-94d0-55d7699e10f4 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:11.979768 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:11.996117 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8ad2a-6b04-43fa-94d0-55d7699e10f4 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:12.031014 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf26e7-330a-4067-90a6-956ba47be59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:12.031548 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf26e7-330a-4067-90a6-956ba47be59a None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:12.031827 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf26e7-330a-4067-90a6-956ba47be59a None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:12.032101 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf26e7-330a-4067-90a6-956ba47be59a None admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:12.033957 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf26e7-330a-4067-90a6-956ba47be59a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:12.034263 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf26e7-330a-4067-90a6-956ba47be59a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:12.035718 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf26e7-330a-4067-90a6-956ba47be59a None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:12.047396 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 550/1099] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:33:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:12.048255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432fcf2-13ab-4cca-8028-96bc38b669ba None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:12.053046 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf26e7-330a-4067-90a6-956ba47be59a None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:12.129341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:12.151301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432fcf2-13ab-4cca-8028-96bc38b669ba None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:12.155372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf26e7-330a-4067-90a6-956ba47be59a None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:12.185115 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41347ebd-e02d-4f35-94c5-3516f50cbce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:12.185784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41347ebd-e02d-4f35-94c5-3516f50cbce7 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:12.186066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41347ebd-e02d-4f35-94c5-3516f50cbce7 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:12.186343 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41347ebd-e02d-4f35-94c5-3516f50cbce7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:12.188858 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253de2c-2d0d-4c67-8b74-18549bc53dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:12.189501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253de2c-2d0d-4c67-8b74-18549bc53dbe None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:12.189785 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253de2c-2d0d-4c67-8b74-18549bc53dbe None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:12.190055 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253de2c-2d0d-4c67-8b74-18549bc53dbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:12.190770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253de2c-2d0d-4c67-8b74-18549bc53dbe None admin] RBAC: Adding query filter params (role.id=82c00b0c6f4942a1b7b2c5b01d4846f3, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=18be8c54c9644c5e9812eea09e60c11c) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:12.191073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253de2c-2d0d-4c67-8b74-18549bc53dbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:12.192494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253de2c-2d0d-4c67-8b74-18549bc53dbe None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:12.197383 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41347ebd-e02d-4f35-94c5-3516f50cbce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:33:12.198132 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 551/1100] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:33:12 2022] GET /identity/v3/role_assignments?user.id=18be8c54c9644c5e9812eea09e60c11c&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=82c00b0c6f4942a1b7b2c5b01d4846f3 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:33:12.202099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-41347ebd-e02d-4f35-94c5-3516f50cbce7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:33:12.202099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:12.202099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:12.202099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:12.202099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:12.202099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:12.202099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:12.202099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:12.202099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:12.202099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:12.202099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:12.202099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:12.202099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:33:12.202099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:33:12.202099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:33:12.202099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:33:12.203243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:33:12.203243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:33:12.203243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:33:12.203243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:33:12.203243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:12.203243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:12.203243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:12.203243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:12.203243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:12.203243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:12.203243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:12.203243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:12.203243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:12.203243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:12.203243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:12.203243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:12.204792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:12.204792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:12.204792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:12.204792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:12.204792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:33:12.204792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:33:12.204792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:33:12.204792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:33:12.204792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:33:12.204792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:33:12.204792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:33:12.204792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:33:12.204792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 550/1101] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:33:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:33:12.210311 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253de2c-2d0d-4c67-8b74-18549bc53dbe None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:12.227107 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:12.319282 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253de2c-2d0d-4c67-8b74-18549bc53dbe None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:12.354073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18602107-9617-496b-92b6-9fb5b9185c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:12.354677 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18602107-9617-496b-92b6-9fb5b9185c0d None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:12.354952 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18602107-9617-496b-92b6-9fb5b9185c0d None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:12.355222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18602107-9617-496b-92b6-9fb5b9185c0d None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:12.355877 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18602107-9617-496b-92b6-9fb5b9185c0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:12.356175 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18602107-9617-496b-92b6-9fb5b9185c0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:12.358591 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18602107-9617-496b-92b6-9fb5b9185c0d None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:12.366749 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 552/1102] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:33:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:12.372811 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41347ebd-e02d-4f35-94c5-3516f50cbce7 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:12.477710 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41347ebd-e02d-4f35-94c5-3516f50cbce7 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:12.512160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1951be9-8147-46ed-b27a-ea8ba3ef3238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:12.512781 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1951be9-8147-46ed-b27a-ea8ba3ef3238 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:12.513059 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1951be9-8147-46ed-b27a-ea8ba3ef3238 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:12.513331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1951be9-8147-46ed-b27a-ea8ba3ef3238 None admin] PATH_INFO: `/v3/users/3e3a8d9b61a5496e8b4c4baf33aec7ef` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:12.514495 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1951be9-8147-46ed-b27a-ea8ba3ef3238 None admin] RBAC: Authorizing `identity:get_user(user_id=3e3a8d9b61a5496e8b4c4baf33aec7ef)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:12.515917 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1951be9-8147-46ed-b27a-ea8ba3ef3238 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:12.518067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 551/1103] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:33:12 2022] GET /identity/v3/users/3e3a8d9b61a5496e8b4c4baf33aec7ef => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:12.524041 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18602107-9617-496b-92b6-9fb5b9185c0d None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:12.598410 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:12.630362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18602107-9617-496b-92b6-9fb5b9185c0d None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:12.665850 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f36b6-732c-4784-898d-44a291cb3a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:12.666464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f36b6-732c-4784-898d-44a291cb3a7d None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:12.666742 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f36b6-732c-4784-898d-44a291cb3a7d None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:12.667020 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f36b6-732c-4784-898d-44a291cb3a7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:12.736978 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f36b6-732c-4784-898d-44a291cb3a7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:12.738454 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f36b6-732c-4784-898d-44a291cb3a7d None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:12.808316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:12.843757 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 553/1104] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:33:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:33:12.850711 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1951be9-8147-46ed-b27a-ea8ba3ef3238 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:12.864994 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:12.960053 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1951be9-8147-46ed-b27a-ea8ba3ef3238 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:12.994575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a641988-68a5-4ac6-89db-2fdf1d228d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:12.995261 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a641988-68a5-4ac6-89db-2fdf1d228d6d None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:12.995547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a641988-68a5-4ac6-89db-2fdf1d228d6d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:12.995822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a641988-68a5-4ac6-89db-2fdf1d228d6d None admin] PATH_INFO: `/v3/projects/2ef2759ff4054381b71914bd8d47916e` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:12.996951 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a641988-68a5-4ac6-89db-2fdf1d228d6d None admin] RBAC: Authorizing `identity:get_project(project_id=2ef2759ff4054381b71914bd8d47916e)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:12.998559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a641988-68a5-4ac6-89db-2fdf1d228d6d None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:13.000268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 552/1105] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:33:12 2022] GET /identity/v3/projects/2ef2759ff4054381b71914bd8d47916e => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:13.006901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f36b6-732c-4784-898d-44a291cb3a7d None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:13.106749 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f36b6-732c-4784-898d-44a291cb3a7d None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:13.139742 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147d4da-9d47-4775-a065-048c40912586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:13.140334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147d4da-9d47-4775-a065-048c40912586 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:13.140611 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147d4da-9d47-4775-a065-048c40912586 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:13.140884 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147d4da-9d47-4775-a065-048c40912586 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:13.142359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147d4da-9d47-4775-a065-048c40912586 None admin] RBAC: Adding query filter params (role.id=cd2effe8340d4be08a28d3a40db6979d, scope.project.id=2ef2759ff4054381b71914bd8d47916e, user.id=3e3a8d9b61a5496e8b4c4baf33aec7ef) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:13.142739 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147d4da-9d47-4775-a065-048c40912586 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:13.144151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147d4da-9d47-4775-a065-048c40912586 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:13.149755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 554/1106] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:33:13 2022] GET /identity/v3/role_assignments?user.id=3e3a8d9b61a5496e8b4c4baf33aec7ef&scope.project.id=2ef2759ff4054381b71914bd8d47916e&role.id=cd2effe8340d4be08a28d3a40db6979d => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:33:15.089458 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bceb4-95f4-492b-9311-885a341ebf0a None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:15.090045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bceb4-95f4-492b-9311-885a341ebf0a None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:15.090045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bceb4-95f4-492b-9311-885a341ebf0a None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:15.091332 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 553/1107] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:33:15.097211 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d30b2-3541-4106-8f8a-c2a236cd32e7 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:15.097656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d30b2-3541-4106-8f8a-c2a236cd32e7 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:15.097793 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d30b2-3541-4106-8f8a-c2a236cd32e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:15.115841 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-910d30b2-3541-4106-8f8a-c2a236cd32e7 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:15.117034 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-910d30b2-3541-4106-8f8a-c2a236cd32e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:15.143916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:15.184513 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 555/1108] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:33:15.455572 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bceb4-95f4-492b-9311-885a341ebf0a None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:15.532644 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:15.556493 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bceb4-95f4-492b-9311-885a341ebf0a None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:15.589575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567da48-4f6c-4d32-9079-187fdeaae9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:15.590189 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567da48-4f6c-4d32-9079-187fdeaae9de None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:15.590471 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567da48-4f6c-4d32-9079-187fdeaae9de None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:15.590744 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567da48-4f6c-4d32-9079-187fdeaae9de None admin] PATH_INFO: `/v3/domains/default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:15.591851 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567da48-4f6c-4d32-9079-187fdeaae9de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:15.593269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567da48-4f6c-4d32-9079-187fdeaae9de None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:15.594931 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 554/1109] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:33:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:15.600596 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d30b2-3541-4106-8f8a-c2a236cd32e7 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:15.697278 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d30b2-3541-4106-8f8a-c2a236cd32e7 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:15.729856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38faea9-165f-4b86-bbe9-5ed33836e9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:15.730388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38faea9-165f-4b86-bbe9-5ed33836e9ea None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:15.730666 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38faea9-165f-4b86-bbe9-5ed33836e9ea None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:15.730939 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38faea9-165f-4b86-bbe9-5ed33836e9ea None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:15.731570 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38faea9-165f-4b86-bbe9-5ed33836e9ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:15.732982 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38faea9-165f-4b86-bbe9-5ed33836e9ea None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:15.755648 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 556/1110] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 09:33:15 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:33:17.710753 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea8fc2-a886-4810-8867-a8ba1cfdb796 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:17.711307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea8fc2-a886-4810-8867-a8ba1cfdb796 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:17.711307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea8fc2-a886-4810-8867-a8ba1cfdb796 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:17.712633 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 555/1111] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:33:17.717779 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577ccb1-1e4e-4a77-8456-bdb6f0ed167b None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:17.718156 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577ccb1-1e4e-4a77-8456-bdb6f0ed167b None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:17.718338 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577ccb1-1e4e-4a77-8456-bdb6f0ed167b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:17.736490 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-0577ccb1-1e4e-4a77-8456-bdb6f0ed167b None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:17.737715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-0577ccb1-1e4e-4a77-8456-bdb6f0ed167b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:17.752389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:17.805718 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 557/1112] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:33:18.086675 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea8fc2-a886-4810-8867-a8ba1cfdb796 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:18.186331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea8fc2-a886-4810-8867-a8ba1cfdb796 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:18.222991 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bec02-f8e4-4f76-8e5c-b3e7e5228aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:18.223615 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bec02-f8e4-4f76-8e5c-b3e7e5228aa5 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:18.223894 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bec02-f8e4-4f76-8e5c-b3e7e5228aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:18.224166 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bec02-f8e4-4f76-8e5c-b3e7e5228aa5 None admin] PATH_INFO: `/v3/roles/6c6a208f837c453cb9aceca635451134` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:18.225596 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6bec02-f8e4-4f76-8e5c-b3e7e5228aa5 None admin] RBAC: Authorizing `identity:get_role(role_id=6c6a208f837c453cb9aceca635451134)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:18.227006 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6bec02-f8e4-4f76-8e5c-b3e7e5228aa5 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:18.228272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 556/1113] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:33:18 2022] GET /identity/v3/roles/6c6a208f837c453cb9aceca635451134 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:18.234265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577ccb1-1e4e-4a77-8456-bdb6f0ed167b None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:18.328279 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577ccb1-1e4e-4a77-8456-bdb6f0ed167b None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:18.361231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d85e2b-cb3e-4ed8-b639-617d458cc204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:18.361814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d85e2b-cb3e-4ed8-b639-617d458cc204 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:18.362088 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d85e2b-cb3e-4ed8-b639-617d458cc204 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:18.362354 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d85e2b-cb3e-4ed8-b639-617d458cc204 None admin] PATH_INFO: `/v3/users/28307c28ae7246b19f71c0b7bdfbd28f` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:18.374934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d85e2b-cb3e-4ed8-b639-617d458cc204 None admin] RBAC: Authorizing `identity:get_user(user_id=28307c28ae7246b19f71c0b7bdfbd28f)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:18.376879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d85e2b-cb3e-4ed8-b639-617d458cc204 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:18.378475 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 558/1114] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:33:18 2022] GET /identity/v3/users/28307c28ae7246b19f71c0b7bdfbd28f => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:18.384281 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bec02-f8e4-4f76-8e5c-b3e7e5228aa5 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:18.400132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:18.489693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bec02-f8e4-4f76-8e5c-b3e7e5228aa5 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:18.522075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeddfed-bebf-44b3-af66-1042cf00f912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:18.522670 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeddfed-bebf-44b3-af66-1042cf00f912 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:18.522950 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeddfed-bebf-44b3-af66-1042cf00f912 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:18.523223 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeddfed-bebf-44b3-af66-1042cf00f912 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:18.589689 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeddfed-bebf-44b3-af66-1042cf00f912 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:18.591126 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeddfed-bebf-44b3-af66-1042cf00f912 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:18.604031 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:18.687718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 557/1115] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:33:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:33:18.694186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d85e2b-cb3e-4ed8-b639-617d458cc204 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:18.704691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:18.791131 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d85e2b-cb3e-4ed8-b639-617d458cc204 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:18.825095 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5c6cb-6fe5-497a-9360-dd1d986ec50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:18.825748 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5c6cb-6fe5-497a-9360-dd1d986ec50f None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:18.826029 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5c6cb-6fe5-497a-9360-dd1d986ec50f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:18.826304 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5c6cb-6fe5-497a-9360-dd1d986ec50f None admin] PATH_INFO: `/v3/projects/2ef2759ff4054381b71914bd8d47916e` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:18.827418 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5c6cb-6fe5-497a-9360-dd1d986ec50f None admin] RBAC: Authorizing `identity:get_project(project_id=2ef2759ff4054381b71914bd8d47916e)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:18.828830 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5c6cb-6fe5-497a-9360-dd1d986ec50f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:18.830510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 559/1116] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:33:18 2022] GET /identity/v3/projects/2ef2759ff4054381b71914bd8d47916e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:18.836631 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeddfed-bebf-44b3-af66-1042cf00f912 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:18.936487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeddfed-bebf-44b3-af66-1042cf00f912 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:18.950099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:18.971958 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317753fc-d36f-48aa-b705-cfe31ae47c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:18.972544 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317753fc-d36f-48aa-b705-cfe31ae47c50 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:18.972824 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317753fc-d36f-48aa-b705-cfe31ae47c50 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:18.973098 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317753fc-d36f-48aa-b705-cfe31ae47c50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:18.973842 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317753fc-d36f-48aa-b705-cfe31ae47c50 None admin] RBAC: Adding query filter params (role.id=6c6a208f837c453cb9aceca635451134, scope.project.id=2ef2759ff4054381b71914bd8d47916e, user.id=28307c28ae7246b19f71c0b7bdfbd28f) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:18.974152 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317753fc-d36f-48aa-b705-cfe31ae47c50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:18.975567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317753fc-d36f-48aa-b705-cfe31ae47c50 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:18.980766 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 558/1117] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:33:18 2022] GET /identity/v3/role_assignments?user.id=28307c28ae7246b19f71c0b7bdfbd28f&scope.project.id=2ef2759ff4054381b71914bd8d47916e&role.id=6c6a208f837c453cb9aceca635451134 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:20.904302 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04316c-9ce9-4aef-bf39-b6c086fb6f50 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:20.904866 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04316c-9ce9-4aef-bf39-b6c086fb6f50 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:20.904866 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04316c-9ce9-4aef-bf39-b6c086fb6f50 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:20.906210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 560/1118] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:33:20.911372 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719340a4-db47-43b2-ac67-41fd8f398930 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:20.911797 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719340a4-db47-43b2-ac67-41fd8f398930 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:20.911909 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719340a4-db47-43b2-ac67-41fd8f398930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:20.930201 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-719340a4-db47-43b2-ac67-41fd8f398930 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:20.931333 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-719340a4-db47-43b2-ac67-41fd8f398930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:21.003195 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 559/1119] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:33:21.285290 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04316c-9ce9-4aef-bf39-b6c086fb6f50 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:21.361487 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:21.384228 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04316c-9ce9-4aef-bf39-b6c086fb6f50 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:21.417809 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee9b19-48ba-4f78-aae1-3c1d7cd7b133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:21.418420 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee9b19-48ba-4f78-aae1-3c1d7cd7b133 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:21.418692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee9b19-48ba-4f78-aae1-3c1d7cd7b133 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:21.418959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee9b19-48ba-4f78-aae1-3c1d7cd7b133 None admin] PATH_INFO: `/v3/roles/6c6a208f837c453cb9aceca635451134` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:21.420328 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee9b19-48ba-4f78-aae1-3c1d7cd7b133 None admin] RBAC: Authorizing `identity:get_role(role_id=6c6a208f837c453cb9aceca635451134)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:21.421699 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee9b19-48ba-4f78-aae1-3c1d7cd7b133 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:21.423634 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 561/1120] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:33:21 2022] GET /identity/v3/roles/6c6a208f837c453cb9aceca635451134 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:21.429457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719340a4-db47-43b2-ac67-41fd8f398930 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:21.524542 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719340a4-db47-43b2-ac67-41fd8f398930 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:21.531462 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:21.558908 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1848306-031e-4c74-8627-fa35306b17fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:21.559528 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1848306-031e-4c74-8627-fa35306b17fd None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:21.559807 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1848306-031e-4c74-8627-fa35306b17fd None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:21.560081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1848306-031e-4c74-8627-fa35306b17fd None admin] PATH_INFO: `/v3/users/28307c28ae7246b19f71c0b7bdfbd28f` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:21.561195 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1848306-031e-4c74-8627-fa35306b17fd None admin] RBAC: Authorizing `identity:get_user(user_id=28307c28ae7246b19f71c0b7bdfbd28f)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:21.562648 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1848306-031e-4c74-8627-fa35306b17fd None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:21.564413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 560/1121] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:33:21 2022] GET /identity/v3/users/28307c28ae7246b19f71c0b7bdfbd28f => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:21.570344 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee9b19-48ba-4f78-aae1-3c1d7cd7b133 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:21.669110 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee9b19-48ba-4f78-aae1-3c1d7cd7b133 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:21.701406 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd285f-6fde-476b-ab86-efa6d2841187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:21.702047 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd285f-6fde-476b-ab86-efa6d2841187 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:21.702322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd285f-6fde-476b-ab86-efa6d2841187 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:21.702592 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd285f-6fde-476b-ab86-efa6d2841187 None admin] PATH_INFO: `/v3/projects/2ef2759ff4054381b71914bd8d47916e` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:21.703685 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd285f-6fde-476b-ab86-efa6d2841187 None admin] RBAC: Authorizing `identity:get_project(project_id=2ef2759ff4054381b71914bd8d47916e)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:21.705645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd285f-6fde-476b-ab86-efa6d2841187 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:21.707249 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 562/1122] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:33:21 2022] GET /identity/v3/projects/2ef2759ff4054381b71914bd8d47916e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:21.713247 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1848306-031e-4c74-8627-fa35306b17fd None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:21.810563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1848306-031e-4c74-8627-fa35306b17fd None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:21.842872 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbae4a6-d792-4b22-8a84-1006e6d8e0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:21.843511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbae4a6-d792-4b22-8a84-1006e6d8e0e2 None admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:21.843787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbae4a6-d792-4b22-8a84-1006e6d8e0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:21.844058 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbae4a6-d792-4b22-8a84-1006e6d8e0e2 None admin] PATH_INFO: `/v3/projects/2ef2759ff4054381b71914bd8d47916e/users/28307c28ae7246b19f71c0b7bdfbd28f/roles/6c6a208f837c453cb9aceca635451134` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:21.846825 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbae4a6-d792-4b22-8a84-1006e6d8e0e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ef2759ff4054381b71914bd8d47916e, user_id=28307c28ae7246b19f71c0b7bdfbd28f, role_id=6c6a208f837c453cb9aceca635451134)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:21.848232 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbae4a6-d792-4b22-8a84-1006e6d8e0e2 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:21.861230 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 561/1123] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:33:21 2022] PUT /identity/v3/projects/2ef2759ff4054381b71914bd8d47916e/users/28307c28ae7246b19f71c0b7bdfbd28f/roles/6c6a208f837c453cb9aceca635451134 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:33:23.787702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbf0b0-6dc2-4d75-90b6-7cc9dede05d3 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:23.787702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbf0b0-6dc2-4d75-90b6-7cc9dede05d3 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:23.787702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fbf0b0-6dc2-4d75-90b6-7cc9dede05d3 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:23.788952 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 563/1124] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:33:23.794164 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15907f-df5e-4cb7-ae0b-96893beccb95 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:23.794603 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15907f-df5e-4cb7-ae0b-96893beccb95 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:23.794765 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15907f-df5e-4cb7-ae0b-96893beccb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:23.814220 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-ae15907f-df5e-4cb7-ae0b-96893beccb95 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:23.815754 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ae15907f-df5e-4cb7-ae0b-96893beccb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:23.842942 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:23.888638 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 562/1125] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:33:24.165818 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbf0b0-6dc2-4d75-90b6-7cc9dede05d3 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:24.181270 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:24.267504 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fbf0b0-6dc2-4d75-90b6-7cc9dede05d3 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:24.301400 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5afed-5b03-47a7-a126-669646d20aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:24.302046 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5afed-5b03-47a7-a126-669646d20aa2 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:24.302324 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5afed-5b03-47a7-a126-669646d20aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:24.302595 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5afed-5b03-47a7-a126-669646d20aa2 None admin] PATH_INFO: `/v3/roles/6c6a208f837c453cb9aceca635451134` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:24.303978 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5afed-5b03-47a7-a126-669646d20aa2 None admin] RBAC: Authorizing `identity:get_role(role_id=6c6a208f837c453cb9aceca635451134)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:24.305324 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5afed-5b03-47a7-a126-669646d20aa2 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:24.306663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 564/1126] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:33:24 2022] GET /identity/v3/roles/6c6a208f837c453cb9aceca635451134 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:24.312893 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15907f-df5e-4cb7-ae0b-96893beccb95 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:24.410725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15907f-df5e-4cb7-ae0b-96893beccb95 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:24.445415 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c57695-8106-41b4-8f8a-cabef1b11d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:24.446057 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c57695-8106-41b4-8f8a-cabef1b11d6e None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:24.446332 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c57695-8106-41b4-8f8a-cabef1b11d6e None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:24.446601 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c57695-8106-41b4-8f8a-cabef1b11d6e None admin] PATH_INFO: `/v3/users/28307c28ae7246b19f71c0b7bdfbd28f` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:24.447718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c57695-8106-41b4-8f8a-cabef1b11d6e None admin] RBAC: Authorizing `identity:get_user(user_id=28307c28ae7246b19f71c0b7bdfbd28f)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:24.449124 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c57695-8106-41b4-8f8a-cabef1b11d6e None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:24.450724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 563/1127] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:33:24 2022] GET /identity/v3/users/28307c28ae7246b19f71c0b7bdfbd28f => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:24.457194 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5afed-5b03-47a7-a126-669646d20aa2 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:24.537188 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:24.556051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5afed-5b03-47a7-a126-669646d20aa2 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:24.589210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b66885-243b-41ea-812a-7eef7c3590f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:24.589824 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b66885-243b-41ea-812a-7eef7c3590f7 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:24.590103 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b66885-243b-41ea-812a-7eef7c3590f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:24.590376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b66885-243b-41ea-812a-7eef7c3590f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:24.655027 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b66885-243b-41ea-812a-7eef7c3590f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:24.656450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b66885-243b-41ea-812a-7eef7c3590f7 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:24.732969 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:24.754312 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 565/1128] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:33:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:33:24.760544 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c57695-8106-41b4-8f8a-cabef1b11d6e None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:24.792443 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:24.859822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c57695-8106-41b4-8f8a-cabef1b11d6e None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:24.894387 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408168d-9e80-4fdb-bb06-b9e46873949f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:24.895002 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408168d-9e80-4fdb-bb06-b9e46873949f None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:24.895276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408168d-9e80-4fdb-bb06-b9e46873949f None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:24.895545 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408168d-9e80-4fdb-bb06-b9e46873949f None admin] PATH_INFO: `/v3/projects/2ef2759ff4054381b71914bd8d47916e` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:24.896644 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408168d-9e80-4fdb-bb06-b9e46873949f None admin] RBAC: Authorizing `identity:get_project(project_id=2ef2759ff4054381b71914bd8d47916e)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:24.898090 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408168d-9e80-4fdb-bb06-b9e46873949f None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:24.899685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 564/1129] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:33:24 2022] GET /identity/v3/projects/2ef2759ff4054381b71914bd8d47916e => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:24.905868 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b66885-243b-41ea-812a-7eef7c3590f7 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:25.006231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b66885-243b-41ea-812a-7eef7c3590f7 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:25.039440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ca025-a2ca-4ba0-aff1-1a3c45e49a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:25.040034 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ca025-a2ca-4ba0-aff1-1a3c45e49a9f None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:25.040313 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ca025-a2ca-4ba0-aff1-1a3c45e49a9f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:25.040589 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ca025-a2ca-4ba0-aff1-1a3c45e49a9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:25.041308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ca025-a2ca-4ba0-aff1-1a3c45e49a9f None admin] RBAC: Adding query filter params (role.id=6c6a208f837c453cb9aceca635451134, scope.project.id=2ef2759ff4054381b71914bd8d47916e, user.id=28307c28ae7246b19f71c0b7bdfbd28f) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:25.041648 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ca025-a2ca-4ba0-aff1-1a3c45e49a9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:25.043073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ca025-a2ca-4ba0-aff1-1a3c45e49a9f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:25.049447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 566/1130] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:33:24 2022] GET /identity/v3/role_assignments?user.id=28307c28ae7246b19f71c0b7bdfbd28f&scope.project.id=2ef2759ff4054381b71914bd8d47916e&role.id=6c6a208f837c453cb9aceca635451134 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:26.968452 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac4ff7-a174-48d3-b580-ffb5778b78db None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:26.969013 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac4ff7-a174-48d3-b580-ffb5778b78db None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:26.969013 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac4ff7-a174-48d3-b580-ffb5778b78db None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:26.970382 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 565/1131] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:33:26.975662 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482ed68-ef9f-4006-96c9-fe23950e0158 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:26.976064 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482ed68-ef9f-4006-96c9-fe23950e0158 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:26.976223 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482ed68-ef9f-4006-96c9-fe23950e0158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:26.994798 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-7482ed68-ef9f-4006-96c9-fe23950e0158 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:26.995988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-7482ed68-ef9f-4006-96c9-fe23950e0158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:27.035267 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:27.061751 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 567/1132] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:33:27.334501 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac4ff7-a174-48d3-b580-ffb5778b78db None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:27.430042 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:27.434233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac4ff7-a174-48d3-b580-ffb5778b78db None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:27.467600 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d287422-235d-44db-bce7-9160b6f9a37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:27.468207 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d287422-235d-44db-bce7-9160b6f9a37c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:27.468481 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d287422-235d-44db-bce7-9160b6f9a37c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:27.468754 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d287422-235d-44db-bce7-9160b6f9a37c None admin] PATH_INFO: `/v3/domains/default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:27.469922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d287422-235d-44db-bce7-9160b6f9a37c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:27.471328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d287422-235d-44db-bce7-9160b6f9a37c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:27.472845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 566/1133] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:33:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:27.478801 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482ed68-ef9f-4006-96c9-fe23950e0158 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:27.575088 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482ed68-ef9f-4006-96c9-fe23950e0158 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:27.608415 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc03c0f-2502-49cf-887a-0425ced7405e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:27.609005 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc03c0f-2502-49cf-887a-0425ced7405e None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:27.609281 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc03c0f-2502-49cf-887a-0425ced7405e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:27.609574 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc03c0f-2502-49cf-887a-0425ced7405e None admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:27.610241 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc03c0f-2502-49cf-887a-0425ced7405e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:27.611647 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc03c0f-2502-49cf-887a-0425ced7405e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:27.637779 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 568/1134] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 09:33:27 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:33:29.581099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5209caa-8d88-4889-8782-1e120d36b773 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:29.581665 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5209caa-8d88-4889-8782-1e120d36b773 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:29.581665 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5209caa-8d88-4889-8782-1e120d36b773 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:29.582922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 567/1135] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:33:29.588243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8e08b-c3a3-4e1c-827c-ba818a6c9b09 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:29.588608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8e08b-c3a3-4e1c-827c-ba818a6c9b09 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:29.588795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8e08b-c3a3-4e1c-827c-ba818a6c9b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:29.607190 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-6ae8e08b-c3a3-4e1c-827c-ba818a6c9b09 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:29.608641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-6ae8e08b-c3a3-4e1c-827c-ba818a6c9b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:29.628667 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:29.675621 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 569/1136] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:33:29.960909 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5209caa-8d88-4889-8782-1e120d36b773 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:30.059214 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5209caa-8d88-4889-8782-1e120d36b773 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:30.092024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824142c-10b7-4c7a-9eac-4f326d6a043f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:30.092630 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824142c-10b7-4c7a-9eac-4f326d6a043f None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:30.092902 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824142c-10b7-4c7a-9eac-4f326d6a043f None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:30.093171 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824142c-10b7-4c7a-9eac-4f326d6a043f None admin] PATH_INFO: `/v3/domains/default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:30.094337 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824142c-10b7-4c7a-9eac-4f326d6a043f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:30.095812 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824142c-10b7-4c7a-9eac-4f326d6a043f None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:30.097319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 568/1137] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:33:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:30.103009 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8e08b-c3a3-4e1c-827c-ba818a6c9b09 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:30.204385 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8e08b-c3a3-4e1c-827c-ba818a6c9b09 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:30.237721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7320964-0193-470a-95c6-ab0e6f4bbb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:30.238322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7320964-0193-470a-95c6-ab0e6f4bbb1d None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:30.238600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7320964-0193-470a-95c6-ab0e6f4bbb1d None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:30.238870 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7320964-0193-470a-95c6-ab0e6f4bbb1d None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:30.239511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7320964-0193-470a-95c6-ab0e6f4bbb1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:30.240929 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7320964-0193-470a-95c6-ab0e6f4bbb1d None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:30.262630 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 570/1138] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 09:33:30 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:33:32.196997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d98f3-c17f-4e8a-ad72-8158faef21f1 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:32.197591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d98f3-c17f-4e8a-ad72-8158faef21f1 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:32.197591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d98f3-c17f-4e8a-ad72-8158faef21f1 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:32.198878 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 569/1139] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:33:32.204521 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe96ea4-11ae-409b-a94d-e5b9257ab6a4 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:32.204946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe96ea4-11ae-409b-a94d-e5b9257ab6a4 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:32.205061 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe96ea4-11ae-409b-a94d-e5b9257ab6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:32.224284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-8fe96ea4-11ae-409b-a94d-e5b9257ab6a4 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:32.225522 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-8fe96ea4-11ae-409b-a94d-e5b9257ab6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:32.233303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:32.292487 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 571/1140] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:33:32.562410 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d98f3-c17f-4e8a-ad72-8158faef21f1 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:32.598436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:32.664740 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d98f3-c17f-4e8a-ad72-8158faef21f1 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:32.698018 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce2ee3-3223-438a-bd67-eac2d4c18695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:32.698631 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce2ee3-3223-438a-bd67-eac2d4c18695 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:32.698908 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce2ee3-3223-438a-bd67-eac2d4c18695 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:32.699179 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce2ee3-3223-438a-bd67-eac2d4c18695 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:32.709542 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce2ee3-3223-438a-bd67-eac2d4c18695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:33:32.714169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-1bce2ee3-3223-438a-bd67-eac2d4c18695 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:33:32.714169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:32.714169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:32.714169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:32.714169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:32.714169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:32.714169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:32.714169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:32.714169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:32.714169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:32.714169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:32.714169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:32.714169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:33:32.714169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:33:32.714169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:33:32.714169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:33:32.715244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:33:32.715244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:33:32.715244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:33:32.715244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:33:32.715244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:32.715244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:32.715244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:32.715244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:32.715244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:32.715244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:32.715244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:32.715244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:32.715244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:32.715244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:32.715244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:32.715244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:32.716268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:32.716268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:32.716268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:32.716268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:32.716268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:33:32.716268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:33:32.716268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:33:32.716268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:33:32.716268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:33:32.716268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:33:32.716268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:33:32.716268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:33:32.716268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 570/1141] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:33:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:33:32.721322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe96ea4-11ae-409b-a94d-e5b9257ab6a4 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:32.818073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe96ea4-11ae-409b-a94d-e5b9257ab6a4 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:32.851012 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb096e6-fa08-4bfd-8c8a-ef3d8d7b12cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:32.851605 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb096e6-fa08-4bfd-8c8a-ef3d8d7b12cb None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:32.851887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb096e6-fa08-4bfd-8c8a-ef3d8d7b12cb None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:32.852163 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb096e6-fa08-4bfd-8c8a-ef3d8d7b12cb None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:32.852827 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb096e6-fa08-4bfd-8c8a-ef3d8d7b12cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:32.853132 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb096e6-fa08-4bfd-8c8a-ef3d8d7b12cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:32.854519 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb096e6-fa08-4bfd-8c8a-ef3d8d7b12cb None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:32.862688 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 572/1142] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:33:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:32.868445 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce2ee3-3223-438a-bd67-eac2d4c18695 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:32.962597 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:32.968749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce2ee3-3223-438a-bd67-eac2d4c18695 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:33.003995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ec979-16e5-4e08-9267-6007d41c3153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:33.004605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ec979-16e5-4e08-9267-6007d41c3153 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:33.004888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ec979-16e5-4e08-9267-6007d41c3153 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:33.005166 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ec979-16e5-4e08-9267-6007d41c3153 None admin] PATH_INFO: `/v3/users/7697d81b3cda48b6a8557d808c653bda` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:33.017904 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ec979-16e5-4e08-9267-6007d41c3153 None admin] RBAC: Authorizing `identity:get_user(user_id=7697d81b3cda48b6a8557d808c653bda)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:33.019333 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ec979-16e5-4e08-9267-6007d41c3153 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:33.020912 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 571/1143] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:33:32 2022] GET /identity/v3/users/7697d81b3cda48b6a8557d808c653bda => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:33.026834 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb096e6-fa08-4bfd-8c8a-ef3d8d7b12cb None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:33.030608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:33.124941 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb096e6-fa08-4bfd-8c8a-ef3d8d7b12cb None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:33.157912 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b983d-7e63-4f4f-b679-0c778716716e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:33.158509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b983d-7e63-4f4f-b679-0c778716716e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:33.158790 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b983d-7e63-4f4f-b679-0c778716716e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:33.159066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b983d-7e63-4f4f-b679-0c778716716e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:33.224015 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b983d-7e63-4f4f-b679-0c778716716e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:33.225481 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b983d-7e63-4f4f-b679-0c778716716e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:33.228172 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:33.323522 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 573/1144] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:33:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:33:33.329445 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ec979-16e5-4e08-9267-6007d41c3153 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:33.428132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ec979-16e5-4e08-9267-6007d41c3153 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:33.461406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e677308-1e94-4d98-b16c-504a295ad5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:33.462054 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e677308-1e94-4d98-b16c-504a295ad5e0 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:33.462336 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e677308-1e94-4d98-b16c-504a295ad5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:33.462611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e677308-1e94-4d98-b16c-504a295ad5e0 None admin] PATH_INFO: `/v3/projects/b51b8884ff3440f6bdf3aa90a781fc32` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:33.463727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e677308-1e94-4d98-b16c-504a295ad5e0 None admin] RBAC: Authorizing `identity:get_project(project_id=b51b8884ff3440f6bdf3aa90a781fc32)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:33.465146 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e677308-1e94-4d98-b16c-504a295ad5e0 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:33.466789 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 572/1145] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:33:33 2022] GET /identity/v3/projects/b51b8884ff3440f6bdf3aa90a781fc32 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:33.473760 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b983d-7e63-4f4f-b679-0c778716716e None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:33.570560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b983d-7e63-4f4f-b679-0c778716716e None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:33.572838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:33.603808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65e27f-dcca-42e6-986a-b45f13627242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:33.604402 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65e27f-dcca-42e6-986a-b45f13627242 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:33.604678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65e27f-dcca-42e6-986a-b45f13627242 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:33.604950 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65e27f-dcca-42e6-986a-b45f13627242 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:33.605709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65e27f-dcca-42e6-986a-b45f13627242 None admin] RBAC: Adding query filter params (role.id=cd2effe8340d4be08a28d3a40db6979d, scope.project.id=b51b8884ff3440f6bdf3aa90a781fc32, user.id=7697d81b3cda48b6a8557d808c653bda) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:33.606018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65e27f-dcca-42e6-986a-b45f13627242 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:33.607429 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65e27f-dcca-42e6-986a-b45f13627242 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:33.613754 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 574/1146] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:33:33 2022] GET /identity/v3/role_assignments?user.id=7697d81b3cda48b6a8557d808c653bda&scope.project.id=b51b8884ff3440f6bdf3aa90a781fc32&role.id=cd2effe8340d4be08a28d3a40db6979d => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:35.507349 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34346c4-95bb-4df6-ab68-6bf7e5a59fcb None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:35.507856 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34346c4-95bb-4df6-ab68-6bf7e5a59fcb None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:35.507856 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34346c4-95bb-4df6-ab68-6bf7e5a59fcb None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:35.509158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 573/1147] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:33:35.514395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003bcff-0369-4f01-a8c7-9010a9f4c43f None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:35.514862 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003bcff-0369-4f01-a8c7-9010a9f4c43f None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:35.514955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003bcff-0369-4f01-a8c7-9010a9f4c43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:35.533600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-2003bcff-0369-4f01-a8c7-9010a9f4c43f None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:35.534775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2003bcff-0369-4f01-a8c7-9010a9f4c43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:35.598792 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 575/1148] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:33:35.870959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34346c4-95bb-4df6-ab68-6bf7e5a59fcb None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:35.897846 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:35.974168 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34346c4-95bb-4df6-ab68-6bf7e5a59fcb None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:36.007169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392e0a1-95af-4fc9-be0e-5d3714ca45f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:36.007786 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392e0a1-95af-4fc9-be0e-5d3714ca45f8 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:36.008067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392e0a1-95af-4fc9-be0e-5d3714ca45f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:36.008342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392e0a1-95af-4fc9-be0e-5d3714ca45f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:36.018817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392e0a1-95af-4fc9-be0e-5d3714ca45f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:33:36.023488 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-5392e0a1-95af-4fc9-be0e-5d3714ca45f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:33:36.023488 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:36.023488 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:36.023488 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:36.023488 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:36.023488 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:36.023488 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:36.023488 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:36.023488 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:36.023488 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:36.023488 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:36.023488 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:36.023488 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:33:36.023488 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:33:36.023488 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:33:36.023488 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:33:36.024567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:33:36.024567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:33:36.024567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:33:36.024567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:33:36.024567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:36.024567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:36.024567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:36.024567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:36.024567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:36.024567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:36.024567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:36.024567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:36.024567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:36.024567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:36.024567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:36.024567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:36.025439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:36.025439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:36.025439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:36.025439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:36.025439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:33:36.025439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:33:36.025439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:33:36.025439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:33:36.025439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:33:36.025439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:33:36.025439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:33:36.025439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:33:36.025439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 574/1149] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:33:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:33:36.030573 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003bcff-0369-4f01-a8c7-9010a9f4c43f None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:36.121880 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:36.126234 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003bcff-0369-4f01-a8c7-9010a9f4c43f None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:36.160007 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecb94d-d98e-4c75-a70f-763701932fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:36.160603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecb94d-d98e-4c75-a70f-763701932fe6 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:36.160881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecb94d-d98e-4c75-a70f-763701932fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:36.161151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecb94d-d98e-4c75-a70f-763701932fe6 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:36.161835 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecb94d-d98e-4c75-a70f-763701932fe6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:36.162134 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecb94d-d98e-4c75-a70f-763701932fe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:36.163489 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecb94d-d98e-4c75-a70f-763701932fe6 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:36.171332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 576/1150] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:33:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:36.177217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392e0a1-95af-4fc9-be0e-5d3714ca45f8 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:36.284843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:36.303779 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392e0a1-95af-4fc9-be0e-5d3714ca45f8 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:36.338014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da488305-b9f3-4e34-be85-73345ea2ec5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:36.338630 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da488305-b9f3-4e34-be85-73345ea2ec5c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:36.338911 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da488305-b9f3-4e34-be85-73345ea2ec5c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:36.339186 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da488305-b9f3-4e34-be85-73345ea2ec5c None admin] PATH_INFO: `/v3/users/7697d81b3cda48b6a8557d808c653bda` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:36.340303 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da488305-b9f3-4e34-be85-73345ea2ec5c None admin] RBAC: Authorizing `identity:get_user(user_id=7697d81b3cda48b6a8557d808c653bda)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:36.341763 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da488305-b9f3-4e34-be85-73345ea2ec5c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:36.343328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 575/1151] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:33:36 2022] GET /identity/v3/users/7697d81b3cda48b6a8557d808c653bda => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:36.349181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecb94d-d98e-4c75-a70f-763701932fe6 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:36.447637 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecb94d-d98e-4c75-a70f-763701932fe6 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:36.480142 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35da14-a32b-42ee-b881-7d00dd68273a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:36.480763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35da14-a32b-42ee-b881-7d00dd68273a None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:36.481041 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35da14-a32b-42ee-b881-7d00dd68273a None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:36.481314 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35da14-a32b-42ee-b881-7d00dd68273a None admin] PATH_INFO: `/v3/projects/b51b8884ff3440f6bdf3aa90a781fc32` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:36.482461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35da14-a32b-42ee-b881-7d00dd68273a None admin] RBAC: Authorizing `identity:get_project(project_id=b51b8884ff3440f6bdf3aa90a781fc32)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:36.484139 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35da14-a32b-42ee-b881-7d00dd68273a None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:36.486403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 577/1152] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:33:36 2022] GET /identity/v3/projects/b51b8884ff3440f6bdf3aa90a781fc32 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:36.492291 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da488305-b9f3-4e34-be85-73345ea2ec5c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:36.595971 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da488305-b9f3-4e34-be85-73345ea2ec5c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:36.630266 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf84a69-9722-4f47-8921-b73082a75044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:36.630913 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf84a69-9722-4f47-8921-b73082a75044 None admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:36.631193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf84a69-9722-4f47-8921-b73082a75044 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:36.631467 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf84a69-9722-4f47-8921-b73082a75044 None admin] PATH_INFO: `/v3/projects/b51b8884ff3440f6bdf3aa90a781fc32/users/7697d81b3cda48b6a8557d808c653bda/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:36.633363 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf84a69-9722-4f47-8921-b73082a75044 None admin] RBAC: Authorizing `identity:create_grant(project_id=b51b8884ff3440f6bdf3aa90a781fc32, user_id=7697d81b3cda48b6a8557d808c653bda, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:36.634829 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf84a69-9722-4f47-8921-b73082a75044 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:36.648471 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 576/1153] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:33:36 2022] PUT /identity/v3/projects/b51b8884ff3440f6bdf3aa90a781fc32/users/7697d81b3cda48b6a8557d808c653bda/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:33:38.533011 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d664f59-f60d-4882-ad5a-ad041f7244c3 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:38.533536 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d664f59-f60d-4882-ad5a-ad041f7244c3 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:38.533536 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d664f59-f60d-4882-ad5a-ad041f7244c3 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:38.534833 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 578/1154] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:33:38.540090 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991edac8-9130-46b0-a100-bd9356321b88 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:38.540540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991edac8-9130-46b0-a100-bd9356321b88 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:38.540640 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991edac8-9130-46b0-a100-bd9356321b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:38.558825 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-991edac8-9130-46b0-a100-bd9356321b88 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:38.560010 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-991edac8-9130-46b0-a100-bd9356321b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:38.563337 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:38.626867 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 577/1155] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:33:38.894253 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d664f59-f60d-4882-ad5a-ad041f7244c3 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:38.923403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:38.997696 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d664f59-f60d-4882-ad5a-ad041f7244c3 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:39.030391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4556e-492a-4e2a-a8ca-3995151fd581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:39.031006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4556e-492a-4e2a-a8ca-3995151fd581 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:39.031287 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4556e-492a-4e2a-a8ca-3995151fd581 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:39.032168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4556e-492a-4e2a-a8ca-3995151fd581 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:39.042444 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4556e-492a-4e2a-a8ca-3995151fd581 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:33:39.047759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-b0f4556e-492a-4e2a-a8ca-3995151fd581 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:33:39.047759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:39.047759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:39.047759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:39.047759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:39.047759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:39.047759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:39.047759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:39.047759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:39.047759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:39.047759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:39.047759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:39.047759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:33:39.047759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:33:39.047759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:33:39.047759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:33:39.049037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:33:39.049037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:33:39.049037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:33:39.049037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:33:39.049037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:39.049037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:39.049037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:39.049037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:39.049037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:39.049037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:39.049037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:39.049037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:39.049037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:39.049037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:39.049037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:39.049037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:39.050242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:39.050242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:39.050242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:39.050242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:39.050242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:33:39.050242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:33:39.050242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:33:39.050242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:33:39.050242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:33:39.050242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:33:39.050242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:33:39.050242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:33:39.050242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 579/1156] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:33:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:33:39.054881 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991edac8-9130-46b0-a100-bd9356321b88 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:39.151232 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991edac8-9130-46b0-a100-bd9356321b88 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:39.188140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce9a72-7bd5-4608-94aa-6e9d54ed3e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:39.188737 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce9a72-7bd5-4608-94aa-6e9d54ed3e45 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:39.189016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce9a72-7bd5-4608-94aa-6e9d54ed3e45 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:39.189288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce9a72-7bd5-4608-94aa-6e9d54ed3e45 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:39.189991 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce9a72-7bd5-4608-94aa-6e9d54ed3e45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:39.190298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce9a72-7bd5-4608-94aa-6e9d54ed3e45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:39.191664 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce9a72-7bd5-4608-94aa-6e9d54ed3e45 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:39.200050 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 578/1157] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:33:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:39.205833 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4556e-492a-4e2a-a8ca-3995151fd581 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:39.293698 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:39.306655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4556e-492a-4e2a-a8ca-3995151fd581 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:39.340002 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d29d3-d744-4439-bb17-e14787701daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:39.340668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d29d3-d744-4439-bb17-e14787701daf None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:39.340945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d29d3-d744-4439-bb17-e14787701daf None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:39.341220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d29d3-d744-4439-bb17-e14787701daf None admin] PATH_INFO: `/v3/users/7697d81b3cda48b6a8557d808c653bda` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:39.342504 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d29d3-d744-4439-bb17-e14787701daf None admin] RBAC: Authorizing `identity:get_user(user_id=7697d81b3cda48b6a8557d808c653bda)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:39.344564 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d29d3-d744-4439-bb17-e14787701daf None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:39.346292 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 580/1158] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:33:39 2022] GET /identity/v3/users/7697d81b3cda48b6a8557d808c653bda => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:39.352263 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce9a72-7bd5-4608-94aa-6e9d54ed3e45 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:39.355165 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:39.450743 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce9a72-7bd5-4608-94aa-6e9d54ed3e45 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:39.485826 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5c509-100c-4297-8d0d-3ca028a48da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:39.486418 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5c509-100c-4297-8d0d-3ca028a48da9 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:39.486690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5c509-100c-4297-8d0d-3ca028a48da9 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:39.486959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5c509-100c-4297-8d0d-3ca028a48da9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:39.555855 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5c509-100c-4297-8d0d-3ca028a48da9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:39.557307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5c509-100c-4297-8d0d-3ca028a48da9 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:39.559143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:39.654244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 579/1159] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:33:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:33:39.660938 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d29d3-d744-4439-bb17-e14787701daf None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:39.758866 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d29d3-d744-4439-bb17-e14787701daf None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:39.791387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f6a2d-5b46-477a-b9f8-843c25607491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:39.792006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f6a2d-5b46-477a-b9f8-843c25607491 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:39.792288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f6a2d-5b46-477a-b9f8-843c25607491 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:39.792562 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f6a2d-5b46-477a-b9f8-843c25607491 None admin] PATH_INFO: `/v3/projects/b51b8884ff3440f6bdf3aa90a781fc32` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:39.793705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f6a2d-5b46-477a-b9f8-843c25607491 None admin] RBAC: Authorizing `identity:get_project(project_id=b51b8884ff3440f6bdf3aa90a781fc32)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:39.795120 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f6a2d-5b46-477a-b9f8-843c25607491 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:39.796749 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 581/1160] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:33:39 2022] GET /identity/v3/projects/b51b8884ff3440f6bdf3aa90a781fc32 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:39.803037 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5c509-100c-4297-8d0d-3ca028a48da9 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:39.907701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5c509-100c-4297-8d0d-3ca028a48da9 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:39.909218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:39.942468 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb897dab-98b7-4457-a57d-fc2a063b3835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:39.943061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb897dab-98b7-4457-a57d-fc2a063b3835 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:39.943341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb897dab-98b7-4457-a57d-fc2a063b3835 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:39.943638 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb897dab-98b7-4457-a57d-fc2a063b3835 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:39.944354 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb897dab-98b7-4457-a57d-fc2a063b3835 None admin] RBAC: Adding query filter params (role.id=cd2effe8340d4be08a28d3a40db6979d, scope.project.id=b51b8884ff3440f6bdf3aa90a781fc32, user.id=7697d81b3cda48b6a8557d808c653bda) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:39.944658 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb897dab-98b7-4457-a57d-fc2a063b3835 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:39.946112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb897dab-98b7-4457-a57d-fc2a063b3835 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:39.951741 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 580/1161] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:33:39 2022] GET /identity/v3/role_assignments?user.id=7697d81b3cda48b6a8557d808c653bda&scope.project.id=b51b8884ff3440f6bdf3aa90a781fc32&role.id=cd2effe8340d4be08a28d3a40db6979d => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:41.879525 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e753a8-2caf-4f97-beef-005bc021f2f0 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:41.880166 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e753a8-2caf-4f97-beef-005bc021f2f0 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:41.880166 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e753a8-2caf-4f97-beef-005bc021f2f0 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:41.881415 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 582/1162] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:33:41.886854 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39274f27-cb29-4b90-85de-148b6673ae9c None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:41.887297 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39274f27-cb29-4b90-85de-148b6673ae9c None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:41.887395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39274f27-cb29-4b90-85de-148b6673ae9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:41.905641 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-39274f27-cb29-4b90-85de-148b6673ae9c None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:41.906874 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-39274f27-cb29-4b90-85de-148b6673ae9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:41.977662 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 581/1163] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:33:42.244979 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e753a8-2caf-4f97-beef-005bc021f2f0 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:42.270316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:42.346690 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e753a8-2caf-4f97-beef-005bc021f2f0 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:42.379406 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29917395-3cce-4668-a0ef-dab2fe2f77b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:42.380003 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29917395-3cce-4668-a0ef-dab2fe2f77b8 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:42.380282 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29917395-3cce-4668-a0ef-dab2fe2f77b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:42.380551 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29917395-3cce-4668-a0ef-dab2fe2f77b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:42.445715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29917395-3cce-4668-a0ef-dab2fe2f77b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:42.447147 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29917395-3cce-4668-a0ef-dab2fe2f77b8 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:42.471096 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:42.544597 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 583/1164] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:33:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:33:42.550683 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39274f27-cb29-4b90-85de-148b6673ae9c None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:42.642673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:42.648585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39274f27-cb29-4b90-85de-148b6673ae9c None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:42.682162 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84eb94-e589-405e-a511-7b510857dbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:42.682778 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84eb94-e589-405e-a511-7b510857dbf4 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:42.683060 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84eb94-e589-405e-a511-7b510857dbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:42.683337 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84eb94-e589-405e-a511-7b510857dbf4 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:42.690672 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84eb94-e589-405e-a511-7b510857dbf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:42.692094 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84eb94-e589-405e-a511-7b510857dbf4 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:42.703082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-ef84eb94-e589-405e-a511-7b510857dbf4 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 09:33:42.703082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:42.703082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 09:33:42.703082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 09:33:42.703082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:33:42.703082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:33:42.703082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:33:42.703082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:33:42.703082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 09:33:42.703082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:33:42.703082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:33:42.703082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:33:42.703082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:42.703082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:42.703082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:42.703082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:42.703082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:42.704822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:42.704822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:42.704822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:42.704822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:42.704822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:42.704822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:42.704822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:33:42.704822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:33:42.704822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:33:42.704822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:33:42.704822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:42.704822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:42.704822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:42.704822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:42.704822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:42.704822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:42.705964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:42.705964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:42.705964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:42.705964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:42.705964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:42.705964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:42.705964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:42.705964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:42.705964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:42.705964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:42.705964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 09:33:42.705964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:33:42.705964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 09:33:42.705964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:33:42.705964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 582/1165] 10.222.0.58 () {56 vars in 1117 bytes} [Wed Aug 24 09:33:42 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:33:42.710767 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29917395-3cce-4668-a0ef-dab2fe2f77b8 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:42.807533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29917395-3cce-4668-a0ef-dab2fe2f77b8 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:42.831585 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:42.842250 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a3687-ef61-49d4-ae77-64416284c8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:42.842845 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a3687-ef61-49d4-ae77-64416284c8f3 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:42.843121 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a3687-ef61-49d4-ae77-64416284c8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:42.843400 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a3687-ef61-49d4-ae77-64416284c8f3 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:42.844038 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a3687-ef61-49d4-ae77-64416284c8f3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:42.844337 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a3687-ef61-49d4-ae77-64416284c8f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:42.845713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a3687-ef61-49d4-ae77-64416284c8f3 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:42.852670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 584/1166] 10.222.0.58 () {56 vars in 1115 bytes} [Wed Aug 24 09:33:42 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:44.745816 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977246f0-609f-4cfa-a821-03eb0bdd333b None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:44.746391 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977246f0-609f-4cfa-a821-03eb0bdd333b None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:44.746391 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977246f0-609f-4cfa-a821-03eb0bdd333b None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:44.747733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 583/1167] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:33:44.753275 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47a5be-30d4-4f74-b604-6fd733fdb871 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:44.753727 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47a5be-30d4-4f74-b604-6fd733fdb871 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:44.753857 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47a5be-30d4-4f74-b604-6fd733fdb871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:44.771948 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-fc47a5be-30d4-4f74-b604-6fd733fdb871 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:44.773140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-fc47a5be-30d4-4f74-b604-6fd733fdb871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:44.838859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 585/1168] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:33:45.110534 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977246f0-609f-4cfa-a821-03eb0bdd333b None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:45.211219 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977246f0-609f-4cfa-a821-03eb0bdd333b None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:45.244359 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b90f9-92a3-4aff-851f-1c03fe3dd00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:45.244955 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b90f9-92a3-4aff-851f-1c03fe3dd00f None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:45.245233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b90f9-92a3-4aff-851f-1c03fe3dd00f None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:45.245541 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b90f9-92a3-4aff-851f-1c03fe3dd00f None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:45.246200 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b90f9-92a3-4aff-851f-1c03fe3dd00f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:45.247584 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b90f9-92a3-4aff-851f-1c03fe3dd00f None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:45.263692 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 584/1169] 10.222.0.58 () {60 vars in 1138 bytes} [Wed Aug 24 09:33:45 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:33:47.203382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93787a23-898e-497a-b2ef-e596c2191929 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:47.203955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93787a23-898e-497a-b2ef-e596c2191929 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:47.204053 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93787a23-898e-497a-b2ef-e596c2191929 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:47.205422 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 586/1170] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:33:47.210648 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c3ad3-a29f-4cb6-a784-107ff0376c9b None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:47.211049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c3ad3-a29f-4cb6-a784-107ff0376c9b None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:47.211187 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c3ad3-a29f-4cb6-a784-107ff0376c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:47.229696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-c23c3ad3-a29f-4cb6-a784-107ff0376c9b None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:47.230899 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-c23c3ad3-a29f-4cb6-a784-107ff0376c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:47.242656 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:47.298751 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 585/1171] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 09:33:47.563948 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93787a23-898e-497a-b2ef-e596c2191929 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:47.663255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93787a23-898e-497a-b2ef-e596c2191929 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:47.679750 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:47.696464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9499751-623f-49a6-8499-982e29ebf94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:47.697079 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9499751-623f-49a6-8499-982e29ebf94e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:47.697358 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9499751-623f-49a6-8499-982e29ebf94e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:47.697659 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9499751-623f-49a6-8499-982e29ebf94e None admin] PATH_INFO: `/v3/domains/c3bf3f5519294ba3b704f2a534b6948f` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:47.708262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9499751-623f-49a6-8499-982e29ebf94e None admin] RBAC: Authorizing `identity:get_domain(domain_id=c3bf3f5519294ba3b704f2a534b6948f)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:47.709768 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9499751-623f-49a6-8499-982e29ebf94e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:47.711348 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 587/1172] 10.222.0.58 () {56 vars in 1183 bytes} [Wed Aug 24 09:33:47 2022] GET /identity/v3/domains/c3bf3f5519294ba3b704f2a534b6948f => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:47.717167 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c3ad3-a29f-4cb6-a784-107ff0376c9b None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:47.813722 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c3ad3-a29f-4cb6-a784-107ff0376c9b None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:47.847139 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa4554-fbf3-4454-a627-6b258be1fe3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:47.847730 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa4554-fbf3-4454-a627-6b258be1fe3c None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:47.848015 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa4554-fbf3-4454-a627-6b258be1fe3c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:47.848290 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa4554-fbf3-4454-a627-6b258be1fe3c None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:47.848936 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa4554-fbf3-4454-a627-6b258be1fe3c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:47.850404 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa4554-fbf3-4454-a627-6b258be1fe3c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:47.871521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:47.879604 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 586/1173] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 09:33:47 2022] POST /identity/v3/projects => generated 361 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:33:49.792249 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e46485-c5c4-4452-9529-86af461edf12 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:49.792828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e46485-c5c4-4452-9529-86af461edf12 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:49.792828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e46485-c5c4-4452-9529-86af461edf12 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:49.794171 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 588/1174] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:33:49.799877 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a214b3-ea3b-42f9-ad66-ccc9508b957c None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:49.800314 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a214b3-ea3b-42f9-ad66-ccc9508b957c None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:49.800425 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a214b3-ea3b-42f9-ad66-ccc9508b957c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:49.818344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-d3a214b3-ea3b-42f9-ad66-ccc9508b957c None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:49.819540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-d3a214b3-ea3b-42f9-ad66-ccc9508b957c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:49.884998 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 587/1175] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:33:50.153109 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e46485-c5c4-4452-9529-86af461edf12 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:50.252916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e46485-c5c4-4452-9529-86af461edf12 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:50.285893 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e51b5-c2c2-42b8-8bf2-b9f419e11f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:50.286505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e51b5-c2c2-42b8-8bf2-b9f419e11f55 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:50.286783 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e51b5-c2c2-42b8-8bf2-b9f419e11f55 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:50.287080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e51b5-c2c2-42b8-8bf2-b9f419e11f55 None admin] PATH_INFO: `/v3/domains/c3bf3f5519294ba3b704f2a534b6948f` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:50.288189 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e51b5-c2c2-42b8-8bf2-b9f419e11f55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c3bf3f5519294ba3b704f2a534b6948f)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:50.289619 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e51b5-c2c2-42b8-8bf2-b9f419e11f55 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:50.291178 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 589/1176] 10.222.0.58 () {56 vars in 1183 bytes} [Wed Aug 24 09:33:50 2022] GET /identity/v3/domains/c3bf3f5519294ba3b704f2a534b6948f => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:50.297062 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a214b3-ea3b-42f9-ad66-ccc9508b957c None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:50.394023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a214b3-ea3b-42f9-ad66-ccc9508b957c None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:50.419702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:50.427696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e35ba-41f2-4ee1-9f3e-ae8491b9cbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:50.428296 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e35ba-41f2-4ee1-9f3e-ae8491b9cbaf None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:50.430348 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e35ba-41f2-4ee1-9f3e-ae8491b9cbaf None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:50.430348 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e35ba-41f2-4ee1-9f3e-ae8491b9cbaf None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:50.430348 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e35ba-41f2-4ee1-9f3e-ae8491b9cbaf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:50.430892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e35ba-41f2-4ee1-9f3e-ae8491b9cbaf None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:50.451916 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 588/1177] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 09:33:50 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:33:52.436645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc875c3-842a-459c-bc21-b0b36b4926bf None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:52.437220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc875c3-842a-459c-bc21-b0b36b4926bf None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:52.437220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc875c3-842a-459c-bc21-b0b36b4926bf None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:52.438589 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 590/1178] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:33:52.443876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba185d8-2b97-456a-8efb-5084a19a50fa None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:52.444294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba185d8-2b97-456a-8efb-5084a19a50fa None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:52.444429 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba185d8-2b97-456a-8efb-5084a19a50fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:52.462253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-fba185d8-2b97-456a-8efb-5084a19a50fa None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:52.463439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-fba185d8-2b97-456a-8efb-5084a19a50fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:52.528335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 589/1179] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:33:52.808109 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc875c3-842a-459c-bc21-b0b36b4926bf None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:52.856896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:52.910123 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc875c3-842a-459c-bc21-b0b36b4926bf None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:52.943673 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41792d18-ae35-4d93-97a5-86a25eaa5a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:52.944295 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41792d18-ae35-4d93-97a5-86a25eaa5a92 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:52.944574 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41792d18-ae35-4d93-97a5-86a25eaa5a92 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:52.944849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41792d18-ae35-4d93-97a5-86a25eaa5a92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:52.954928 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41792d18-ae35-4d93-97a5-86a25eaa5a92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:33:52.959579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-41792d18-ae35-4d93-97a5-86a25eaa5a92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:33:52.959579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:52.959579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:52.959579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:52.959579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:52.959579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:52.959579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:52.959579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:52.959579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:52.959579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:52.959579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:52.959579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:52.959579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:33:52.959579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:33:52.959579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:33:52.959579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:33:52.960675 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:33:52.960675 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:33:52.960675 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:33:52.960675 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:33:52.960675 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:52.960675 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:52.960675 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:52.960675 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:52.960675 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:52.960675 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:52.960675 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:52.960675 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:52.960675 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:52.960675 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:52.960675 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:52.960675 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:52.961705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:52.961705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:52.961705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:52.961705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:52.961705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:33:52.961705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:33:52.961705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:33:52.961705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:33:52.961705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:33:52.961705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:33:52.961705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:33:52.961705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:33:52.961705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 591/1180] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:33:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:33:52.966838 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba185d8-2b97-456a-8efb-5084a19a50fa None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:53.064149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba185d8-2b97-456a-8efb-5084a19a50fa None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:53.077405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:53.099182 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c97d22-ffeb-43b2-9c7f-1f009580e3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:53.099778 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c97d22-ffeb-43b2-9c7f-1f009580e3a0 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:53.100056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c97d22-ffeb-43b2-9c7f-1f009580e3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:53.100328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c97d22-ffeb-43b2-9c7f-1f009580e3a0 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:53.100984 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c97d22-ffeb-43b2-9c7f-1f009580e3a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:53.101283 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c97d22-ffeb-43b2-9c7f-1f009580e3a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:53.102666 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c97d22-ffeb-43b2-9c7f-1f009580e3a0 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:53.111432 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 590/1181] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:33:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:53.117386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41792d18-ae35-4d93-97a5-86a25eaa5a92 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:53.216446 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41792d18-ae35-4d93-97a5-86a25eaa5a92 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:53.224996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:53.252752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58148be2-68e3-441a-9634-67e6aecf3408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:53.253377 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58148be2-68e3-441a-9634-67e6aecf3408 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:53.253683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58148be2-68e3-441a-9634-67e6aecf3408 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:53.253957 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58148be2-68e3-441a-9634-67e6aecf3408 None admin] PATH_INFO: `/v3/users/95f00b1d84ad4012b7aac30b1803d9d7` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:53.266934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58148be2-68e3-441a-9634-67e6aecf3408 None admin] RBAC: Authorizing `identity:get_user(user_id=95f00b1d84ad4012b7aac30b1803d9d7)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:53.268356 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58148be2-68e3-441a-9634-67e6aecf3408 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:53.269979 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 592/1182] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:33:53 2022] GET /identity/v3/users/95f00b1d84ad4012b7aac30b1803d9d7 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:53.276046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c97d22-ffeb-43b2-9c7f-1f009580e3a0 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:53.374025 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c97d22-ffeb-43b2-9c7f-1f009580e3a0 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:53.407046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a0cdb-460d-4f57-9696-4d508ce6a356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:53.407638 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a0cdb-460d-4f57-9696-4d508ce6a356 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:53.407910 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a0cdb-460d-4f57-9696-4d508ce6a356 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:53.408178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a0cdb-460d-4f57-9696-4d508ce6a356 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:53.450796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:53.474344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a0cdb-460d-4f57-9696-4d508ce6a356 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:53.475768 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a0cdb-460d-4f57-9696-4d508ce6a356 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:53.569822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 591/1183] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:33:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:33:53.575753 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58148be2-68e3-441a-9634-67e6aecf3408 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:53.673555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58148be2-68e3-441a-9634-67e6aecf3408 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:53.706996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf74fcf-6bd5-432e-aef5-c07562c2d542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:53.707614 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf74fcf-6bd5-432e-aef5-c07562c2d542 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:53.707894 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf74fcf-6bd5-432e-aef5-c07562c2d542 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:53.708171 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf74fcf-6bd5-432e-aef5-c07562c2d542 None admin] PATH_INFO: `/v3/projects/26bb01aa84a545f8ad870fdbc872dd1e` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:53.709287 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf74fcf-6bd5-432e-aef5-c07562c2d542 None admin] RBAC: Authorizing `identity:get_project(project_id=26bb01aa84a545f8ad870fdbc872dd1e)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:53.710734 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf74fcf-6bd5-432e-aef5-c07562c2d542 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:53.712352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 593/1184] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:33:53 2022] GET /identity/v3/projects/26bb01aa84a545f8ad870fdbc872dd1e => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:53.718375 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a0cdb-460d-4f57-9696-4d508ce6a356 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:53.792629 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:53.816022 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a0cdb-460d-4f57-9696-4d508ce6a356 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:53.849058 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fe68a-9dc8-416b-a3b5-f347707983c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:53.849668 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fe68a-9dc8-416b-a3b5-f347707983c6 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:53.849943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fe68a-9dc8-416b-a3b5-f347707983c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:53.850209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fe68a-9dc8-416b-a3b5-f347707983c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:53.850924 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5fe68a-9dc8-416b-a3b5-f347707983c6 None admin] RBAC: Adding query filter params (role.id=cd2effe8340d4be08a28d3a40db6979d, scope.project.id=26bb01aa84a545f8ad870fdbc872dd1e, user.id=95f00b1d84ad4012b7aac30b1803d9d7) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:53.851225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5fe68a-9dc8-416b-a3b5-f347707983c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:53.852623 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5fe68a-9dc8-416b-a3b5-f347707983c6 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:53.857831 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 592/1185] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:33:53 2022] GET /identity/v3/role_assignments?user.id=95f00b1d84ad4012b7aac30b1803d9d7&scope.project.id=26bb01aa84a545f8ad870fdbc872dd1e&role.id=cd2effe8340d4be08a28d3a40db6979d => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:55.751179 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd64119-11fa-447d-bfd5-af6b2bd64f3a None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:55.752314 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd64119-11fa-447d-bfd5-af6b2bd64f3a None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:55.752314 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd64119-11fa-447d-bfd5-af6b2bd64f3a None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:55.753646 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 594/1186] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:33:55.758727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db538c9c-d375-4fab-ba2b-05d4fefce624 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:55.759168 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db538c9c-d375-4fab-ba2b-05d4fefce624 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:55.759261 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db538c9c-d375-4fab-ba2b-05d4fefce624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:55.776899 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-db538c9c-d375-4fab-ba2b-05d4fefce624 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:55.778108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-db538c9c-d375-4fab-ba2b-05d4fefce624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:55.846029 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 593/1187] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:33:56.117277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd64119-11fa-447d-bfd5-af6b2bd64f3a None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:56.147673 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:56.224017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd64119-11fa-447d-bfd5-af6b2bd64f3a None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:56.257925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f60146-3cc6-4b62-bf7c-9c8c2d4a1255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:56.258549 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f60146-3cc6-4b62-bf7c-9c8c2d4a1255 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:56.258829 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f60146-3cc6-4b62-bf7c-9c8c2d4a1255 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:56.259102 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f60146-3cc6-4b62-bf7c-9c8c2d4a1255 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:56.269452 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f60146-3cc6-4b62-bf7c-9c8c2d4a1255 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:33:56.274169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-a8f60146-3cc6-4b62-bf7c-9c8c2d4a1255 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:33:56.274169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:56.274169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:56.274169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:56.274169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:56.274169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:56.274169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:56.274169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:56.274169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:56.274169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:56.274169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:56.274169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:56.274169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:33:56.274169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:33:56.274169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:33:56.274169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:33:56.275255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:33:56.275255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:33:56.275255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:33:56.275255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:33:56.275255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:56.275255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:56.275255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:56.275255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:56.275255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:56.275255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:56.275255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:56.275255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:56.275255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:56.275255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:56.275255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:56.275255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:56.276168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:56.276168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:56.276168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:56.276168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:56.276168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:33:56.276168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:33:56.276168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:33:56.276168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:33:56.276168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:33:56.276168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:33:56.276168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:33:56.276168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:33:56.276168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 595/1188] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:33:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:33:56.281275 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db538c9c-d375-4fab-ba2b-05d4fefce624 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:56.348457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:56.379259 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db538c9c-d375-4fab-ba2b-05d4fefce624 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:56.415095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653794f9-f31a-4278-bb7d-93e357fe89f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:56.415696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653794f9-f31a-4278-bb7d-93e357fe89f7 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:56.415976 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653794f9-f31a-4278-bb7d-93e357fe89f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:56.416250 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653794f9-f31a-4278-bb7d-93e357fe89f7 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:56.416914 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653794f9-f31a-4278-bb7d-93e357fe89f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:56.417220 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653794f9-f31a-4278-bb7d-93e357fe89f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:56.418614 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653794f9-f31a-4278-bb7d-93e357fe89f7 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:56.426796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 594/1189] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:33:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:56.432685 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f60146-3cc6-4b62-bf7c-9c8c2d4a1255 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:56.525012 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:56.534620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f60146-3cc6-4b62-bf7c-9c8c2d4a1255 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:56.567691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc7bdc-8a29-4fc7-b94e-99dd67be6ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:56.568308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc7bdc-8a29-4fc7-b94e-99dd67be6ebc None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:56.568589 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc7bdc-8a29-4fc7-b94e-99dd67be6ebc None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:56.568864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc7bdc-8a29-4fc7-b94e-99dd67be6ebc None admin] PATH_INFO: `/v3/users/95f00b1d84ad4012b7aac30b1803d9d7` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:56.570008 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc7bdc-8a29-4fc7-b94e-99dd67be6ebc None admin] RBAC: Authorizing `identity:get_user(user_id=95f00b1d84ad4012b7aac30b1803d9d7)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:56.571431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc7bdc-8a29-4fc7-b94e-99dd67be6ebc None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:56.573015 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 596/1190] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:33:56 2022] GET /identity/v3/users/95f00b1d84ad4012b7aac30b1803d9d7 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:56.578854 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653794f9-f31a-4278-bb7d-93e357fe89f7 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:56.679100 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653794f9-f31a-4278-bb7d-93e357fe89f7 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:56.707854 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:56.713134 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6838003-9496-4ac7-86e4-6c7b04e74e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:56.713785 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6838003-9496-4ac7-86e4-6c7b04e74e22 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:56.714067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6838003-9496-4ac7-86e4-6c7b04e74e22 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:56.714343 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6838003-9496-4ac7-86e4-6c7b04e74e22 None admin] PATH_INFO: `/v3/projects/26bb01aa84a545f8ad870fdbc872dd1e` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:56.715457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6838003-9496-4ac7-86e4-6c7b04e74e22 None admin] RBAC: Authorizing `identity:get_project(project_id=26bb01aa84a545f8ad870fdbc872dd1e)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:56.716883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6838003-9496-4ac7-86e4-6c7b04e74e22 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:56.718526 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 595/1191] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:33:56 2022] GET /identity/v3/projects/26bb01aa84a545f8ad870fdbc872dd1e => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:56.724637 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc7bdc-8a29-4fc7-b94e-99dd67be6ebc None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:56.821426 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc7bdc-8a29-4fc7-b94e-99dd67be6ebc None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:56.853867 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada056e-3599-4178-bd6b-c417e7fb0ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:56.854505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada056e-3599-4178-bd6b-c417e7fb0ef3 None admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:56.854781 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada056e-3599-4178-bd6b-c417e7fb0ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:56.855053 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada056e-3599-4178-bd6b-c417e7fb0ef3 None admin] PATH_INFO: `/v3/projects/26bb01aa84a545f8ad870fdbc872dd1e/users/95f00b1d84ad4012b7aac30b1803d9d7/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:56.856920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada056e-3599-4178-bd6b-c417e7fb0ef3 None admin] RBAC: Authorizing `identity:create_grant(project_id=26bb01aa84a545f8ad870fdbc872dd1e, user_id=95f00b1d84ad4012b7aac30b1803d9d7, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:56.858621 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada056e-3599-4178-bd6b-c417e7fb0ef3 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:56.874409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 597/1192] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:33:56 2022] PUT /identity/v3/projects/26bb01aa84a545f8ad870fdbc872dd1e/users/95f00b1d84ad4012b7aac30b1803d9d7/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:33:58.787304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b19761-d71a-435a-a93c-bf7b8275fcf7 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:58.787874 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b19761-d71a-435a-a93c-bf7b8275fcf7 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:58.787874 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b19761-d71a-435a-a93c-bf7b8275fcf7 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:58.789221 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 596/1193] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:33:58.796605 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5720f3c-7a0d-41dc-97e5-e42c85f94316 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:58.797018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5720f3c-7a0d-41dc-97e5-e42c85f94316 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:58.797157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5720f3c-7a0d-41dc-97e5-e42c85f94316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:58.817947 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-c5720f3c-7a0d-41dc-97e5-e42c85f94316 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:33:58.819142 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-c5720f3c-7a0d-41dc-97e5-e42c85f94316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:33:58.836075 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:58.897904 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 598/1194] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:33:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:33:59.216962 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b19761-d71a-435a-a93c-bf7b8275fcf7 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:59.329803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b19761-d71a-435a-a93c-bf7b8275fcf7 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:59.362516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8370a9d-546d-4431-954b-48617f01a76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:59.363134 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8370a9d-546d-4431-954b-48617f01a76d None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:59.363411 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8370a9d-546d-4431-954b-48617f01a76d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:59.363679 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8370a9d-546d-4431-954b-48617f01a76d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:59.373972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8370a9d-546d-4431-954b-48617f01a76d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:33:59.379367 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-c8370a9d-546d-4431-954b-48617f01a76d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:33:59.379367 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:33:59.379367 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:33:59.379367 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:33:59.379367 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:33:59.379367 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:33:59.379367 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:33:59.379367 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:33:59.379367 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:33:59.379367 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:33:59.379367 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:33:59.379367 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:33:59.379367 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:33:59.379367 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:33:59.379367 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:33:59.379367 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:33:59.380480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:33:59.380480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:33:59.380480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:33:59.380480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:33:59.380480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:33:59.380480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:33:59.380480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:33:59.380480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:33:59.380480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:33:59.380480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:33:59.380480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:33:59.380480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:33:59.380480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:33:59.380480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:33:59.380480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:33:59.380480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:33:59.381350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:33:59.381350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:33:59.381350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:33:59.381350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:33:59.381350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:33:59.381350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:33:59.381350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:33:59.381350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:33:59.381350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:33:59.381350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:33:59.381350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:33:59.381350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:33:59.381350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 597/1195] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:33:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:33:59.386561 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5720f3c-7a0d-41dc-97e5-e42c85f94316 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:59.482315 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5720f3c-7a0d-41dc-97e5-e42c85f94316 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:59.515455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35784b1e-f2d4-4d9f-a3b7-f59b6752617f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:59.516052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35784b1e-f2d4-4d9f-a3b7-f59b6752617f None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:59.516326 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35784b1e-f2d4-4d9f-a3b7-f59b6752617f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:59.516593 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35784b1e-f2d4-4d9f-a3b7-f59b6752617f None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:59.517963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35784b1e-f2d4-4d9f-a3b7-f59b6752617f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:33:59.518254 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35784b1e-f2d4-4d9f-a3b7-f59b6752617f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:59.519599 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35784b1e-f2d4-4d9f-a3b7-f59b6752617f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:59.527384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 599/1196] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:33:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:59.533967 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8370a9d-546d-4431-954b-48617f01a76d None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:59.592794 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:59.634208 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8370a9d-546d-4431-954b-48617f01a76d None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:59.666901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d53bb-7cc6-4129-b7fd-62c8ac6e5735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:59.667524 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d53bb-7cc6-4129-b7fd-62c8ac6e5735 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:59.667806 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d53bb-7cc6-4129-b7fd-62c8ac6e5735 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:59.668079 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d53bb-7cc6-4129-b7fd-62c8ac6e5735 None admin] PATH_INFO: `/v3/users/95f00b1d84ad4012b7aac30b1803d9d7` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:59.669188 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d53bb-7cc6-4129-b7fd-62c8ac6e5735 None admin] RBAC: Authorizing `identity:get_user(user_id=95f00b1d84ad4012b7aac30b1803d9d7)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:59.670671 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d53bb-7cc6-4129-b7fd-62c8ac6e5735 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:59.672232 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 598/1197] 10.222.0.58 () {56 vars in 1177 bytes} [Wed Aug 24 09:33:59 2022] GET /identity/v3/users/95f00b1d84ad4012b7aac30b1803d9d7 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:33:59.678738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35784b1e-f2d4-4d9f-a3b7-f59b6752617f None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:33:59.693692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:59.775495 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35784b1e-f2d4-4d9f-a3b7-f59b6752617f None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:33:59.808367 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef47f77-52a5-485c-b497-1aacfa03e5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:33:59.808963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef47f77-52a5-485c-b497-1aacfa03e5d5 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:33:59.809238 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef47f77-52a5-485c-b497-1aacfa03e5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:33:59.809532 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef47f77-52a5-485c-b497-1aacfa03e5d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:33:59.874254 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef47f77-52a5-485c-b497-1aacfa03e5d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:33:59.875672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef47f77-52a5-485c-b497-1aacfa03e5d5 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:33:59.888562 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:59.969796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 600/1198] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:33:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 09:33:59.976441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d53bb-7cc6-4129-b7fd-62c8ac6e5735 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:34:00.075033 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d53bb-7cc6-4129-b7fd-62c8ac6e5735 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:34:00.101148 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:34:00.109544 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2e71b-ca95-42cb-9fc3-92ef2b6c5300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:34:00.110164 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2e71b-ca95-42cb-9fc3-92ef2b6c5300 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:00.110551 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2e71b-ca95-42cb-9fc3-92ef2b6c5300 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:00.110842 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2e71b-ca95-42cb-9fc3-92ef2b6c5300 None admin] PATH_INFO: `/v3/projects/26bb01aa84a545f8ad870fdbc872dd1e` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:00.111965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2e71b-ca95-42cb-9fc3-92ef2b6c5300 None admin] RBAC: Authorizing `identity:get_project(project_id=26bb01aa84a545f8ad870fdbc872dd1e)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:34:00.113388 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2e71b-ca95-42cb-9fc3-92ef2b6c5300 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:34:00.115034 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 599/1199] 10.222.0.58 () {56 vars in 1186 bytes} [Wed Aug 24 09:33:59 2022] GET /identity/v3/projects/26bb01aa84a545f8ad870fdbc872dd1e => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:34:00.121284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef47f77-52a5-485c-b497-1aacfa03e5d5 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:34:00.226392 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef47f77-52a5-485c-b497-1aacfa03e5d5 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:34:00.239595 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:34:00.260438 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05652a-141d-47c8-a09e-35d84136f6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:34:00.261029 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05652a-141d-47c8-a09e-35d84136f6fc None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:00.261307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05652a-141d-47c8-a09e-35d84136f6fc None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:00.261624 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05652a-141d-47c8-a09e-35d84136f6fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:00.262341 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05652a-141d-47c8-a09e-35d84136f6fc None admin] RBAC: Adding query filter params (role.id=cd2effe8340d4be08a28d3a40db6979d, scope.project.id=26bb01aa84a545f8ad870fdbc872dd1e, user.id=95f00b1d84ad4012b7aac30b1803d9d7) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:34:00.262646 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05652a-141d-47c8-a09e-35d84136f6fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:34:00.264053 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05652a-141d-47c8-a09e-35d84136f6fc None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:34:00.270197 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 601/1200] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:34:00 2022] GET /identity/v3/role_assignments?user.id=95f00b1d84ad4012b7aac30b1803d9d7&scope.project.id=26bb01aa84a545f8ad870fdbc872dd1e&role.id=cd2effe8340d4be08a28d3a40db6979d => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:34:10.106143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:34:10.267451 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=12 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:34:56.587531 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3b0f9-fe46-4cc6-8d9f-aa47aa986ce7 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:56.588114 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3b0f9-fe46-4cc6-8d9f-aa47aa986ce7 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:56.588114 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3b0f9-fe46-4cc6-8d9f-aa47aa986ce7 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:56.589517 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 600/1201] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:34:56.595380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba3c95-39f6-48dd-ab96-3235f50fd34a None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:56.595893 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba3c95-39f6-48dd-ab96-3235f50fd34a None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:56.595990 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba3c95-39f6-48dd-ab96-3235f50fd34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:56.622760 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-ecba3c95-39f6-48dd-ab96-3235f50fd34a None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:34:56.623987 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-ecba3c95-39f6-48dd-ab96-3235f50fd34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:34:56.726333 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 602/1202] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:34:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:34:57.020191 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3b0f9-fe46-4cc6-8d9f-aa47aa986ce7 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:34:57.155338 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3b0f9-fe46-4cc6-8d9f-aa47aa986ce7 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:34:57.195567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0b6d3-0ecf-4643-a420-a58874a61d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:34:57.196736 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0b6d3-0ecf-4643-a420-a58874a61d9b None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:57.197449 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0b6d3-0ecf-4643-a420-a58874a61d9b None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:57.197449 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0b6d3-0ecf-4643-a420-a58874a61d9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:57.210613 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0b6d3-0ecf-4643-a420-a58874a61d9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:34:57.212136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0b6d3-0ecf-4643-a420-a58874a61d9b None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:34:57.238138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-5ff0b6d3-0ecf-4643-a420-a58874a61d9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:34:57.238138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:34:57.238138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:34:57.238138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:34:57.238138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:34:57.238138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:34:57.238138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:34:57.238138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:34:57.238138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:34:57.238138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:34:57.238138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:34:57.238138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:34:57.238138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:34:57.238138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:34:57.238138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:34:57.238138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:34:57.239433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:34:57.239433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:34:57.239433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:34:57.239433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:34:57.239433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:34:57.239433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:34:57.239433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:34:57.239433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:34:57.239433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:34:57.239433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:34:57.239433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:34:57.239433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:34:57.239433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:34:57.239433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:34:57.239433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:34:57.239433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:34:57.239433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:34:57.240898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:34:57.240898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:34:57.240898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:34:57.240898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 601/1203] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:34:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:34:57.251189 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba3c95-39f6-48dd-ab96-3235f50fd34a None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:34:57.396334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba3c95-39f6-48dd-ab96-3235f50fd34a None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:34:57.435029 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:34:57.448514 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e10d9-2d11-4df2-afa9-c0f034264dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:34:57.448514 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e10d9-2d11-4df2-afa9-c0f034264dff None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:57.448514 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e10d9-2d11-4df2-afa9-c0f034264dff None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:57.448514 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e10d9-2d11-4df2-afa9-c0f034264dff None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:57.448938 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e10d9-2d11-4df2-afa9-c0f034264dff None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:34:57.448938 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e10d9-2d11-4df2-afa9-c0f034264dff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:34:57.452389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e10d9-2d11-4df2-afa9-c0f034264dff None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:34:57.469735 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 603/1204] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:34:57.475246 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0b6d3-0ecf-4643-a420-a58874a61d9b None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:34:57.544186 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:34:57.609221 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0b6d3-0ecf-4643-a420-a58874a61d9b None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:34:57.665449 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d47b4-6a2b-4fe0-bb75-76114d374976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:34:57.666034 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d47b4-6a2b-4fe0-bb75-76114d374976 None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:57.666307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d47b4-6a2b-4fe0-bb75-76114d374976 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:57.666576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d47b4-6a2b-4fe0-bb75-76114d374976 None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:57.667223 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d47b4-6a2b-4fe0-bb75-76114d374976 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:34:57.668651 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d47b4-6a2b-4fe0-bb75-76114d374976 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:34:57.695869 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 602/1205] 10.222.0.58 () {60 vars in 1132 bytes} [Wed Aug 24 09:34:57 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:34:59.994058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c8830-01a4-44ec-a108-5dcf04b133d4 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:34:59.995932 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c8830-01a4-44ec-a108-5dcf04b133d4 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:34:59.995932 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c8830-01a4-44ec-a108-5dcf04b133d4 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:34:59.996609 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 604/1206] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:34:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:35:00.003740 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f4806-eb59-4d57-a880-3bf48fc08c51 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:00.004297 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f4806-eb59-4d57-a880-3bf48fc08c51 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:00.004297 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f4806-eb59-4d57-a880-3bf48fc08c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:00.026203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-329f4806-eb59-4d57-a880-3bf48fc08c51 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:35:00.027535 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-329f4806-eb59-4d57-a880-3bf48fc08c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:35:00.121247 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 603/1207] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:35:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:35:00.462264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c8830-01a4-44ec-a108-5dcf04b133d4 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:00.609988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c8830-01a4-44ec-a108-5dcf04b133d4 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:00.652901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697784fd-7c70-40d2-b299-4c68141b445d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:00.653526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697784fd-7c70-40d2-b299-4c68141b445d None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:00.653811 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697784fd-7c70-40d2-b299-4c68141b445d None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:00.654086 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697784fd-7c70-40d2-b299-4c68141b445d None admin] PATH_INFO: `/v3/roles/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:00.666188 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697784fd-7c70-40d2-b299-4c68141b445d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:35:00.671425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-697784fd-7c70-40d2-b299-4c68141b445d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:35:00.671425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:00.671425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:00.671425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:00.671425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:00.671425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:00.671425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:00.671425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:00.671425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:00.671425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:00.671425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:00.671425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:00.671425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:35:00.671425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:35:00.671425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:35:00.671425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:35:00.674284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:35:00.674284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:35:00.674284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:35:00.674284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:35:00.674284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:00.674284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:00.674284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:00.674284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:00.674284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:00.674284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:00.674284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:00.674284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:00.674284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:00.674284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:00.674284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:00.674284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:00.675183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:00.675183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:00.675183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:00.675183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:00.675183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:35:00.675183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:35:00.675183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:35:00.675183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:35:00.675183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:35:00.675183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:35:00.675183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:35:00.675183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:00.675183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 605/1208] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:35:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:00.678752 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f4806-eb59-4d57-a880-3bf48fc08c51 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:00.725578 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:00.806727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f4806-eb59-4d57-a880-3bf48fc08c51 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:00.847708 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10991b8-b57e-4e87-bb52-c88269455c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:00.848445 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10991b8-b57e-4e87-bb52-c88269455c86 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:00.848760 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10991b8-b57e-4e87-bb52-c88269455c86 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:00.849253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10991b8-b57e-4e87-bb52-c88269455c86 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:00.850034 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10991b8-b57e-4e87-bb52-c88269455c86 None admin] RBAC: Adding query filter params (name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:00.850337 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10991b8-b57e-4e87-bb52-c88269455c86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:00.851723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10991b8-b57e-4e87-bb52-c88269455c86 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:00.862575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 604/1209] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 09:35:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:35:00.868244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697784fd-7c70-40d2-b299-4c68141b445d None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:00.932122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:01.000252 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697784fd-7c70-40d2-b299-4c68141b445d None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:01.041604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31e4de-78ea-4e2c-89a0-35ebd6df2c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:01.042476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31e4de-78ea-4e2c-89a0-35ebd6df2c65 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:01.042933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31e4de-78ea-4e2c-89a0-35ebd6df2c65 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:01.043128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31e4de-78ea-4e2c-89a0-35ebd6df2c65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:01.055201 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31e4de-78ea-4e2c-89a0-35ebd6df2c65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:01.056777 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31e4de-78ea-4e2c-89a0-35ebd6df2c65 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:01.073702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-4c31e4de-78ea-4e2c-89a0-35ebd6df2c65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:01.073702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:01.073702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:01.073702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:01.073702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:01.073702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:01.073702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:01.073702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:01.073702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:01.073702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:01.073702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:01.073702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:01.073702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:35:01.073702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:35:01.073702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:35:01.073702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:35:01.074775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:01.074775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:01.074775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:01.074775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:01.074775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:01.074775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:01.074775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:01.074775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:01.074775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:01.074775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:01.074775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:01.074775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:01.074775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:01.074775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:01.074775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:01.074775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:01.074775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:35:01.076111 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:35:01.076111 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:01.076111 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:01.076111 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 606/1210] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:35:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:01.081543 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10991b8-b57e-4e87-bb52-c88269455c86 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:01.201482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:01.207206 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10991b8-b57e-4e87-bb52-c88269455c86 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:01.248444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261591a-e70f-42a8-ab3b-b203119be954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:01.249340 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261591a-e70f-42a8-ab3b-b203119be954 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:01.249659 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261591a-e70f-42a8-ab3b-b203119be954 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:01.250933 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261591a-e70f-42a8-ab3b-b203119be954 None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:01.250933 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261591a-e70f-42a8-ab3b-b203119be954 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:01.251217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261591a-e70f-42a8-ab3b-b203119be954 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:01.252699 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261591a-e70f-42a8-ab3b-b203119be954 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:01.265425 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 605/1211] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:35:01.271166 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31e4de-78ea-4e2c-89a0-35ebd6df2c65 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:01.386096 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31e4de-78ea-4e2c-89a0-35ebd6df2c65 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:01.387694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:01.425905 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e5564-7f02-498a-a23f-18d972852d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:01.426825 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e5564-7f02-498a-a23f-18d972852d72 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:01.427104 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e5564-7f02-498a-a23f-18d972852d72 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:01.427382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e5564-7f02-498a-a23f-18d972852d72 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:01.436589 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e5564-7f02-498a-a23f-18d972852d72 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:01.438699 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e5564-7f02-498a-a23f-18d972852d72 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:01.452122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-518e5564-7f02-498a-a23f-18d972852d72 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:35:01.452122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:01.452122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:01.452122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:01.452122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:01.452122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:01.452122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:01.452122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:01.452122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:01.452122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:01.452122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:01.452122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:01.452122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:35:01.452122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:35:01.452122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:35:01.452122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:35:01.453151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:01.453151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:01.453151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:35:01.453151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:35:01.453151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:35:01.453151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:35:01.453151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:01.453151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:01.453151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:01.453151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:01.453151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:01.453151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:01.453151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:01.453151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:01.453151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:01.453151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:01.453151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:01.453151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:01.454557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:01.454557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:01.454557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:35:01.454557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:35:01.454557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:35:01.454557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:35:01.454557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:35:01.454557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:35:01.454557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:35:01.454557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:01.458618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 607/1212] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:35:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:35:01.460334 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261591a-e70f-42a8-ab3b-b203119be954 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:01.581979 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261591a-e70f-42a8-ab3b-b203119be954 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:01.620181 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51350551-5ed6-4419-8639-a758e49139d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:01.620837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51350551-5ed6-4419-8639-a758e49139d5 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:01.621168 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51350551-5ed6-4419-8639-a758e49139d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:01.621392 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51350551-5ed6-4419-8639-a758e49139d5 None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:01.622226 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51350551-5ed6-4419-8639-a758e49139d5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:01.622538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51350551-5ed6-4419-8639-a758e49139d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:01.624226 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51350551-5ed6-4419-8639-a758e49139d5 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:01.651039 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 606/1213] 10.222.0.58 () {56 vars in 1143 bytes} [Wed Aug 24 09:35:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:01.652473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e5564-7f02-498a-a23f-18d972852d72 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:01.767025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e5564-7f02-498a-a23f-18d972852d72 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:01.809928 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6415c5-3e0d-4f7a-a64b-55d2952671ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:01.810701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6415c5-3e0d-4f7a-a64b-55d2952671ef None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:01.811079 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6415c5-3e0d-4f7a-a64b-55d2952671ef None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:01.811456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6415c5-3e0d-4f7a-a64b-55d2952671ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:01.851550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:01.905416 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6415c5-3e0d-4f7a-a64b-55d2952671ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:01.908016 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6415c5-3e0d-4f7a-a64b-55d2952671ef None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:02.021620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 608/1214] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:35:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:35:02.027554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51350551-5ed6-4419-8639-a758e49139d5 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:02.050513 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:02.146845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51350551-5ed6-4419-8639-a758e49139d5 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:02.182753 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7d65c-a8da-48a6-9c16-290d954ed1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:02.183375 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7d65c-a8da-48a6-9c16-290d954ed1e6 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:02.183658 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7d65c-a8da-48a6-9c16-290d954ed1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:02.183963 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7d65c-a8da-48a6-9c16-290d954ed1e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:02.195262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7d65c-a8da-48a6-9c16-290d954ed1e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:02.196801 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7d65c-a8da-48a6-9c16-290d954ed1e6 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:02.213045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-f4c7d65c-a8da-48a6-9c16-290d954ed1e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:02.213045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:02.213045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:02.213045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:02.213045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:02.213045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:02.213045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:02.213045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:02.213045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:02.213045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:02.213045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:02.213045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:02.213045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:35:02.213045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:35:02.213045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:35:02.213045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:35:02.214406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:02.214406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:02.214406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:02.214406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:02.214406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:02.214406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:02.214406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:02.214406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:02.214406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:02.214406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:02.214406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:02.214406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:02.214406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:02.214406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:02.214406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:02.214406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:02.214406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:35:02.215278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:35:02.215278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:02.215278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:35:02.215278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 607/1215] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:02.220054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6415c5-3e0d-4f7a-a64b-55d2952671ef None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:02.292770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:02.339428 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6415c5-3e0d-4f7a-a64b-55d2952671ef None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:02.378372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9deadc-b0a6-40b8-a76b-77c1f73584c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:02.379072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9deadc-b0a6-40b8-a76b-77c1f73584c3 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:02.379319 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9deadc-b0a6-40b8-a76b-77c1f73584c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:02.379588 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9deadc-b0a6-40b8-a76b-77c1f73584c3 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:02.380277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9deadc-b0a6-40b8-a76b-77c1f73584c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:02.380581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9deadc-b0a6-40b8-a76b-77c1f73584c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:02.382036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9deadc-b0a6-40b8-a76b-77c1f73584c3 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:02.398831 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 609/1216] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:02.399946 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7d65c-a8da-48a6-9c16-290d954ed1e6 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:02.482176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:02.521312 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7d65c-a8da-48a6-9c16-290d954ed1e6 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:02.560308 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e1edf-f468-4622-a7c5-0e44c40d287e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:02.560950 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e1edf-f468-4622-a7c5-0e44c40d287e None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:02.561248 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e1edf-f468-4622-a7c5-0e44c40d287e None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:02.561522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e1edf-f468-4622-a7c5-0e44c40d287e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:02.569171 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e1edf-f468-4622-a7c5-0e44c40d287e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:02.570648 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e1edf-f468-4622-a7c5-0e44c40d287e None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:02.583350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-b69e1edf-f468-4622-a7c5-0e44c40d287e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:35:02.583350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:02.583350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:02.583350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:02.583350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:02.583350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:02.583350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:02.583350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:02.583350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:02.583350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:02.583350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:02.583350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:02.583350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:35:02.583350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:35:02.583350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:35:02.584472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:35:02.584472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:02.584472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:02.584472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:02.584472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:02.584472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:02.584472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:02.584472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:02.584472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:02.584472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:02.584472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:02.584472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:02.584472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:02.584472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:02.584472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:02.584472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:02.584472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:02.585383 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:35:02.585383 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:35:02.585383 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:35:02.585383 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:35:02.585383 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:35:02.585383 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:35:02.585383 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:35:02.585383 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:35:02.585383 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 608/1217] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:35:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:35:02.590414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9deadc-b0a6-40b8-a76b-77c1f73584c3 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:02.705384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9deadc-b0a6-40b8-a76b-77c1f73584c3 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:02.733855 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:02.749041 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925a8e4-b8b6-44e1-8ae3-7fc9b9de869b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:02.749626 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925a8e4-b8b6-44e1-8ae3-7fc9b9de869b None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:02.749923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925a8e4-b8b6-44e1-8ae3-7fc9b9de869b None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:02.750292 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925a8e4-b8b6-44e1-8ae3-7fc9b9de869b None admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:02.751130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925a8e4-b8b6-44e1-8ae3-7fc9b9de869b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:02.751449 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925a8e4-b8b6-44e1-8ae3-7fc9b9de869b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:02.752910 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925a8e4-b8b6-44e1-8ae3-7fc9b9de869b None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:02.766622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 610/1218] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:35:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:02.773153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e1edf-f468-4622-a7c5-0e44c40d287e None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:02.910492 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e1edf-f468-4622-a7c5-0e44c40d287e None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:02.948201 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:02.957781 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ccbaf-547e-4222-b9c4-7b705ac51d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:02.958452 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ccbaf-547e-4222-b9c4-7b705ac51d5f None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:02.959040 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ccbaf-547e-4222-b9c4-7b705ac51d5f None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:02.959396 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ccbaf-547e-4222-b9c4-7b705ac51d5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:02.960191 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ccbaf-547e-4222-b9c4-7b705ac51d5f None admin] RBAC: Adding query filter params (role.id=85dac7b70cf04091baaf69caabd27a8b, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=6983e364f5564ed7854dff06a80f55d2) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:02.960531 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ccbaf-547e-4222-b9c4-7b705ac51d5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:02.962274 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ccbaf-547e-4222-b9c4-7b705ac51d5f None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:02.977502 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 609/1219] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:35:02 2022] GET /identity/v3/role_assignments?user.id=6983e364f5564ed7854dff06a80f55d2&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=85dac7b70cf04091baaf69caabd27a8b => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:05.103143 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c745f-70f4-472d-a6bb-98b362030398 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:05.103710 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c745f-70f4-472d-a6bb-98b362030398 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:05.103710 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c745f-70f4-472d-a6bb-98b362030398 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:05.105030 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 611/1220] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:35:05.111233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95cc5f-11ad-40d8-a1e2-64564decd30d None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:05.111815 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95cc5f-11ad-40d8-a1e2-64564decd30d None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:05.111815 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95cc5f-11ad-40d8-a1e2-64564decd30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:05.130708 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-be95cc5f-11ad-40d8-a1e2-64564decd30d None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:35:05.131894 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-be95cc5f-11ad-40d8-a1e2-64564decd30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:35:05.205715 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 610/1221] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:35:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:35:05.510617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c745f-70f4-472d-a6bb-98b362030398 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:05.636335 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c745f-70f4-472d-a6bb-98b362030398 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:05.675947 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660d4dd-3e51-4109-9bb0-21f16ef6d0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:05.676702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660d4dd-3e51-4109-9bb0-21f16ef6d0fa None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:05.676986 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660d4dd-3e51-4109-9bb0-21f16ef6d0fa None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:05.677255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660d4dd-3e51-4109-9bb0-21f16ef6d0fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:05.688823 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660d4dd-3e51-4109-9bb0-21f16ef6d0fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:35:05.693625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-5660d4dd-3e51-4109-9bb0-21f16ef6d0fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:35:05.693625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:05.693625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:05.693625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:05.693625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:05.693625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:05.693625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:05.693625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:05.693625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:05.693625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:05.693625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:05.693625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:05.693625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:35:05.693625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:35:05.693625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:35:05.693625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:35:05.694859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:35:05.694859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:35:05.694859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:35:05.694859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:35:05.694859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:05.694859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:05.694859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:05.694859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:05.694859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:05.694859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:05.694859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:05.694859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:05.694859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:05.694859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:05.694859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:05.694859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:05.695913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:05.695913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:05.695913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:05.695913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:05.695913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:35:05.695913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:35:05.695913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:35:05.695913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:35:05.695913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:35:05.695913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:35:05.695913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:35:05.695913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:05.695913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 612/1222] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:35:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:05.700869 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95cc5f-11ad-40d8-a1e2-64564decd30d None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:05.816595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be95cc5f-11ad-40d8-a1e2-64564decd30d None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:05.850804 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:05.864939 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13a700-2ccc-469d-bc5b-518521d5efd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:05.865611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13a700-2ccc-469d-bc5b-518521d5efd0 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:05.865932 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13a700-2ccc-469d-bc5b-518521d5efd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:05.866270 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13a700-2ccc-469d-bc5b-518521d5efd0 None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:05.866924 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13a700-2ccc-469d-bc5b-518521d5efd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:05.867312 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13a700-2ccc-469d-bc5b-518521d5efd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:05.868703 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13a700-2ccc-469d-bc5b-518521d5efd0 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:05.877405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 611/1223] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 09:35:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:05.883181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660d4dd-3e51-4109-9bb0-21f16ef6d0fa None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:05.933912 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:05.998672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660d4dd-3e51-4109-9bb0-21f16ef6d0fa None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:06.034483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97bc0a-4770-4a28-bba1-a1738c686018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:06.035105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97bc0a-4770-4a28-bba1-a1738c686018 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:06.035381 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97bc0a-4770-4a28-bba1-a1738c686018 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:06.035648 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97bc0a-4770-4a28-bba1-a1738c686018 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:06.048238 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97bc0a-4770-4a28-bba1-a1738c686018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:06.049716 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97bc0a-4770-4a28-bba1-a1738c686018 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:06.069920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-bf97bc0a-4770-4a28-bba1-a1738c686018 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:06.069920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:06.069920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:06.069920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:06.069920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:06.069920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:06.069920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:06.069920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:06.069920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:06.069920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:06.069920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:06.069920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:06.069920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:35:06.069920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:35:06.069920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:35:06.069920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:35:06.071054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:06.071054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:06.071054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:06.071054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:06.071054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:06.071054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:06.071054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:06.071054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:06.071054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:06.071054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:06.071054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:06.071054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:06.071054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:06.071054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:06.071054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:06.071054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:06.071054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:35:06.076640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:35:06.076640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:06.076640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:06.076640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 613/1224] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:35:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:06.076873 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13a700-2ccc-469d-bc5b-518521d5efd0 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:06.186199 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13a700-2ccc-469d-bc5b-518521d5efd0 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:06.222401 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5cff0-b0df-4102-9d9d-706ec0a3d8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:06.223012 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5cff0-b0df-4102-9d9d-706ec0a3d8eb None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:06.223320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5cff0-b0df-4102-9d9d-706ec0a3d8eb None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:06.223598 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5cff0-b0df-4102-9d9d-706ec0a3d8eb None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:06.224243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5cff0-b0df-4102-9d9d-706ec0a3d8eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:06.224547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5cff0-b0df-4102-9d9d-706ec0a3d8eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:06.225969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5cff0-b0df-4102-9d9d-706ec0a3d8eb None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:06.241122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 612/1225] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:06.245483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97bc0a-4770-4a28-bba1-a1738c686018 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:06.349661 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:06.358288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97bc0a-4770-4a28-bba1-a1738c686018 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:06.405049 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f6dd9-d693-4ab3-8e66-416140a56cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:06.405898 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6dd9-d693-4ab3-8e66-416140a56cfc None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:06.406205 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6dd9-d693-4ab3-8e66-416140a56cfc None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:06.406735 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6dd9-d693-4ab3-8e66-416140a56cfc None admin] PATH_INFO: `/v3/users/placement` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:06.416451 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f6dd9-d693-4ab3-8e66-416140a56cfc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:06.418278 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f6dd9-d693-4ab3-8e66-416140a56cfc None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:06.431353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-d77f6dd9-d693-4ab3-8e66-416140a56cfc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:35:06.431353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:06.431353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:06.431353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:06.431353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:06.431353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:06.431353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:06.431353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:06.431353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:06.431353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:06.431353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:06.431353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:06.431353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:35:06.431353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:35:06.431353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:35:06.431353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:35:06.432389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:06.432389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:06.432389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:35:06.432389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:35:06.432389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:35:06.432389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:35:06.432389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:06.432389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:06.432389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:06.432389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:06.432389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:06.432389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:06.432389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:06.432389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:06.432389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:06.432389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:06.432389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:06.432389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:06.433332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:06.433332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:06.433332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:35:06.433332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:35:06.433332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:35:06.433332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:35:06.433332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:35:06.433332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:35:06.433332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:35:06.433332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:06.433332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 614/1226] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:35:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:06.439102 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5cff0-b0df-4102-9d9d-706ec0a3d8eb None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:06.492482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:06.553151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5cff0-b0df-4102-9d9d-706ec0a3d8eb None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:06.593920 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875f88f-1a0a-407c-a198-1beb9453fb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:06.594524 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875f88f-1a0a-407c-a198-1beb9453fb32 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:06.594814 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875f88f-1a0a-407c-a198-1beb9453fb32 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:06.595081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875f88f-1a0a-407c-a198-1beb9453fb32 None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:06.595811 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875f88f-1a0a-407c-a198-1beb9453fb32 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:06.596119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875f88f-1a0a-407c-a198-1beb9453fb32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:06.597567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875f88f-1a0a-407c-a198-1beb9453fb32 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:06.621349 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 613/1227] 10.222.0.58 () {56 vars in 1143 bytes} [Wed Aug 24 09:35:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:06.622520 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f6dd9-d693-4ab3-8e66-416140a56cfc None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:06.745905 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f6dd9-d693-4ab3-8e66-416140a56cfc None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:06.791164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cdf9b-9387-41ae-82e6-18d98b846ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:06.791829 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cdf9b-9387-41ae-82e6-18d98b846ef2 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:06.792121 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cdf9b-9387-41ae-82e6-18d98b846ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:06.792390 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cdf9b-9387-41ae-82e6-18d98b846ef2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:06.805129 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cdf9b-9387-41ae-82e6-18d98b846ef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:06.806622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cdf9b-9387-41ae-82e6-18d98b846ef2 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:06.826643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-410cdf9b-9387-41ae-82e6-18d98b846ef2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:06.826643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:06.826643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:06.826643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:06.826643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:06.826643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:06.826643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:06.826643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:06.826643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:06.826643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:06.826643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:06.826643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:06.826643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:35:06.826643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:35:06.826643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:35:06.826643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:35:06.827820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:06.827820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:06.827820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:06.827820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:06.827820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:06.827820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:06.827820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:06.827820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:06.827820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:06.827820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:06.827820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:06.827820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:06.827820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:06.827820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:06.827820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:06.827820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:06.827820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:35:06.829172 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:35:06.829172 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:06.829172 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:06.829172 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 615/1228] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:35:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:06.833906 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875f88f-1a0a-407c-a198-1beb9453fb32 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:06.943618 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875f88f-1a0a-407c-a198-1beb9453fb32 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:06.946006 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:06.979515 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005904fa-961d-4c00-924f-92db2935d29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:06.980125 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005904fa-961d-4c00-924f-92db2935d29f None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:06.980406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005904fa-961d-4c00-924f-92db2935d29f None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:06.980680 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005904fa-961d-4c00-924f-92db2935d29f None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:06.981330 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005904fa-961d-4c00-924f-92db2935d29f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:06.981667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005904fa-961d-4c00-924f-92db2935d29f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:06.983303 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005904fa-961d-4c00-924f-92db2935d29f None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:06.995739 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 614/1229] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:07.002582 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cdf9b-9387-41ae-82e6-18d98b846ef2 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:07.012275 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:07.112247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cdf9b-9387-41ae-82e6-18d98b846ef2 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:07.150306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f9ea2-0f3d-43d9-b4b6-a5c54bf5919b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:07.151098 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f9ea2-0f3d-43d9-b4b6-a5c54bf5919b None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:07.151434 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f9ea2-0f3d-43d9-b4b6-a5c54bf5919b None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:07.151749 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f9ea2-0f3d-43d9-b4b6-a5c54bf5919b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:07.160492 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f9ea2-0f3d-43d9-b4b6-a5c54bf5919b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:07.161970 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f9ea2-0f3d-43d9-b4b6-a5c54bf5919b None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:07.176149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-415f9ea2-0f3d-43d9-b4b6-a5c54bf5919b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:35:07.176149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:07.176149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:07.176149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:07.176149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:07.176149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:07.176149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:07.176149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:07.176149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:07.176149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:07.176149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:07.176149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:07.176149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:35:07.176149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:35:07.176149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:35:07.177342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:35:07.177342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:07.177342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:07.177342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:07.177342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:07.177342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:07.177342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:07.177342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:07.177342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:07.177342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:07.177342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:07.177342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:07.177342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:07.177342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:07.177342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:07.177342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:07.177342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:07.178471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:35:07.178471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:35:07.178471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:35:07.178471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:35:07.178471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:35:07.178471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:35:07.178471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:35:07.178471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:07.179381 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 616/1230] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:35:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:07.187315 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005904fa-961d-4c00-924f-92db2935d29f None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:07.299088 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005904fa-961d-4c00-924f-92db2935d29f None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:07.335623 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a7ad7-ff93-4ff5-8d39-cc5d014a9702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:07.336330 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a7ad7-ff93-4ff5-8d39-cc5d014a9702 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:07.336609 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a7ad7-ff93-4ff5-8d39-cc5d014a9702 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:07.336885 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a7ad7-ff93-4ff5-8d39-cc5d014a9702 None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:07.337606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a7ad7-ff93-4ff5-8d39-cc5d014a9702 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:07.337914 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a7ad7-ff93-4ff5-8d39-cc5d014a9702 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:07.339344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a7ad7-ff93-4ff5-8d39-cc5d014a9702 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:07.352638 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 615/1231] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:35:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:07.359036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f9ea2-0f3d-43d9-b4b6-a5c54bf5919b None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:07.433184 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:07.474699 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f9ea2-0f3d-43d9-b4b6-a5c54bf5919b None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:07.512376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19366516-269a-4134-9c18-9520636fb1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:07.512993 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19366516-269a-4134-9c18-9520636fb1bb None admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:07.513261 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19366516-269a-4134-9c18-9520636fb1bb None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:07.513581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19366516-269a-4134-9c18-9520636fb1bb None admin] PATH_INFO: `/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/6983e364f5564ed7854dff06a80f55d2/roles/85dac7b70cf04091baaf69caabd27a8b` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:07.528883 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19366516-269a-4134-9c18-9520636fb1bb None admin] RBAC: Authorizing `identity:create_grant(project_id=1c95aafd70e547d29c7647e6027faf2f, user_id=6983e364f5564ed7854dff06a80f55d2, role_id=85dac7b70cf04091baaf69caabd27a8b)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:07.530342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19366516-269a-4134-9c18-9520636fb1bb None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:07.543425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 617/1232] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:35:07 2022] PUT /identity/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/6983e364f5564ed7854dff06a80f55d2/roles/85dac7b70cf04091baaf69caabd27a8b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:35:09.500864 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77fe48-f16b-463e-b4b0-7b074512f067 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:09.501529 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77fe48-f16b-463e-b4b0-7b074512f067 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:09.501626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77fe48-f16b-463e-b4b0-7b074512f067 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:09.502905 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 616/1233] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:35:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:35:09.508291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eda58-946f-4586-afd5-5e506cb781c4 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:09.508815 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eda58-946f-4586-afd5-5e506cb781c4 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:09.509250 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eda58-946f-4586-afd5-5e506cb781c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:09.529709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-961eda58-946f-4586-afd5-5e506cb781c4 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:35:09.530911 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-961eda58-946f-4586-afd5-5e506cb781c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:35:09.602787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 618/1234] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:35:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:35:09.954051 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77fe48-f16b-463e-b4b0-7b074512f067 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:09.981664 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:10.073610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77fe48-f16b-463e-b4b0-7b074512f067 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:10.112365 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e52070-0eb9-48ec-ae61-b8014fed3d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:10.112996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e52070-0eb9-48ec-ae61-b8014fed3d4d None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:10.113272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e52070-0eb9-48ec-ae61-b8014fed3d4d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:10.113573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e52070-0eb9-48ec-ae61-b8014fed3d4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:10.123736 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e52070-0eb9-48ec-ae61-b8014fed3d4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:35:10.129067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-a4e52070-0eb9-48ec-ae61-b8014fed3d4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:35:10.129067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:10.129067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:10.129067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:10.129067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:10.129067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:10.129067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:10.129067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:10.129067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:10.129067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:10.129067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:10.129067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:10.129067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:35:10.129067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:35:10.129067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:35:10.129067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:35:10.130239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:35:10.130239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:35:10.130239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:35:10.130239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:35:10.130239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:10.130239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:10.130239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:10.130239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:10.130239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:10.130239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:10.130239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:10.130239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:10.130239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:10.130239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:10.130239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:10.130239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:10.131295 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:10.131295 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:10.131295 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:10.131295 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:10.131295 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:35:10.131295 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:35:10.131295 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:35:10.131295 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:35:10.131295 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:35:10.131295 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:35:10.131295 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 09:35:10.131295 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:35:10.131295 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 617/1235] 10.222.0.58 () {56 vars in 1102 bytes} [Wed Aug 24 09:35:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:10.137204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961eda58-946f-4586-afd5-5e506cb781c4 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:10.189009 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:10.246728 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961eda58-946f-4586-afd5-5e506cb781c4 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:10.283944 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3e984-5009-4d4c-9538-005cf6595ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:10.284555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3e984-5009-4d4c-9538-005cf6595ff2 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:10.284829 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3e984-5009-4d4c-9538-005cf6595ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:10.285149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3e984-5009-4d4c-9538-005cf6595ff2 None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:10.285826 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3e984-5009-4d4c-9538-005cf6595ff2 None admin] RBAC: Adding query filter params (name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:10.286124 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3e984-5009-4d4c-9538-005cf6595ff2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:10.287473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3e984-5009-4d4c-9538-005cf6595ff2 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:10.296588 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 619/1236] 10.222.0.58 () {56 vars in 1103 bytes} [Wed Aug 24 09:35:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:10.303323 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e52070-0eb9-48ec-ae61-b8014fed3d4d None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:10.397890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:10.415311 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e52070-0eb9-48ec-ae61-b8014fed3d4d None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:10.455759 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c6ef7-b52b-4ec6-a26e-635a2ac2606a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:10.456400 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c6ef7-b52b-4ec6-a26e-635a2ac2606a None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:10.456680 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c6ef7-b52b-4ec6-a26e-635a2ac2606a None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:10.456956 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c6ef7-b52b-4ec6-a26e-635a2ac2606a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:10.468078 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c6ef7-b52b-4ec6-a26e-635a2ac2606a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:10.470110 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c6ef7-b52b-4ec6-a26e-635a2ac2606a None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:10.492301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-8f2c6ef7-b52b-4ec6-a26e-635a2ac2606a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:10.492301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:10.492301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:10.492301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:10.492301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:10.492301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:10.492301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:10.492301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:10.492301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:10.492301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:10.492301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:10.492301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:10.492301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:35:10.492301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:35:10.492301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:35:10.492301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:35:10.493510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:10.493510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:10.493510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:10.493510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:10.493510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:10.493510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:10.493510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:10.493510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:10.493510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:10.493510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:10.493510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:10.493510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:10.493510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:10.493510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:10.493510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:10.493510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:10.493510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:35:10.494580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:35:10.494580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:10.494580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:35:10.494580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 618/1237] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:35:10.499449 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3e984-5009-4d4c-9538-005cf6595ff2 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:10.608832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3e984-5009-4d4c-9538-005cf6595ff2 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:10.619448 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:10.650028 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce686dc7-61d0-4a5a-a4e3-b2104ca6c2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:10.650653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce686dc7-61d0-4a5a-a4e3-b2104ca6c2b4 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:10.650922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce686dc7-61d0-4a5a-a4e3-b2104ca6c2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:10.651202 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce686dc7-61d0-4a5a-a4e3-b2104ca6c2b4 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:10.651852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce686dc7-61d0-4a5a-a4e3-b2104ca6c2b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:10.652154 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce686dc7-61d0-4a5a-a4e3-b2104ca6c2b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:10.653542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce686dc7-61d0-4a5a-a4e3-b2104ca6c2b4 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:10.666199 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 620/1238] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:10.673105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c6ef7-b52b-4ec6-a26e-635a2ac2606a None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:10.791078 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c6ef7-b52b-4ec6-a26e-635a2ac2606a None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:10.832293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2baaa-a617-4de1-bd64-0230168db770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:10.832926 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2baaa-a617-4de1-bd64-0230168db770 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:10.833206 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2baaa-a617-4de1-bd64-0230168db770 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:10.833504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2baaa-a617-4de1-bd64-0230168db770 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:10.836237 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:10.841577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2baaa-a617-4de1-bd64-0230168db770 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:10.843187 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2baaa-a617-4de1-bd64-0230168db770 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:10.854884 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-e8f2baaa-a617-4de1-bd64-0230168db770 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:35:10.854884 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:10.854884 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:10.854884 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:10.854884 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:10.854884 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:10.854884 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:10.854884 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:10.854884 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:10.854884 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:10.854884 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:10.854884 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:10.854884 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:35:10.854884 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:35:10.854884 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:35:10.854884 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:35:10.856068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:10.856068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:10.856068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:35:10.856068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:35:10.856068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:35:10.856068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:35:10.856068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:10.856068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:10.856068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:10.856068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:10.856068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:10.856068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:10.856068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:10.856068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:10.856068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:10.856068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:10.856068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:10.856068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:10.857483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:10.857483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:10.857483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:35:10.857483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:35:10.857483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:35:10.857483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:35:10.857483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:35:10.857483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:35:10.857483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:35:10.857483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:35:10.857483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 619/1239] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:35:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:10.862685 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce686dc7-61d0-4a5a-a4e3-b2104ca6c2b4 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:10.964751 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce686dc7-61d0-4a5a-a4e3-b2104ca6c2b4 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:11.003832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68468f4-316f-4760-ac3d-013ef8f62761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:11.004452 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68468f4-316f-4760-ac3d-013ef8f62761 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:11.004731 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68468f4-316f-4760-ac3d-013ef8f62761 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:11.005007 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68468f4-316f-4760-ac3d-013ef8f62761 None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:11.005780 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68468f4-316f-4760-ac3d-013ef8f62761 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:11.006083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68468f4-316f-4760-ac3d-013ef8f62761 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:11.007584 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68468f4-316f-4760-ac3d-013ef8f62761 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:11.025617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 621/1240] 10.222.0.58 () {56 vars in 1143 bytes} [Wed Aug 24 09:35:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:11.031567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2baaa-a617-4de1-bd64-0230168db770 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:11.143344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2baaa-a617-4de1-bd64-0230168db770 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:11.181867 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316b6c4-0124-4699-b80d-31665d20274d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:11.182470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316b6c4-0124-4699-b80d-31665d20274d None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:11.182747 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316b6c4-0124-4699-b80d-31665d20274d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:11.183018 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316b6c4-0124-4699-b80d-31665d20274d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:11.256390 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:11.263555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316b6c4-0124-4699-b80d-31665d20274d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:11.265006 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316b6c4-0124-4699-b80d-31665d20274d None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:11.391117 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 620/1241] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:35:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 09:35:11.397339 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68468f4-316f-4760-ac3d-013ef8f62761 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:11.430873 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:11.523794 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68468f4-316f-4760-ac3d-013ef8f62761 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:11.568119 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432952d-1ef0-4e04-9ec0-29f37e08b86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:11.568750 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432952d-1ef0-4e04-9ec0-29f37e08b86a None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:11.569034 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432952d-1ef0-4e04-9ec0-29f37e08b86a None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:11.569524 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432952d-1ef0-4e04-9ec0-29f37e08b86a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:11.583639 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432952d-1ef0-4e04-9ec0-29f37e08b86a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:11.585277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432952d-1ef0-4e04-9ec0-29f37e08b86a None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:11.603036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-c432952d-1ef0-4e04-9ec0-29f37e08b86a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:11.603036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:11.603036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:11.603036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:11.603036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:11.603036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:11.603036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:11.603036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:11.603036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:11.603036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:11.603036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:11.603036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:11.603036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:35:11.603036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:35:11.603036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:35:11.603036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:35:11.604531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:11.604531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:11.604531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:11.604531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:11.604531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:11.604531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:11.604531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:11.604531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:11.604531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:11.604531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:11.604531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:11.604531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:11.604531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:11.604531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:11.604531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:11.604531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:11.604531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:35:11.605531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:35:11.605531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:11.605531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:11.605531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 622/1242] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:35:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:35:11.612835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316b6c4-0124-4699-b80d-31665d20274d None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:11.714400 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:11.721569 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316b6c4-0124-4699-b80d-31665d20274d None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:11.762912 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9955458-bbb2-4185-a20b-0409a3f379ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:11.763996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9955458-bbb2-4185-a20b-0409a3f379ce None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:11.764274 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9955458-bbb2-4185-a20b-0409a3f379ce None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:11.764559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9955458-bbb2-4185-a20b-0409a3f379ce None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:11.765280 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9955458-bbb2-4185-a20b-0409a3f379ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:11.765666 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9955458-bbb2-4185-a20b-0409a3f379ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:11.767074 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9955458-bbb2-4185-a20b-0409a3f379ce None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:11.780649 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 621/1243] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:11.787041 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432952d-1ef0-4e04-9ec0-29f37e08b86a None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:11.882000 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:11.909307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432952d-1ef0-4e04-9ec0-29f37e08b86a None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:11.945541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28bc9e-6dc9-49a1-957d-9fc41258648b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:11.946172 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28bc9e-6dc9-49a1-957d-9fc41258648b None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:11.946483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28bc9e-6dc9-49a1-957d-9fc41258648b None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:11.946760 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28bc9e-6dc9-49a1-957d-9fc41258648b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:11.953852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28bc9e-6dc9-49a1-957d-9fc41258648b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:11.955269 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28bc9e-6dc9-49a1-957d-9fc41258648b None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:11.968282 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-ec28bc9e-6dc9-49a1-957d-9fc41258648b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:35:11.968282 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:11.968282 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:11.968282 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:11.968282 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:11.968282 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:11.968282 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:11.968282 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:11.968282 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:11.968282 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:11.968282 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:11.968282 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:11.968282 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:35:11.968282 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:35:11.968282 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:35:11.969802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:35:11.969802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:11.969802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:11.969802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:11.969802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:11.969802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:11.969802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:11.969802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:11.969802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:11.969802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:11.969802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:11.969802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:11.969802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:11.969802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:11.969802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:11.969802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:11.969802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:11.970847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:35:11.970847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:35:11.970847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:35:11.970847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:35:11.970847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:35:11.970847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:35:11.970847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:35:11.970847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:11.970847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 623/1244] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:35:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:35:11.976365 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9955458-bbb2-4185-a20b-0409a3f379ce None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:12.101048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9955458-bbb2-4185-a20b-0409a3f379ce None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:12.138931 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf99e0b-be73-4314-aa38-1189fa774906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:12.139840 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf99e0b-be73-4314-aa38-1189fa774906 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:12.140195 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf99e0b-be73-4314-aa38-1189fa774906 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:12.140660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf99e0b-be73-4314-aa38-1189fa774906 None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:12.141759 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf99e0b-be73-4314-aa38-1189fa774906 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:12.142294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf99e0b-be73-4314-aa38-1189fa774906 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:12.144286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf99e0b-be73-4314-aa38-1189fa774906 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:12.159516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 622/1245] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:35:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:12.166604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28bc9e-6dc9-49a1-957d-9fc41258648b None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:12.278160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28bc9e-6dc9-49a1-957d-9fc41258648b None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:12.315085 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51601a11-e19a-465f-a34a-dabdd9b17b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:12.315680 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51601a11-e19a-465f-a34a-dabdd9b17b71 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:12.315960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51601a11-e19a-465f-a34a-dabdd9b17b71 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:12.316239 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51601a11-e19a-465f-a34a-dabdd9b17b71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:12.317016 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51601a11-e19a-465f-a34a-dabdd9b17b71 None admin] RBAC: Adding query filter params (role.id=85dac7b70cf04091baaf69caabd27a8b, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=6983e364f5564ed7854dff06a80f55d2) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:12.317332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51601a11-e19a-465f-a34a-dabdd9b17b71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:12.318790 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51601a11-e19a-465f-a34a-dabdd9b17b71 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:12.326541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 624/1246] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:35:12 2022] GET /identity/v3/role_assignments?user.id=6983e364f5564ed7854dff06a80f55d2&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=85dac7b70cf04091baaf69caabd27a8b => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:14.503905 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b3432-ac6d-4848-b06d-50ab77352a71 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:14.504483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b3432-ac6d-4848-b06d-50ab77352a71 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:14.504617 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b3432-ac6d-4848-b06d-50ab77352a71 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:14.506677 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 623/1247] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:35:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:35:14.512165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab889e-74d8-4761-8cd7-5489204dd97e None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:14.512657 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab889e-74d8-4761-8cd7-5489204dd97e None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:14.512832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab889e-74d8-4761-8cd7-5489204dd97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:14.520018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:14.534454 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-9cab889e-74d8-4761-8cd7-5489204dd97e None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:35:14.535646 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-9cab889e-74d8-4761-8cd7-5489204dd97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:35:14.605716 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 625/1248] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:35:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:35:14.890907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b3432-ac6d-4848-b06d-50ab77352a71 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:14.914059 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:15.008802 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b3432-ac6d-4848-b06d-50ab77352a71 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:15.053204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c209b-0068-4d53-97c4-08b5131f943d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:15.053883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c209b-0068-4d53-97c4-08b5131f943d None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:15.054165 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c209b-0068-4d53-97c4-08b5131f943d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:15.054417 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c209b-0068-4d53-97c4-08b5131f943d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:15.068548 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c209b-0068-4d53-97c4-08b5131f943d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:35:15.073379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-cd8c209b-0068-4d53-97c4-08b5131f943d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:35:15.073379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:15.073379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:15.073379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:15.073379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:15.073379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:15.073379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:15.073379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:15.073379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:15.073379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:15.073379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:15.073379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:15.073379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:35:15.073379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:35:15.073379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:35:15.073379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:35:15.081888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:35:15.081888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:35:15.081888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:35:15.081888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:35:15.081888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:15.081888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:15.081888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:15.081888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:15.081888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:15.081888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:15.081888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:15.081888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:15.081888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:15.081888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:15.081888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:15.081888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:15.083066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:15.083066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:15.083066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:15.083066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:15.083066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:35:15.083066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:35:15.083066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:35:15.083066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:35:15.083066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:35:15.083066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:35:15.083066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:35:15.083066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:35:15.083066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 624/1249] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:35:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:15.084261 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab889e-74d8-4761-8cd7-5489204dd97e None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:15.189932 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab889e-74d8-4761-8cd7-5489204dd97e None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:15.222313 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:15.228998 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde56cf-543f-4dfd-9ea8-d292b3a5612f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:15.229650 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde56cf-543f-4dfd-9ea8-d292b3a5612f None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:15.229932 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde56cf-543f-4dfd-9ea8-d292b3a5612f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:15.230206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde56cf-543f-4dfd-9ea8-d292b3a5612f None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:15.230876 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde56cf-543f-4dfd-9ea8-d292b3a5612f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:15.231179 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde56cf-543f-4dfd-9ea8-d292b3a5612f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:15.232538 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde56cf-543f-4dfd-9ea8-d292b3a5612f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:15.246259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 626/1250] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:35:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:15.247247 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c209b-0068-4d53-97c4-08b5131f943d None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:15.334676 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:15.361961 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c209b-0068-4d53-97c4-08b5131f943d None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:15.400292 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e13823-3512-4558-bfda-77d1a6a2a7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:15.400969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e13823-3512-4558-bfda-77d1a6a2a7cb None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:15.401255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e13823-3512-4558-bfda-77d1a6a2a7cb None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:15.401632 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e13823-3512-4558-bfda-77d1a6a2a7cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:15.412892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e13823-3512-4558-bfda-77d1a6a2a7cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:15.414369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e13823-3512-4558-bfda-77d1a6a2a7cb None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:15.429156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-12e13823-3512-4558-bfda-77d1a6a2a7cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:15.429156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:15.429156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:15.429156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:15.429156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:15.429156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:15.429156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:15.429156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:15.429156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:15.429156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:15.429156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:15.429156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:15.429156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:35:15.429156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:35:15.429156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:35:15.429156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:35:15.430446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:15.430446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:15.430446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:15.430446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:15.430446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:15.430446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:15.430446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:15.430446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:15.430446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:15.430446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:15.430446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:15.430446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:15.430446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:15.430446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:15.430446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:15.430446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:15.430446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:35:15.431369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:35:15.431369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:15.431369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:35:15.431369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 625/1251] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 09:35:15.436347 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde56cf-543f-4dfd-9ea8-d292b3a5612f None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:15.545785 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde56cf-543f-4dfd-9ea8-d292b3a5612f None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:15.583437 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326b424-c18c-40f7-9561-300bc7c0cfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:15.584046 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326b424-c18c-40f7-9561-300bc7c0cfa4 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:15.584348 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326b424-c18c-40f7-9561-300bc7c0cfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:15.584626 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a326b424-c18c-40f7-9561-300bc7c0cfa4 None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:15.585265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326b424-c18c-40f7-9561-300bc7c0cfa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:15.585598 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326b424-c18c-40f7-9561-300bc7c0cfa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:15.587198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a326b424-c18c-40f7-9561-300bc7c0cfa4 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:15.601046 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 627/1252] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:15.607260 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e13823-3512-4558-bfda-77d1a6a2a7cb None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:15.718529 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e13823-3512-4558-bfda-77d1a6a2a7cb None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:15.747255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:15.757159 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558379d5-3db4-4d38-bb3d-34e3c703fe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:15.757777 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558379d5-3db4-4d38-bb3d-34e3c703fe1f None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:15.758056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558379d5-3db4-4d38-bb3d-34e3c703fe1f None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:15.758327 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558379d5-3db4-4d38-bb3d-34e3c703fe1f None admin] PATH_INFO: `/v3/users/placement` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:15.766591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558379d5-3db4-4d38-bb3d-34e3c703fe1f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:15.768035 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558379d5-3db4-4d38-bb3d-34e3c703fe1f None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:15.782393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-558379d5-3db4-4d38-bb3d-34e3c703fe1f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:35:15.782393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:15.782393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:15.782393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:15.782393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:15.782393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:15.782393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:15.782393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:15.782393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:15.782393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:15.782393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:15.782393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:15.782393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:35:15.782393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:35:15.782393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:35:15.782393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:35:15.783582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:15.783582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:15.783582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:35:15.783582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:35:15.783582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:35:15.783582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:35:15.783582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:15.783582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:15.783582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:15.783582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:15.783582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:15.783582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:15.783582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:15.783582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:15.783582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:15.783582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:15.783582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:15.783582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:15.789504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:15.789504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:15.789504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:35:15.789504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:35:15.789504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:35:15.789504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:35:15.789504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:35:15.789504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:35:15.789504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:35:15.789504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:35:15.789504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 626/1253] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:35:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:15.791335 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326b424-c18c-40f7-9561-300bc7c0cfa4 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:15.858182 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:15.914164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a326b424-c18c-40f7-9561-300bc7c0cfa4 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:15.952483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4f1ac-c97c-44e9-a1f5-3d88524a8158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:15.953165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4f1ac-c97c-44e9-a1f5-3d88524a8158 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:15.953496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4f1ac-c97c-44e9-a1f5-3d88524a8158 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:15.953903 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4f1ac-c97c-44e9-a1f5-3d88524a8158 None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:15.954720 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4f1ac-c97c-44e9-a1f5-3d88524a8158 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:15.955102 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4f1ac-c97c-44e9-a1f5-3d88524a8158 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:15.956729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4f1ac-c97c-44e9-a1f5-3d88524a8158 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:15.976570 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 628/1254] 10.222.0.58 () {56 vars in 1143 bytes} [Wed Aug 24 09:35:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:15.982503 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558379d5-3db4-4d38-bb3d-34e3c703fe1f None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:16.110076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558379d5-3db4-4d38-bb3d-34e3c703fe1f None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:16.149334 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50748370-4ac8-4d22-b879-6422bd1df1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:16.150021 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50748370-4ac8-4d22-b879-6422bd1df1bc None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:16.150300 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50748370-4ac8-4d22-b879-6422bd1df1bc None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:16.150663 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50748370-4ac8-4d22-b879-6422bd1df1bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:16.217105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:16.233821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50748370-4ac8-4d22-b879-6422bd1df1bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:16.235946 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50748370-4ac8-4d22-b879-6422bd1df1bc None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:16.342450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 627/1255] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:35:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 09:35:16.349043 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4f1ac-c97c-44e9-a1f5-3d88524a8158 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:16.455116 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4f1ac-c97c-44e9-a1f5-3d88524a8158 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:16.469802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:16.492560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db89b8-6e3e-400f-8e09-f85caccf0231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:16.493207 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db89b8-6e3e-400f-8e09-f85caccf0231 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:16.493507 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db89b8-6e3e-400f-8e09-f85caccf0231 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:16.493789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db89b8-6e3e-400f-8e09-f85caccf0231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:16.504915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db89b8-6e3e-400f-8e09-f85caccf0231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:16.506417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db89b8-6e3e-400f-8e09-f85caccf0231 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:16.523035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-65db89b8-6e3e-400f-8e09-f85caccf0231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:16.523035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:16.523035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:16.523035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:16.523035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:16.523035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:16.523035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:16.523035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:16.523035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:16.523035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:16.523035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:16.523035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:16.523035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:35:16.523035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:35:16.523035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:35:16.523035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:35:16.524247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:16.524247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:16.524247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:16.524247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:16.524247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:16.524247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:16.524247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:16.524247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:16.524247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:16.524247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:16.524247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:16.524247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:16.524247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:16.524247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:16.524247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:16.524247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:16.524247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:35:16.525378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:35:16.525378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:16.525378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:16.525378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 629/1256] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:35:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:16.530060 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50748370-4ac8-4d22-b879-6422bd1df1bc None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:16.621395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:16.634807 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50748370-4ac8-4d22-b879-6422bd1df1bc None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:16.670434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08215706-5bac-4408-8c24-4c61eaee44dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:16.671041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08215706-5bac-4408-8c24-4c61eaee44dc None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:16.671324 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08215706-5bac-4408-8c24-4c61eaee44dc None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:16.672231 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08215706-5bac-4408-8c24-4c61eaee44dc None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:16.672989 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08215706-5bac-4408-8c24-4c61eaee44dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:16.673296 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08215706-5bac-4408-8c24-4c61eaee44dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:16.674698 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08215706-5bac-4408-8c24-4c61eaee44dc None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:16.686512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 628/1257] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:16.692712 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db89b8-6e3e-400f-8e09-f85caccf0231 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:16.810183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db89b8-6e3e-400f-8e09-f85caccf0231 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:16.846761 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50daf49a-bd68-439a-a1f1-6995f213c2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:16.847384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50daf49a-bd68-439a-a1f1-6995f213c2d8 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:16.847662 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50daf49a-bd68-439a-a1f1-6995f213c2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:16.847931 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50daf49a-bd68-439a-a1f1-6995f213c2d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:16.854576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50daf49a-bd68-439a-a1f1-6995f213c2d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:16.855983 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50daf49a-bd68-439a-a1f1-6995f213c2d8 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:16.867566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-50daf49a-bd68-439a-a1f1-6995f213c2d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:35:16.867566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:16.867566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:16.867566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:16.867566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:16.867566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:16.867566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:16.867566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:16.867566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:16.867566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:16.867566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:16.867566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:16.867566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:35:16.867566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:35:16.867566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:35:16.868620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:35:16.868620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:16.868620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:16.868620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:16.868620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:16.868620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:16.868620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:16.868620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:16.868620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:16.868620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:16.868620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:16.868620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:16.868620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:16.868620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:16.868620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:16.868620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:16.868620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:16.869581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:35:16.869581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:35:16.869581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:35:16.869581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:35:16.869581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:35:16.869581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:35:16.869581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:35:16.869581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:16.869581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 630/1258] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:35:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:16.874600 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08215706-5bac-4408-8c24-4c61eaee44dc None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:16.971668 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08215706-5bac-4408-8c24-4c61eaee44dc None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:17.004094 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c1084-c137-4ec9-9e07-d9e3f12e2bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:17.004684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c1084-c137-4ec9-9e07-d9e3f12e2bd7 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:17.004960 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c1084-c137-4ec9-9e07-d9e3f12e2bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:17.005226 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c1084-c137-4ec9-9e07-d9e3f12e2bd7 None admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:17.005927 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c1084-c137-4ec9-9e07-d9e3f12e2bd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:17.006227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c1084-c137-4ec9-9e07-d9e3f12e2bd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:17.007633 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c1084-c137-4ec9-9e07-d9e3f12e2bd7 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:17.019897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 629/1259] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:35:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:17.025930 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50daf49a-bd68-439a-a1f1-6995f213c2d8 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:17.051755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:17.129486 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50daf49a-bd68-439a-a1f1-6995f213c2d8 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:17.161987 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea023843-b9ca-43f0-8e5b-70eed3f687aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:17.162574 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea023843-b9ca-43f0-8e5b-70eed3f687aa None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:17.162848 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea023843-b9ca-43f0-8e5b-70eed3f687aa None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:17.163116 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea023843-b9ca-43f0-8e5b-70eed3f687aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:17.163822 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea023843-b9ca-43f0-8e5b-70eed3f687aa None admin] RBAC: Adding query filter params (role.id=cd2effe8340d4be08a28d3a40db6979d, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=6983e364f5564ed7854dff06a80f55d2) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:17.164123 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea023843-b9ca-43f0-8e5b-70eed3f687aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:17.165542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea023843-b9ca-43f0-8e5b-70eed3f687aa None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:17.170694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 631/1260] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:35:17 2022] GET /identity/v3/role_assignments?user.id=6983e364f5564ed7854dff06a80f55d2&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=cd2effe8340d4be08a28d3a40db6979d => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:19.076300 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e3f96-81e4-4a51-8152-6c300141d34e None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:19.076870 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e3f96-81e4-4a51-8152-6c300141d34e None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:19.076870 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e3f96-81e4-4a51-8152-6c300141d34e None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:19.078312 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 630/1261] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:35:19.083436 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bc8b7-97f0-4b4e-b84b-4d3a19aba74f None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:19.083854 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bc8b7-97f0-4b4e-b84b-4d3a19aba74f None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:19.083989 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bc8b7-97f0-4b4e-b84b-4d3a19aba74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:19.101641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-7a2bc8b7-97f0-4b4e-b84b-4d3a19aba74f None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:35:19.102833 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-7a2bc8b7-97f0-4b4e-b84b-4d3a19aba74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:35:19.179545 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 632/1262] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:35:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:35:19.457425 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e3f96-81e4-4a51-8152-6c300141d34e None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:19.468795 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:19.558302 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e3f96-81e4-4a51-8152-6c300141d34e None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:19.594269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf1adb-d9cd-4114-adcd-5c1dd5c72c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:19.594886 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf1adb-d9cd-4114-adcd-5c1dd5c72c80 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:19.595163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf1adb-d9cd-4114-adcd-5c1dd5c72c80 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:19.595435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf1adb-d9cd-4114-adcd-5c1dd5c72c80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:19.605898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf1adb-d9cd-4114-adcd-5c1dd5c72c80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:35:19.610805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-2bbf1adb-d9cd-4114-adcd-5c1dd5c72c80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:35:19.610805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:19.610805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:19.610805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:19.610805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:19.610805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:19.610805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:19.610805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:19.610805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:19.610805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:19.610805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:19.610805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:19.610805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:35:19.610805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:35:19.610805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:35:19.610805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:35:19.611890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:35:19.611890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:35:19.611890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:35:19.611890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:35:19.611890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:19.611890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:19.611890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:19.611890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:19.611890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:19.611890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:19.611890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:19.611890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:19.611890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:19.611890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:19.611890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:19.611890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:19.612773 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:19.612773 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:19.612773 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:19.612773 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:19.612773 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:35:19.612773 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:35:19.612773 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:35:19.612773 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:35:19.612773 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:35:19.612773 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:35:19.612773 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:35:19.612773 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:35:19.612773 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 631/1263] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:35:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:19.617931 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bc8b7-97f0-4b4e-b84b-4d3a19aba74f None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:19.635828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:19.715558 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bc8b7-97f0-4b4e-b84b-4d3a19aba74f None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:19.748718 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec2b77-7163-4ae9-b634-2c8a3b1c8f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:19.749352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec2b77-7163-4ae9-b634-2c8a3b1c8f9d None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:19.749702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec2b77-7163-4ae9-b634-2c8a3b1c8f9d None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:19.750114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec2b77-7163-4ae9-b634-2c8a3b1c8f9d None admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:19.750936 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec2b77-7163-4ae9-b634-2c8a3b1c8f9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:19.751276 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec2b77-7163-4ae9-b634-2c8a3b1c8f9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:19.752907 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec2b77-7163-4ae9-b634-2c8a3b1c8f9d None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:19.762388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 633/1264] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:35:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:19.768861 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf1adb-d9cd-4114-adcd-5c1dd5c72c80 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:19.841375 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:19.875496 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf1adb-d9cd-4114-adcd-5c1dd5c72c80 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:19.908797 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86535eed-53de-4738-bc42-a74264938095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:19.909416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86535eed-53de-4738-bc42-a74264938095 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:19.909726 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86535eed-53de-4738-bc42-a74264938095 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:19.909998 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86535eed-53de-4738-bc42-a74264938095 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:19.919684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86535eed-53de-4738-bc42-a74264938095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:19.921107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86535eed-53de-4738-bc42-a74264938095 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:19.935626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-86535eed-53de-4738-bc42-a74264938095 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:19.935626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:19.935626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:19.935626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:19.935626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:19.935626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:19.935626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:19.935626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:19.935626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:19.935626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:19.935626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:19.935626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:19.935626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:35:19.935626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:35:19.935626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:35:19.935626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:35:19.936693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:19.936693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:19.936693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:19.936693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:19.936693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:19.936693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:19.936693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:19.936693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:19.936693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:19.936693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:19.936693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:19.936693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:19.936693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:19.936693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:19.936693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:19.936693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:19.936693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:35:19.938529 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:35:19.938529 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:19.938529 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:35:19.938529 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 632/1265] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:35:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:19.943018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec2b77-7163-4ae9-b634-2c8a3b1c8f9d None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:20.022739 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:20.041877 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec2b77-7163-4ae9-b634-2c8a3b1c8f9d None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:20.074752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770a317-c568-4c9c-8686-389e38ab0b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:20.075346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770a317-c568-4c9c-8686-389e38ab0b0f None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:20.075627 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770a317-c568-4c9c-8686-389e38ab0b0f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:20.075901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770a317-c568-4c9c-8686-389e38ab0b0f None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:20.076539 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770a317-c568-4c9c-8686-389e38ab0b0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:20.076840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770a317-c568-4c9c-8686-389e38ab0b0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:20.078882 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770a317-c568-4c9c-8686-389e38ab0b0f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:20.090408 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 634/1266] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:20.096162 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86535eed-53de-4738-bc42-a74264938095 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:20.194020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86535eed-53de-4738-bc42-a74264938095 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:20.213424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:20.227533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582887e-7bc1-4d73-9582-611b33ed75ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:20.228167 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582887e-7bc1-4d73-9582-611b33ed75ab None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:20.228448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582887e-7bc1-4d73-9582-611b33ed75ab None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:20.228725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582887e-7bc1-4d73-9582-611b33ed75ab None admin] PATH_INFO: `/v3/users/placement` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:20.236942 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582887e-7bc1-4d73-9582-611b33ed75ab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:20.238404 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582887e-7bc1-4d73-9582-611b33ed75ab None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:20.249328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-f582887e-7bc1-4d73-9582-611b33ed75ab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:35:20.249328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:20.249328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:20.249328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:20.249328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:20.249328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:20.249328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:20.249328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:20.249328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:20.249328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:20.249328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:20.249328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:20.249328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:35:20.249328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:35:20.249328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:35:20.249328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:35:20.251080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:20.251080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:20.251080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:35:20.251080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:35:20.251080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:35:20.251080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:35:20.251080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:20.251080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:20.251080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:20.251080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:20.251080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:20.251080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:20.251080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:20.251080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:20.251080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:20.251080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:20.251080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:20.251080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:20.252230 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:20.252230 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:20.252230 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:35:20.252230 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:35:20.252230 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:35:20.252230 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:35:20.252230 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:35:20.252230 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:35:20.252230 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:35:20.252230 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:35:20.252230 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 633/1267] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:35:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:20.257403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770a317-c568-4c9c-8686-389e38ab0b0f None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:20.355015 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770a317-c568-4c9c-8686-389e38ab0b0f None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:20.388820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62e71b-6fab-4905-baf6-7a17992636bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:20.389407 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62e71b-6fab-4905-baf6-7a17992636bf None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:20.389711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62e71b-6fab-4905-baf6-7a17992636bf None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:20.389992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62e71b-6fab-4905-baf6-7a17992636bf None admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:20.390825 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62e71b-6fab-4905-baf6-7a17992636bf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:20.391126 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62e71b-6fab-4905-baf6-7a17992636bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:20.392533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62e71b-6fab-4905-baf6-7a17992636bf None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:20.400872 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:20.409560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 635/1268] 10.222.0.58 () {56 vars in 1143 bytes} [Wed Aug 24 09:35:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:20.415218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582887e-7bc1-4d73-9582-611b33ed75ab None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:20.515453 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582887e-7bc1-4d73-9582-611b33ed75ab None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:20.548151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5fb16-0916-4a22-a796-e69a7aa160a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:20.548764 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5fb16-0916-4a22-a796-e69a7aa160a3 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:20.549045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5fb16-0916-4a22-a796-e69a7aa160a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:20.549318 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5fb16-0916-4a22-a796-e69a7aa160a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:20.560199 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5fb16-0916-4a22-a796-e69a7aa160a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:20.561656 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5fb16-0916-4a22-a796-e69a7aa160a3 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:20.576105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-d5e5fb16-0916-4a22-a796-e69a7aa160a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:20.576105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:20.576105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:20.576105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:20.576105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:20.576105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:20.576105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:20.576105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:20.576105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:20.576105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:20.576105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:20.576105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:20.576105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:35:20.576105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:35:20.576105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:35:20.576105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:35:20.577178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:20.577178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:20.577178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:20.577178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:20.577178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:20.577178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:20.577178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:20.577178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:20.577178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:20.577178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:20.577178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:20.577178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:20.577178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:20.577178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:20.577178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:20.577178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:20.577178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:35:20.578233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:35:20.578233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:20.578233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:35:20.578233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 634/1269] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:35:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:20.583053 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62e71b-6fab-4905-baf6-7a17992636bf None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:20.679055 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62e71b-6fab-4905-baf6-7a17992636bf None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:20.710923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af786f7-2ab2-43c8-bf54-88b2afa29d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:20.711509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af786f7-2ab2-43c8-bf54-88b2afa29d0f None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:20.711786 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af786f7-2ab2-43c8-bf54-88b2afa29d0f None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:20.712057 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af786f7-2ab2-43c8-bf54-88b2afa29d0f None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:20.712681 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af786f7-2ab2-43c8-bf54-88b2afa29d0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:20.712977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af786f7-2ab2-43c8-bf54-88b2afa29d0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:20.714342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af786f7-2ab2-43c8-bf54-88b2afa29d0f None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:20.725626 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 636/1270] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:20.731232 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5fb16-0916-4a22-a796-e69a7aa160a3 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:20.767291 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:20.839257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5fb16-0916-4a22-a796-e69a7aa160a3 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:20.871744 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6746e8c-7df8-48a8-bd81-7c5f5bbbfa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:20.872362 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6746e8c-7df8-48a8-bd81-7c5f5bbbfa7f None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:20.872644 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6746e8c-7df8-48a8-bd81-7c5f5bbbfa7f None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:20.872919 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6746e8c-7df8-48a8-bd81-7c5f5bbbfa7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:20.879973 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6746e8c-7df8-48a8-bd81-7c5f5bbbfa7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:20.881399 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6746e8c-7df8-48a8-bd81-7c5f5bbbfa7f None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:20.892995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-f6746e8c-7df8-48a8-bd81-7c5f5bbbfa7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:35:20.892995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:20.892995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:20.892995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:20.892995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:20.892995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:20.892995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:20.892995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:20.892995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:20.892995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:20.892995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:20.892995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:20.892995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:35:20.892995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:35:20.892995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:35:20.894046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:35:20.894046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:20.894046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:20.894046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:20.894046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:20.894046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:20.894046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:20.894046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:20.894046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:20.894046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:20.894046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:20.894046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:20.894046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:20.894046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:20.894046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:20.894046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:20.894046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:20.895051 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:35:20.895051 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:35:20.895051 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:35:20.895051 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:35:20.895051 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:35:20.895051 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:35:20.895051 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:35:20.895051 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:35:20.895051 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 635/1271] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:35:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:20.900032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af786f7-2ab2-43c8-bf54-88b2afa29d0f None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:20.959776 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:21.002203 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af786f7-2ab2-43c8-bf54-88b2afa29d0f None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:21.034971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196dfcb-1614-44c1-a534-716edf81fd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:21.035567 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196dfcb-1614-44c1-a534-716edf81fd29 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:21.035847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196dfcb-1614-44c1-a534-716edf81fd29 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:21.036121 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196dfcb-1614-44c1-a534-716edf81fd29 None admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:21.036802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196dfcb-1614-44c1-a534-716edf81fd29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:21.037105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196dfcb-1614-44c1-a534-716edf81fd29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:21.038554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196dfcb-1614-44c1-a534-716edf81fd29 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:21.050935 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 637/1272] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:35:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:21.056961 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6746e8c-7df8-48a8-bd81-7c5f5bbbfa7f None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:21.146634 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:21.155991 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6746e8c-7df8-48a8-bd81-7c5f5bbbfa7f None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:21.189778 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e96b1-0997-4e68-80eb-5e91891dca95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:21.190449 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e96b1-0997-4e68-80eb-5e91891dca95 None admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:21.190726 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e96b1-0997-4e68-80eb-5e91891dca95 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:21.190999 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e96b1-0997-4e68-80eb-5e91891dca95 None admin] PATH_INFO: `/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/6983e364f5564ed7854dff06a80f55d2/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:21.192874 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e96b1-0997-4e68-80eb-5e91891dca95 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c95aafd70e547d29c7647e6027faf2f, user_id=6983e364f5564ed7854dff06a80f55d2, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:21.194320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e96b1-0997-4e68-80eb-5e91891dca95 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:21.206683 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 636/1273] 10.222.0.58 () {58 vars in 1439 bytes} [Wed Aug 24 09:35:21 2022] PUT /identity/v3/projects/1c95aafd70e547d29c7647e6027faf2f/users/6983e364f5564ed7854dff06a80f55d2/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:35:23.075000 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37848f8b-0f2b-4618-b9a6-85cbc6c90e5b None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:23.075561 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37848f8b-0f2b-4618-b9a6-85cbc6c90e5b None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:23.075561 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37848f8b-0f2b-4618-b9a6-85cbc6c90e5b None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:23.076866 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 638/1274] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:35:23.082612 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c3ba5-c32d-443b-9700-c20955b4d358 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:23.083041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c3ba5-c32d-443b-9700-c20955b4d358 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:23.083174 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c3ba5-c32d-443b-9700-c20955b4d358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:23.100967 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-bb8c3ba5-c32d-443b-9700-c20955b4d358 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:35:23.102192 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-bb8c3ba5-c32d-443b-9700-c20955b4d358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:35:23.168091 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 637/1275] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:35:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:35:23.433430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37848f8b-0f2b-4618-b9a6-85cbc6c90e5b None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:23.531220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37848f8b-0f2b-4618-b9a6-85cbc6c90e5b None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:23.549202 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:23.571308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf03ddc-4ed9-470f-b8a3-63087034995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:23.571970 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf03ddc-4ed9-470f-b8a3-63087034995a None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:23.572253 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf03ddc-4ed9-470f-b8a3-63087034995a None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:23.572531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf03ddc-4ed9-470f-b8a3-63087034995a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:23.582642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf03ddc-4ed9-470f-b8a3-63087034995a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 09:35:23.587334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-9bf03ddc-4ed9-470f-b8a3-63087034995a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:35:23.587334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:23.587334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:23.587334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:23.587334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:23.587334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:23.587334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:23.587334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:23.587334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:23.587334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:23.587334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:23.587334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:23.587334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 09:35:23.587334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 09:35:23.587334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 09:35:23.587334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 09:35:23.588443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 09:35:23.588443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 09:35:23.588443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 09:35:23.588443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 09:35:23.588443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:23.588443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:23.588443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:23.588443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:23.588443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:23.588443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:23.588443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:23.588443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:23.588443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:23.588443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:23.588443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:23.588443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:23.589546 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:23.589546 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:23.589546 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:23.589546 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:23.589546 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 09:35:23.589546 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 09:35:23.589546 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 09:35:23.589546 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 09:35:23.589546 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 09:35:23.589546 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 09:35:23.589546 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 09:35:23.589546 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:23.589546 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 639/1276] 10.222.0.58 () {56 vars in 1096 bytes} [Wed Aug 24 09:35:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:23.594612 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c3ba5-c32d-443b-9700-c20955b4d358 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:23.684511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:23.702763 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c3ba5-c32d-443b-9700-c20955b4d358 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:23.736620 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817528f-40c1-428d-9970-de34af5f1c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:23.737218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817528f-40c1-428d-9970-de34af5f1c2b None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:23.737589 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817528f-40c1-428d-9970-de34af5f1c2b None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:23.737869 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817528f-40c1-428d-9970-de34af5f1c2b None admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:23.738529 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817528f-40c1-428d-9970-de34af5f1c2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:23.738833 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817528f-40c1-428d-9970-de34af5f1c2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:23.740188 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817528f-40c1-428d-9970-de34af5f1c2b None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:23.748003 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 638/1277] 10.222.0.58 () {56 vars in 1099 bytes} [Wed Aug 24 09:35:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:23.754089 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf03ddc-4ed9-470f-b8a3-63087034995a None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:23.862397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf03ddc-4ed9-470f-b8a3-63087034995a None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:23.896945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c66d0c-b164-4501-8c78-cf40c92c7148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:23.898115 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c66d0c-b164-4501-8c78-cf40c92c7148 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:23.898397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c66d0c-b164-4501-8c78-cf40c92c7148 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:23.898671 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c66d0c-b164-4501-8c78-cf40c92c7148 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:23.909483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c66d0c-b164-4501-8c78-cf40c92c7148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:23.910922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c66d0c-b164-4501-8c78-cf40c92c7148 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:23.925686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-d8c66d0c-b164-4501-8c78-cf40c92c7148 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:23.925686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:23.925686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:23.925686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:23.925686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:23.925686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:23.925686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:23.925686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:23.925686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:23.925686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:23.925686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:23.925686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:23.925686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:35:23.925686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:35:23.925686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:35:23.925686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:35:23.926805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:23.926805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:23.926805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:23.926805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:23.926805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:23.926805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:23.926805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:23.926805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:23.926805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:23.926805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:23.926805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:23.926805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:23.926805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:23.926805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:23.926805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:23.926805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:23.926805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:35:23.927974 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:35:23.927974 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:23.927974 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:23.929617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 640/1278] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:23.932616 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817528f-40c1-428d-9970-de34af5f1c2b None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:24.033530 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817528f-40c1-428d-9970-de34af5f1c2b None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:24.066832 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1976e-3166-404f-ab40-b50c1d56f34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:24.067427 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1976e-3166-404f-ab40-b50c1d56f34c None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:24.067709 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1976e-3166-404f-ab40-b50c1d56f34c None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:24.067986 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1976e-3166-404f-ab40-b50c1d56f34c None admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:24.068628 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1976e-3166-404f-ab40-b50c1d56f34c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:24.068938 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1976e-3166-404f-ab40-b50c1d56f34c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:24.070321 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1976e-3166-404f-ab40-b50c1d56f34c None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:24.082908 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 639/1279] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:24.088621 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c66d0c-b164-4501-8c78-cf40c92c7148 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:24.119265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:24.187934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c66d0c-b164-4501-8c78-cf40c92c7148 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:24.221796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a07ddb-76de-492a-b22a-4772cc93caba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:24.222541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a07ddb-76de-492a-b22a-4772cc93caba None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:24.222824 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a07ddb-76de-492a-b22a-4772cc93caba None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:24.223100 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a07ddb-76de-492a-b22a-4772cc93caba None admin] PATH_INFO: `/v3/users/placement` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:24.231294 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a07ddb-76de-492a-b22a-4772cc93caba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:24.233002 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a07ddb-76de-492a-b22a-4772cc93caba None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:24.248244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-53a07ddb-76de-492a-b22a-4772cc93caba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:35:24.248244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:24.248244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:24.248244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:24.248244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:24.248244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:24.248244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:24.248244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:24.248244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:24.248244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:24.248244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:24.248244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:24.248244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 09:35:24.248244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 09:35:24.248244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 09:35:24.248244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 09:35:24.249198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:24.249198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:24.249198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 09:35:24.249198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:35:24.249198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 09:35:24.249198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 09:35:24.249198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:24.249198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:24.249198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:24.249198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:24.249198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:24.249198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:24.249198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:24.249198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:24.249198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:24.249198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:24.249198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:24.249198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:24.254560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:24.254560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:24.254560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 09:35:24.254560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 09:35:24.254560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 09:35:24.254560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 09:35:24.254560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 09:35:24.254560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 09:35:24.254560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 09:35:24.254560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:24.254560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 641/1280] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:35:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:24.255419 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1976e-3166-404f-ab40-b50c1d56f34c None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:24.259202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:24.360045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1976e-3166-404f-ab40-b50c1d56f34c None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:24.394502 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e0b9a-c20c-4e09-b0ee-cd5fabac6306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:24.395108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e0b9a-c20c-4e09-b0ee-cd5fabac6306 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:24.395386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e0b9a-c20c-4e09-b0ee-cd5fabac6306 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:24.395662 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e0b9a-c20c-4e09-b0ee-cd5fabac6306 None admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:24.396389 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e0b9a-c20c-4e09-b0ee-cd5fabac6306 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:24.396695 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e0b9a-c20c-4e09-b0ee-cd5fabac6306 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:24.398143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e0b9a-c20c-4e09-b0ee-cd5fabac6306 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:24.416323 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 640/1281] 10.222.0.58 () {56 vars in 1143 bytes} [Wed Aug 24 09:35:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:24.422725 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a07ddb-76de-492a-b22a-4772cc93caba None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:24.512554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:24.522725 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a07ddb-76de-492a-b22a-4772cc93caba None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:24.554537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75565c10-e28e-46e9-a7d0-0016c1194a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:24.555129 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75565c10-e28e-46e9-a7d0-0016c1194a37 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:24.555403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75565c10-e28e-46e9-a7d0-0016c1194a37 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:24.555674 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75565c10-e28e-46e9-a7d0-0016c1194a37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:24.620159 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75565c10-e28e-46e9-a7d0-0016c1194a37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:24.621540 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75565c10-e28e-46e9-a7d0-0016c1194a37 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:24.706422 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:24.716696 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 642/1282] 10.222.0.58 () {58 vars in 1282 bytes} [Wed Aug 24 09:35:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 09:35:24.722567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e0b9a-c20c-4e09-b0ee-cd5fabac6306 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:24.785161 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:24.823960 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e0b9a-c20c-4e09-b0ee-cd5fabac6306 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:24.857101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44855773-5378-447a-85d5-5ee8999ae534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:24.858005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44855773-5378-447a-85d5-5ee8999ae534 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:24.858287 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44855773-5378-447a-85d5-5ee8999ae534 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:24.858562 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44855773-5378-447a-85d5-5ee8999ae534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:24.868895 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44855773-5378-447a-85d5-5ee8999ae534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:24.870399 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44855773-5378-447a-85d5-5ee8999ae534 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:24.884983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-44855773-5378-447a-85d5-5ee8999ae534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:24.884983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:24.884983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:24.884983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:24.884983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:24.884983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:24.884983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:24.884983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:24.884983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:24.884983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:24.884983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:24.884983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:24.884983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 09:35:24.884983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 09:35:24.884983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 09:35:24.884983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 09:35:24.890723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:24.890723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:24.890723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:24.890723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:24.890723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:24.890723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:24.890723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:24.890723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:24.890723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:24.890723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:24.890723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:24.890723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:24.890723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:24.890723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:24.890723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:24.890723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:24.890723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 09:35:24.891894 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 09:35:24.891894 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 09:35:24.891894 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:35:24.891894 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 641/1283] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:24.892182 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75565c10-e28e-46e9-a7d0-0016c1194a37 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:24.989215 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75565c10-e28e-46e9-a7d0-0016c1194a37 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:25.021770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a13e9-eb72-45e5-a728-54fae028f07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:25.022359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a13e9-eb72-45e5-a728-54fae028f07e None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:25.022634 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a13e9-eb72-45e5-a728-54fae028f07e None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:25.022903 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a13e9-eb72-45e5-a728-54fae028f07e None admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:25.023527 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a13e9-eb72-45e5-a728-54fae028f07e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:25.023821 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a13e9-eb72-45e5-a728-54fae028f07e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:25.025157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a13e9-eb72-45e5-a728-54fae028f07e None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:25.035960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 643/1284] 10.222.0.58 () {56 vars in 1109 bytes} [Wed Aug 24 09:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:25.041675 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44855773-5378-447a-85d5-5ee8999ae534 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:25.139496 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44855773-5378-447a-85d5-5ee8999ae534 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:25.152756 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:25.173649 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3349c2c-d782-46bc-b164-27f37fb1d145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:25.174266 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3349c2c-d782-46bc-b164-27f37fb1d145 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:25.174547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3349c2c-d782-46bc-b164-27f37fb1d145 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:25.174820 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3349c2c-d782-46bc-b164-27f37fb1d145 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:25.181259 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3349c2c-d782-46bc-b164-27f37fb1d145 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:25.182722 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3349c2c-d782-46bc-b164-27f37fb1d145 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:25.193685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application [None req-f3349c2c-d782-46bc-b164-27f37fb1d145 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:35:25.193685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:25.193685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:25.193685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:25.193685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:25.193685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:25.193685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:25.193685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:25.193685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:25.193685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:25.193685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:25.193685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:25.193685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 09:35:25.193685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 09:35:25.193685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 09:35:25.194788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 09:35:25.194788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:25.194788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:25.194788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:25.194788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:25.194788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:25.194788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:25.194788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:25.194788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:25.194788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:25.194788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:25.194788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:25.194788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:25.194788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:25.194788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:25.194788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:25.194788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:25.195889 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 09:35:25.195889 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 09:35:25.195889 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 09:35:25.195889 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 09:35:25.195889 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 09:35:25.195889 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 09:35:25.195889 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 09:35:25.195889 dv-cinder-854271-2-smb devstack@keystone.service[82884]: ERROR keystone.server.flask.application Aug 24 09:35:25.197611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 642/1285] 10.222.0.58 () {56 vars in 1111 bytes} [Wed Aug 24 09:35:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:25.200469 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a13e9-eb72-45e5-a728-54fae028f07e None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:25.251112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:25.301311 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a13e9-eb72-45e5-a728-54fae028f07e None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:25.333562 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1905420-3322-4b91-af97-92c1d6da756a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:25.334166 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1905420-3322-4b91-af97-92c1d6da756a None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:25.334448 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1905420-3322-4b91-af97-92c1d6da756a None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:25.334722 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1905420-3322-4b91-af97-92c1d6da756a None admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:25.335405 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1905420-3322-4b91-af97-92c1d6da756a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:25.335710 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1905420-3322-4b91-af97-92c1d6da756a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:25.337114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1905420-3322-4b91-af97-92c1d6da756a None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:25.349157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 644/1286] 10.222.0.58 () {56 vars in 1148 bytes} [Wed Aug 24 09:35:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:25.355251 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3349c2c-d782-46bc-b164-27f37fb1d145 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:25.463679 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3349c2c-d782-46bc-b164-27f37fb1d145 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:25.497760 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fe64f-3c35-4325-a2a7-c3ebf186f176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:25.498358 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fe64f-3c35-4325-a2a7-c3ebf186f176 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:25.498640 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fe64f-3c35-4325-a2a7-c3ebf186f176 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:25.498916 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fe64f-3c35-4325-a2a7-c3ebf186f176 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:25.499876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fe64f-3c35-4325-a2a7-c3ebf186f176 None admin] RBAC: Adding query filter params (role.id=cd2effe8340d4be08a28d3a40db6979d, scope.project.id=1c95aafd70e547d29c7647e6027faf2f, user.id=6983e364f5564ed7854dff06a80f55d2) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:25.500186 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fe64f-3c35-4325-a2a7-c3ebf186f176 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:25.501636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fe64f-3c35-4325-a2a7-c3ebf186f176 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:25.507226 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 643/1287] 10.222.0.58 () {56 vars in 1374 bytes} [Wed Aug 24 09:35:25 2022] GET /identity/v3/role_assignments?user.id=6983e364f5564ed7854dff06a80f55d2&scope.project.id=1c95aafd70e547d29c7647e6027faf2f&role.id=cd2effe8340d4be08a28d3a40db6979d => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:27.420585 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2484432-e7fc-4074-b0c7-ca320ac9dd66 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:27.421146 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2484432-e7fc-4074-b0c7-ca320ac9dd66 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:27.421244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2484432-e7fc-4074-b0c7-ca320ac9dd66 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:27.422693 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 645/1288] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:35:27.427932 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920fcd2-2442-4f21-a9ee-7c2436cc5810 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:27.428341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920fcd2-2442-4f21-a9ee-7c2436cc5810 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:27.428481 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920fcd2-2442-4f21-a9ee-7c2436cc5810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:27.452177 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-3920fcd2-2442-4f21-a9ee-7c2436cc5810 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:35:27.454925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-3920fcd2-2442-4f21-a9ee-7c2436cc5810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:35:27.487714 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:27.525591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 644/1289] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:35:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:35:27.797199 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2484432-e7fc-4074-b0c7-ca320ac9dd66 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:27.906844 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2484432-e7fc-4074-b0c7-ca320ac9dd66 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:27.917162 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:27.941528 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be06cea-7736-444c-99dc-ef1fdead37b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:27.942149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be06cea-7736-444c-99dc-ef1fdead37b4 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:27.942424 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be06cea-7736-444c-99dc-ef1fdead37b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:27.942693 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be06cea-7736-444c-99dc-ef1fdead37b4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:27.943262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be06cea-7736-444c-99dc-ef1fdead37b4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:27.944633 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be06cea-7736-444c-99dc-ef1fdead37b4 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:27.953004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-2be06cea-7736-444c-99dc-ef1fdead37b4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:35:27.953004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:27.953004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:35:27.953004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:35:27.953004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:35:27.953004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:35:27.953004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:35:27.953004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:35:27.953004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:35:27.953004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:27.953004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:35:27.953004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:27.953004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:27.953004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:27.953004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:27.953004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:27.953004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:27.954248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:27.954248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:27.954248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:27.954248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:27.954248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:27.954248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:27.954248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:35:27.954248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:35:27.954248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:35:27.954248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:35:27.954248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:27.954248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:27.954248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:27.954248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:27.954248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:27.954248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:27.955456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:27.955456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:27.955456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:27.955456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:27.955456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:27.955456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:27.955456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:27.955456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:27.955456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:27.955456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:27.955456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:35:27.955456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:35:27.955456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:35:27.955456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:27.955456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 646/1290] 10.222.0.58 () {56 vars in 1117 bytes} [Wed Aug 24 09:35:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:27.960125 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920fcd2-2442-4f21-a9ee-7c2436cc5810 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:28.056530 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920fcd2-2442-4f21-a9ee-7c2436cc5810 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:28.089812 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73e044-a4e8-4976-8853-ca1127b46d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:28.090401 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73e044-a4e8-4976-8853-ca1127b46d4a None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:28.090682 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73e044-a4e8-4976-8853-ca1127b46d4a None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:28.090957 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73e044-a4e8-4976-8853-ca1127b46d4a None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:28.091579 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73e044-a4e8-4976-8853-ca1127b46d4a None admin] RBAC: Adding query filter params (name=placement) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:28.091881 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73e044-a4e8-4976-8853-ca1127b46d4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:28.093254 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73e044-a4e8-4976-8853-ca1127b46d4a None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:28.098082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 645/1291] 10.222.0.58 () {56 vars in 1116 bytes} [Wed Aug 24 09:35:27 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:28.103678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be06cea-7736-444c-99dc-ef1fdead37b4 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:28.207397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be06cea-7736-444c-99dc-ef1fdead37b4 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:28.240139 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f1270-827c-46d0-a3cd-1fbdd1740a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:28.240739 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f1270-827c-46d0-a3cd-1fbdd1740a0d None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:28.241015 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f1270-827c-46d0-a3cd-1fbdd1740a0d None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:28.241285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f1270-827c-46d0-a3cd-1fbdd1740a0d None admin] PATH_INFO: `/v3/services` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:28.241948 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f1270-827c-46d0-a3cd-1fbdd1740a0d None admin] RBAC: Adding query filter params (type=placement) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:28.242244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f1270-827c-46d0-a3cd-1fbdd1740a0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:28.243589 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f1270-827c-46d0-a3cd-1fbdd1740a0d None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:28.247989 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 647/1292] 10.222.0.58 () {56 vars in 1116 bytes} [Wed Aug 24 09:35:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:30.168440 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7057cf-13ba-4bea-a614-599d151d27f3 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:30.168974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7057cf-13ba-4bea-a614-599d151d27f3 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:30.168974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7057cf-13ba-4bea-a614-599d151d27f3 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:30.170355 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 646/1293] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:35:30.175495 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb2c2f-5ef8-4361-85af-6fd105476a30 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:30.175904 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb2c2f-5ef8-4361-85af-6fd105476a30 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:30.176049 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb2c2f-5ef8-4361-85af-6fd105476a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:30.193777 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-2dbb2c2f-5ef8-4361-85af-6fd105476a30 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:35:30.194954 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2dbb2c2f-5ef8-4361-85af-6fd105476a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:35:30.224248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:30.261003 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 648/1294] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:35:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:35:30.531587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7057cf-13ba-4bea-a614-599d151d27f3 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:30.562505 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:30.632747 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7057cf-13ba-4bea-a614-599d151d27f3 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:30.666273 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a36ca-d51e-473d-9a37-ccc9d8559f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:30.666962 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a36ca-d51e-473d-9a37-ccc9d8559f1d None admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:30.667248 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a36ca-d51e-473d-9a37-ccc9d8559f1d None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:30.667548 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a36ca-d51e-473d-9a37-ccc9d8559f1d None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:30.668190 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a36ca-d51e-473d-9a37-ccc9d8559f1d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:30.669740 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a36ca-d51e-473d-9a37-ccc9d8559f1d None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:30.684862 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 647/1295] 10.222.0.58 () {60 vars in 1141 bytes} [Wed Aug 24 09:35:30 2022] POST /identity/v3/services => generated 246 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:35:32.601506 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01270183-abde-49d9-b666-84b12e0ccf9d None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:32.602045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01270183-abde-49d9-b666-84b12e0ccf9d None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:32.602045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01270183-abde-49d9-b666-84b12e0ccf9d None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:32.603403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 649/1296] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:35:32.610134 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45fc80-b201-472c-bb8a-6eaf7fcd7579 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:32.610525 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45fc80-b201-472c-bb8a-6eaf7fcd7579 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:32.610692 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45fc80-b201-472c-bb8a-6eaf7fcd7579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:32.629390 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-fa45fc80-b201-472c-bb8a-6eaf7fcd7579 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:35:32.630622 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-fa45fc80-b201-472c-bb8a-6eaf7fcd7579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:35:32.703113 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 648/1297] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:35:32 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:35:32.976450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01270183-abde-49d9-b666-84b12e0ccf9d None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:33.076256 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01270183-abde-49d9-b666-84b12e0ccf9d None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:33.110563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccae9e-f271-431d-aaa1-dacbe3b1cb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:33.111182 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccae9e-f271-431d-aaa1-dacbe3b1cb43 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:33.111462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccae9e-f271-431d-aaa1-dacbe3b1cb43 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:33.111736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccae9e-f271-431d-aaa1-dacbe3b1cb43 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:33.112313 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccae9e-f271-431d-aaa1-dacbe3b1cb43 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:33.113702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccae9e-f271-431d-aaa1-dacbe3b1cb43 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:33.122130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-8fccae9e-f271-431d-aaa1-dacbe3b1cb43 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:35:33.122130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:33.122130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:35:33.122130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:35:33.122130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:35:33.122130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:35:33.122130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:35:33.122130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:35:33.122130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:35:33.122130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:33.122130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:35:33.122130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:33.122130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:33.122130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:33.122130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:33.122130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:33.122130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:33.123265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:33.123265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:33.123265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:33.123265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:33.123265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:33.123265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:33.123265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:35:33.123265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:35:33.123265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:35:33.123265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:35:33.123265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:33.123265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:33.123265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:33.123265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:33.123265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:33.123265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:33.124243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:33.124243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:33.124243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:33.124243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:33.124243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:33.124243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:33.124243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:33.124243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:33.124243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:33.124243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:33.124243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:35:33.124243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:35:33.124243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:35:33.124243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:33.124243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 650/1298] 10.222.0.58 () {56 vars in 1117 bytes} [Wed Aug 24 09:35:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:33.129282 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45fc80-b201-472c-bb8a-6eaf7fcd7579 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:33.147881 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:33.227974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45fc80-b201-472c-bb8a-6eaf7fcd7579 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:33.261177 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757d377-0bb4-4aea-bd0f-64232f087933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:33.261801 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757d377-0bb4-4aea-bd0f-64232f087933 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:33.262082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757d377-0bb4-4aea-bd0f-64232f087933 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:33.262354 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757d377-0bb4-4aea-bd0f-64232f087933 None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:33.262975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757d377-0bb4-4aea-bd0f-64232f087933 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:33.263276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757d377-0bb4-4aea-bd0f-64232f087933 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:33.265135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757d377-0bb4-4aea-bd0f-64232f087933 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:33.270134 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 649/1299] 10.222.0.58 () {56 vars in 1116 bytes} [Wed Aug 24 09:35:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:33.276021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccae9e-f271-431d-aaa1-dacbe3b1cb43 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:33.307683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:33.376154 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccae9e-f271-431d-aaa1-dacbe3b1cb43 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:33.408409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a9bc4-1290-4c4c-8129-614f17f68050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:33.408989 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a9bc4-1290-4c4c-8129-614f17f68050 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:33.409267 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a9bc4-1290-4c4c-8129-614f17f68050 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:33.409566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a9bc4-1290-4c4c-8129-614f17f68050 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:33.410259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a9bc4-1290-4c4c-8129-614f17f68050 None admin] RBAC: Adding query filter params (interface=public, service_id=366d84ddda70487db6749651143d2f5b, region_id=RegionOne) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:33.410564 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a9bc4-1290-4c4c-8129-614f17f68050 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:33.411903 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a9bc4-1290-4c4c-8129-614f17f68050 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:33.416764 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 651/1300] 10.222.0.58 () {56 vars in 1251 bytes} [Wed Aug 24 09:35:33 2022] GET /identity/v3/endpoints?service_id=366d84ddda70487db6749651143d2f5b&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:35:33.422978 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757d377-0bb4-4aea-bd0f-64232f087933 None admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:33.503656 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:33.521855 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757d377-0bb4-4aea-bd0f-64232f087933 None admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:33.557300 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59578f-5ce9-4299-8097-75ecf00c113a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:33.557928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59578f-5ce9-4299-8097-75ecf00c113a None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:33.558211 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59578f-5ce9-4299-8097-75ecf00c113a None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:33.558485 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59578f-5ce9-4299-8097-75ecf00c113a None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:33.559087 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59578f-5ce9-4299-8097-75ecf00c113a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:33.560444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59578f-5ce9-4299-8097-75ecf00c113a None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:33.568147 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 650/1301] 10.222.0.58 () {56 vars in 1087 bytes} [Wed Aug 24 09:35:33 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:35:35.493225 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b0925-e3cf-45f3-99f8-019ae8fbb79b None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:35.493783 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b0925-e3cf-45f3-99f8-019ae8fbb79b None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:35.493783 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b0925-e3cf-45f3-99f8-019ae8fbb79b None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:35.495080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 652/1302] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:35:35.500876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7ddfa-080d-4b88-8f87-9fbcda47471c None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:35.501315 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7ddfa-080d-4b88-8f87-9fbcda47471c None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:35.501499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7ddfa-080d-4b88-8f87-9fbcda47471c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:35.519910 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-acc7ddfa-080d-4b88-8f87-9fbcda47471c None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:35:35.521110 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-acc7ddfa-080d-4b88-8f87-9fbcda47471c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:35:35.593482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 651/1303] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:35:35 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 09:35:35.863072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b0925-e3cf-45f3-99f8-019ae8fbb79b None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:35.960162 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:35.967405 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b0925-e3cf-45f3-99f8-019ae8fbb79b None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:36.002813 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f7790-4f1d-4c22-99d6-140e65e28316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:36.003429 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f7790-4f1d-4c22-99d6-140e65e28316 None admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:36.003737 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f7790-4f1d-4c22-99d6-140e65e28316 None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:36.004006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f7790-4f1d-4c22-99d6-140e65e28316 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:36.004575 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f7790-4f1d-4c22-99d6-140e65e28316 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:36.005955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f7790-4f1d-4c22-99d6-140e65e28316 None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:36.014399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application [None req-c93f7790-4f1d-4c22-99d6-140e65e28316 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:35:36.014399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:36.014399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 09:35:36.014399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 09:35:36.014399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 09:35:36.014399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 09:35:36.014399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 09:35:36.014399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:35:36.014399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:35:36.014399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:36.014399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 09:35:36.014399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:36.014399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 09:35:36.014399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 09:35:36.014399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 09:35:36.014399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 09:35:36.014399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 09:35:36.016073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 09:35:36.016073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 09:35:36.016073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 09:35:36.016073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 09:35:36.016073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 09:35:36.016073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 09:35:36.016073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 09:35:36.016073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 09:35:36.016073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 09:35:36.016073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 09:35:36.016073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 09:35:36.016073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 09:35:36.016073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 09:35:36.016073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 09:35:36.016073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 09:35:36.016073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 09:35:36.017105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 09:35:36.017105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application with Lock( Aug 24 09:35:36.017105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 09:35:36.017105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self._enter() Aug 24 09:35:36.017105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 09:35:36.017105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 09:35:36.017105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 09:35:36.017105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application return self.creator() Aug 24 09:35:36.017105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 09:35:36.017105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application created_value = creator( Aug 24 09:35:36.017105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 09:35:36.017105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 09:35:36.017105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 09:35:36.017105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: ERROR keystone.server.flask.application Aug 24 09:35:36.017105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 653/1304] 10.222.0.58 () {56 vars in 1117 bytes} [Wed Aug 24 09:35:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 09:35:36.022220 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7ddfa-080d-4b88-8f87-9fbcda47471c None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:36.096148 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:36.118609 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7ddfa-080d-4b88-8f87-9fbcda47471c None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:36.151512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa236cf-998f-431e-8d47-b9ec3a542356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:36.152115 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa236cf-998f-431e-8d47-b9ec3a542356 None admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:36.152398 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa236cf-998f-431e-8d47-b9ec3a542356 None admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:36.152674 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa236cf-998f-431e-8d47-b9ec3a542356 None admin] PATH_INFO: `/v3/services` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:36.153303 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa236cf-998f-431e-8d47-b9ec3a542356 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:35:36.153641 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa236cf-998f-431e-8d47-b9ec3a542356 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:36.155003 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa236cf-998f-431e-8d47-b9ec3a542356 None admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:36.160632 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 652/1305] 10.222.0.58 () {56 vars in 1116 bytes} [Wed Aug 24 09:35:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:35:36.166395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f7790-4f1d-4c22-99d6-140e65e28316 None admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:35:36.263170 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f7790-4f1d-4c22-99d6-140e65e28316 None admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:35:36.296000 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff111d-6626-43d0-8a93-845dba7d030d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:35:36.296589 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff111d-6626-43d0-8a93-845dba7d030d None admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:35:36.296870 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff111d-6626-43d0-8a93-845dba7d030d None admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:35:36.297142 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff111d-6626-43d0-8a93-845dba7d030d None admin] PATH_INFO: `/v3/endpoints` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:35:36.297830 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff111d-6626-43d0-8a93-845dba7d030d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:35:36.299179 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff111d-6626-43d0-8a93-845dba7d030d None admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:35:36.318178 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 654/1306] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:35:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:35:46.157792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=30 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:46.316582 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:40.214139 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a3e7c-1554-4c44-b5ef-e808a581a612 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:40.214581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a3e7c-1554-4c44-b5ef-e808a581a612 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:40.214802 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a3e7c-1554-4c44-b5ef-e808a581a612 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:40.221206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442d11f-db29-4985-bfc3-c19a1a29ca42 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:40.221645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442d11f-db29-4985-bfc3-c19a1a29ca42 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:40.221859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442d11f-db29-4985-bfc3-c19a1a29ca42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:40.226467 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 653/1307] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:36:40 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:36:40.396205 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-e442d11f-db29-4985-bfc3-c19a1a29ca42 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:36:40.398146 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-e442d11f-db29-4985-bfc3-c19a1a29ca42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:40.540544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 655/1308] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:36:40.853143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10777dda-731b-4a41-b519-c72016730bc4 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:40.853528 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10777dda-731b-4a41-b519-c72016730bc4 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:40.853737 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10777dda-731b-4a41-b519-c72016730bc4 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:40.855201 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 654/1309] 10.222.0.58 () {54 vars in 965 bytes} [Wed Aug 24 09:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:36:40.863121 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab0c77-0186-4308-92c7-7a830f383785 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:40.863788 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab0c77-0186-4308-92c7-7a830f383785 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:40.864274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab0c77-0186-4308-92c7-7a830f383785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:40.952581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-68ab0c77-0186-4308-92c7-7a830f383785 None None] MFA Rules not processed for user `7847dbf8f31146c5ab2136fbdb487783`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:36:40.953082 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-68ab0c77-0186-4308-92c7-7a830f383785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:40.976243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:41.039276 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 656/1310] 10.222.0.58 () {58 vars in 1062 bytes} [Wed Aug 24 09:36:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:36:41.048933 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10777dda-731b-4a41-b519-c72016730bc4 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:36:41.051385 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-10777dda-731b-4a41-b519-c72016730bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:41.186720 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10777dda-731b-4a41-b519-c72016730bc4 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:36:41.301668 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17829ec-ea3f-471c-bdef-af61044957de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:36:41.303285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17829ec-ea3f-471c-bdef-af61044957de service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:41.304055 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17829ec-ea3f-471c-bdef-af61044957de service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:41.304567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17829ec-ea3f-471c-bdef-af61044957de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:41.306714 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-d17829ec-ea3f-471c-bdef-af61044957de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:41.374340 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:41.438838 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17829ec-ea3f-471c-bdef-af61044957de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:36:41.440627 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17829ec-ea3f-471c-bdef-af61044957de service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:36:41.478557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 655/1311] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:36:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:36:43.791982 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac0d43-92fc-44b4-b88d-2c346728ddbc None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:43.792531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac0d43-92fc-44b4-b88d-2c346728ddbc None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:43.792531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac0d43-92fc-44b4-b88d-2c346728ddbc None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:43.794700 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 657/1312] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:36:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:36:43.800081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b4d2f-cedf-4309-8773-0ddf29cb7b81 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:43.800599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b4d2f-cedf-4309-8773-0ddf29cb7b81 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:43.800692 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b4d2f-cedf-4309-8773-0ddf29cb7b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:43.888581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-7e7b4d2f-cedf-4309-8773-0ddf29cb7b81 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:36:43.889446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7e7b4d2f-cedf-4309-8773-0ddf29cb7b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:43.988046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 656/1313] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:36:44.276584 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac0d43-92fc-44b4-b88d-2c346728ddbc None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:36:44.278759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-32ac0d43-92fc-44b4-b88d-2c346728ddbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:44.381328 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac0d43-92fc-44b4-b88d-2c346728ddbc None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:36:44.454630 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:44.457698 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a339a9a-2645-4f37-956d-ca313876a17b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:36:44.458505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a339a9a-2645-4f37-956d-ca313876a17b service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:44.458973 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a339a9a-2645-4f37-956d-ca313876a17b service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:44.459263 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a339a9a-2645-4f37-956d-ca313876a17b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:44.460923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-5a339a9a-2645-4f37-956d-ca313876a17b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:44.569372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a339a9a-2645-4f37-956d-ca313876a17b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:36:44.570818 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a339a9a-2645-4f37-956d-ca313876a17b service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:36:44.590858 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 658/1314] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:36:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:36:46.839669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cbc60-c663-4e17-b014-d9ed24ee4cf9 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:46.841120 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cbc60-c663-4e17-b014-d9ed24ee4cf9 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:46.841120 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cbc60-c663-4e17-b014-d9ed24ee4cf9 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:46.842207 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 657/1315] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:36:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:36:46.847431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33202180-2c68-43f4-84e2-2d84e3521816 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:46.847879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33202180-2c68-43f4-84e2-2d84e3521816 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:46.847978 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33202180-2c68-43f4-84e2-2d84e3521816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:46.914381 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-33202180-2c68-43f4-84e2-2d84e3521816 None None] MFA Rules not processed for user `293b91ba2e5e4247b3d8b1a013fc2242`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:36:46.915574 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-33202180-2c68-43f4-84e2-2d84e3521816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:46.968023 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:47.012961 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 659/1316] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:36:46 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:36:47.301544 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cbc60-c663-4e17-b014-d9ed24ee4cf9 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:36:47.303093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-059cbc60-c663-4e17-b014-d9ed24ee4cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:47.313621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:47.407211 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cbc60-c663-4e17-b014-d9ed24ee4cf9 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:36:47.480934 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df390bd5-6753-48e8-a8ee-ca362c461cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:36:47.481548 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df390bd5-6753-48e8-a8ee-ca362c461cca service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:47.481789 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df390bd5-6753-48e8-a8ee-ca362c461cca service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:47.482323 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df390bd5-6753-48e8-a8ee-ca362c461cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:47.483933 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-df390bd5-6753-48e8-a8ee-ca362c461cca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:47.545840 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:47.592631 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df390bd5-6753-48e8-a8ee-ca362c461cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:36:47.594102 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df390bd5-6753-48e8-a8ee-ca362c461cca service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:36:47.613220 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 658/1317] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:36:47 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:36:50.054093 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe833d3-5532-4e2b-a561-d82f8338acb0 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:50.054665 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe833d3-5532-4e2b-a561-d82f8338acb0 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:50.054665 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe833d3-5532-4e2b-a561-d82f8338acb0 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:50.056008 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 660/1318] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:36:50.061724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7829ba-5b21-4d44-81bf-94fee5211147 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:50.062153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7829ba-5b21-4d44-81bf-94fee5211147 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:50.062257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7829ba-5b21-4d44-81bf-94fee5211147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:50.129478 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-fc7829ba-5b21-4d44-81bf-94fee5211147 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:36:50.130725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-fc7829ba-5b21-4d44-81bf-94fee5211147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:50.225670 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 659/1319] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:36:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:36:50.510502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe833d3-5532-4e2b-a561-d82f8338acb0 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:36:50.512299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-ffe833d3-5532-4e2b-a561-d82f8338acb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:50.615976 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe833d3-5532-4e2b-a561-d82f8338acb0 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:36:50.690636 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab47917-6019-4cd1-903c-30a62d705414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:36:50.691243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab47917-6019-4cd1-903c-30a62d705414 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:50.691541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab47917-6019-4cd1-903c-30a62d705414 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:50.691794 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab47917-6019-4cd1-903c-30a62d705414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:50.693406 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-bab47917-6019-4cd1-903c-30a62d705414 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:50.701071 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:50.804070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab47917-6019-4cd1-903c-30a62d705414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:36:50.805433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab47917-6019-4cd1-903c-30a62d705414 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:36:50.823601 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 661/1320] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:36:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:36:53.384216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b58cd8-a089-4c5e-ab17-9df5168d0ab6 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:53.384778 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b58cd8-a089-4c5e-ab17-9df5168d0ab6 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:53.384778 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b58cd8-a089-4c5e-ab17-9df5168d0ab6 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:53.386161 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 660/1321] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:36:53.391543 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f576d-e128-43ff-80d6-97a17e290d60 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:53.391964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f576d-e128-43ff-80d6-97a17e290d60 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:53.392095 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f576d-e128-43ff-80d6-97a17e290d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:53.457685 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-838f576d-e128-43ff-80d6-97a17e290d60 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:36:53.458883 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-838f576d-e128-43ff-80d6-97a17e290d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:53.517733 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:53.558098 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 662/1322] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:36:53.844560 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b58cd8-a089-4c5e-ab17-9df5168d0ab6 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:36:53.846236 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-57b58cd8-a089-4c5e-ab17-9df5168d0ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:53.866424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:53.952716 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b58cd8-a089-4c5e-ab17-9df5168d0ab6 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:36:54.028426 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120cdd2e-0267-4741-878a-cc9804d24f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:36:54.028954 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cdd2e-0267-4741-878a-cc9804d24f4d service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:54.029235 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cdd2e-0267-4741-878a-cc9804d24f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:54.029547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cdd2e-0267-4741-878a-cc9804d24f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:54.031640 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-120cdd2e-0267-4741-878a-cc9804d24f4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:54.109968 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:54.147692 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120cdd2e-0267-4741-878a-cc9804d24f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:36:54.149121 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120cdd2e-0267-4741-878a-cc9804d24f4d service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:36:54.167908 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 661/1323] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:36:56.173186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a806d-b104-4d9b-b2ac-f44c3a50c468 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:56.173744 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a806d-b104-4d9b-b2ac-f44c3a50c468 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:56.173744 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a806d-b104-4d9b-b2ac-f44c3a50c468 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:56.175029 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 663/1324] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:36:56.180542 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8971287-b503-43b0-ad6c-25d3e836b7e6 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:56.180979 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8971287-b503-43b0-ad6c-25d3e836b7e6 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:56.181087 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8971287-b503-43b0-ad6c-25d3e836b7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:56.257405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-f8971287-b503-43b0-ad6c-25d3e836b7e6 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:36:56.258661 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-f8971287-b503-43b0-ad6c-25d3e836b7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:56.359699 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 662/1325] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:36:56.657574 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d91cc8-6da4-46cf-9cb9-0fb716f94938 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:56.657862 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d91cc8-6da4-46cf-9cb9-0fb716f94938 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:56.658137 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d91cc8-6da4-46cf-9cb9-0fb716f94938 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:56.659478 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 664/1326] 10.222.0.58 () {54 vars in 965 bytes} [Wed Aug 24 09:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:36:56.665230 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267ad86-fbaf-4386-bd20-e1cf26de8dc4 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:56.665557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267ad86-fbaf-4386-bd20-e1cf26de8dc4 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:56.665848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267ad86-fbaf-4386-bd20-e1cf26de8dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:56.698373 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:56.755745 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-a267ad86-fbaf-4386-bd20-e1cf26de8dc4 None None] MFA Rules not processed for user `7847dbf8f31146c5ab2136fbdb487783`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:36:56.756968 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-a267ad86-fbaf-4386-bd20-e1cf26de8dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:56.834848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 663/1327] 10.222.0.58 () {58 vars in 1062 bytes} [Wed Aug 24 09:36:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:36:56.844160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d91cc8-6da4-46cf-9cb9-0fb716f94938 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:36:56.845726 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-76d91cc8-6da4-46cf-9cb9-0fb716f94938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:56.949037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d91cc8-6da4-46cf-9cb9-0fb716f94938 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:36:57.021790 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97d58c-3890-4574-a672-58feff2a0579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:36:57.022314 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97d58c-3890-4574-a672-58feff2a0579 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:57.022597 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97d58c-3890-4574-a672-58feff2a0579 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:57.022870 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97d58c-3890-4574-a672-58feff2a0579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:57.024460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2a97d58c-3890-4574-a672-58feff2a0579 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:57.041054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:57.138076 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97d58c-3890-4574-a672-58feff2a0579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:36:57.139508 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97d58c-3890-4574-a672-58feff2a0579 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:36:57.158574 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 665/1328] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:36:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:36:59.387408 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49f36b-4ac9-48d6-9f91-f91096a5bb76 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:59.387909 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49f36b-4ac9-48d6-9f91-f91096a5bb76 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:59.388146 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49f36b-4ac9-48d6-9f91-f91096a5bb76 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:59.389596 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 664/1329] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:36:59.395170 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32a621-d3ab-4d62-a9af-affdb90bd088 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:36:59.395639 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32a621-d3ab-4d62-a9af-affdb90bd088 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:36:59.395749 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32a621-d3ab-4d62-a9af-affdb90bd088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:36:59.467709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-bb32a621-d3ab-4d62-a9af-affdb90bd088 None None] MFA Rules not processed for user `293b91ba2e5e4247b3d8b1a013fc2242`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:36:59.468918 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-bb32a621-d3ab-4d62-a9af-affdb90bd088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:59.533354 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:59.566638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 666/1330] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:36:59 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:36:59.854612 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49f36b-4ac9-48d6-9f91-f91096a5bb76 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:36:59.856265 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-0d49f36b-4ac9-48d6-9f91-f91096a5bb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:36:59.963722 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49f36b-4ac9-48d6-9f91-f91096a5bb76 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:36:59.986191 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:00.048623 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81efdbf-b4f8-42f2-b957-2cf3c4dc76c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:00.049226 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81efdbf-b4f8-42f2-b957-2cf3c4dc76c0 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:00.049570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81efdbf-b4f8-42f2-b957-2cf3c4dc76c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:00.049808 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81efdbf-b4f8-42f2-b957-2cf3c4dc76c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:00.051415 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-c81efdbf-b4f8-42f2-b957-2cf3c4dc76c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:00.173592 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81efdbf-b4f8-42f2-b957-2cf3c4dc76c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:00.175016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81efdbf-b4f8-42f2-b957-2cf3c4dc76c0 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:00.195670 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 665/1331] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:36:59 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:37:02.608875 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf99a6-643d-4049-a952-cc5cf57c1ad2 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:02.609430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf99a6-643d-4049-a952-cc5cf57c1ad2 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:02.609430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf99a6-643d-4049-a952-cc5cf57c1ad2 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:02.610833 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 667/1332] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:02.616116 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13634d-6507-42d5-b27b-23380fb50986 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:02.616553 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13634d-6507-42d5-b27b-23380fb50986 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:02.616649 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13634d-6507-42d5-b27b-23380fb50986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:02.690846 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:02.693524 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-ab13634d-6507-42d5-b27b-23380fb50986 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:02.695347 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ab13634d-6507-42d5-b27b-23380fb50986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:02.791232 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 666/1333] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:03.083887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf99a6-643d-4049-a952-cc5cf57c1ad2 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:03.085456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-8aaf99a6-643d-4049-a952-cc5cf57c1ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:03.187140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf99a6-643d-4049-a952-cc5cf57c1ad2 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:03.260582 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff14aed-6a1b-4884-b3a4-8ece62f36026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:03.261737 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff14aed-6a1b-4884-b3a4-8ece62f36026 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:03.262116 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff14aed-6a1b-4884-b3a4-8ece62f36026 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:03.262273 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff14aed-6a1b-4884-b3a4-8ece62f36026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:03.263839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-5ff14aed-6a1b-4884-b3a4-8ece62f36026 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:03.291000 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:03.373847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff14aed-6a1b-4884-b3a4-8ece62f36026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:03.375267 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff14aed-6a1b-4884-b3a4-8ece62f36026 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:03.394683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 668/1334] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:37:05.351849 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8efc1-a856-4aa9-baa5-230f6d0674d1 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:05.352382 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8efc1-a856-4aa9-baa5-230f6d0674d1 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:05.352471 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8efc1-a856-4aa9-baa5-230f6d0674d1 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:05.353813 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 667/1335] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:05.359573 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02150d3b-716b-4056-b6d7-f099622658ba None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:05.359998 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02150d3b-716b-4056-b6d7-f099622658ba None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:05.360116 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02150d3b-716b-4056-b6d7-f099622658ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:05.424613 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-02150d3b-716b-4056-b6d7-f099622658ba None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:05.425849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-02150d3b-716b-4056-b6d7-f099622658ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:05.502571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:05.527717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 669/1336] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:05.821581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8efc1-a856-4aa9-baa5-230f6d0674d1 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:05.823174 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-32d8efc1-a856-4aa9-baa5-230f6d0674d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:05.927161 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8efc1-a856-4aa9-baa5-230f6d0674d1 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:05.956066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:06.001336 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02aab57-e290-4dc1-aba7-0b94de17a068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:06.001962 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02aab57-e290-4dc1-aba7-0b94de17a068 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:06.002241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02aab57-e290-4dc1-aba7-0b94de17a068 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:06.002512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02aab57-e290-4dc1-aba7-0b94de17a068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:06.004103 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e02aab57-e290-4dc1-aba7-0b94de17a068 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:06.113059 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02aab57-e290-4dc1-aba7-0b94de17a068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:06.114516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02aab57-e290-4dc1-aba7-0b94de17a068 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:06.132479 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 668/1337] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:37:08.504827 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ec072-8323-4cbd-9e17-116202100842 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:08.505384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ec072-8323-4cbd-9e17-116202100842 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:08.505384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ec072-8323-4cbd-9e17-116202100842 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:08.506701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 670/1338] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:08.512554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353bf6a-c0b8-4b82-94d0-71e1e8e6c79d None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:08.513005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353bf6a-c0b8-4b82-94d0-71e1e8e6c79d None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:08.513101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353bf6a-c0b8-4b82-94d0-71e1e8e6c79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:08.580788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-7353bf6a-c0b8-4b82-94d0-71e1e8e6c79d None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:08.582049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7353bf6a-c0b8-4b82-94d0-71e1e8e6c79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:08.591122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:08.680194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 669/1339] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:37:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:08.973964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ec072-8323-4cbd-9e17-116202100842 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:08.975513 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-847ec072-8323-4cbd-9e17-116202100842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:09.079172 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ec072-8323-4cbd-9e17-116202100842 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:09.152545 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd83ea3-92ae-48e3-94f9-a7119f8c7c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:09.153063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd83ea3-92ae-48e3-94f9-a7119f8c7c67 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:09.153346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd83ea3-92ae-48e3-94f9-a7119f8c7c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:09.153653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd83ea3-92ae-48e3-94f9-a7119f8c7c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:09.155250 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-7fd83ea3-92ae-48e3-94f9-a7119f8c7c67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:09.189891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:09.265054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd83ea3-92ae-48e3-94f9-a7119f8c7c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:09.266520 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd83ea3-92ae-48e3-94f9-a7119f8c7c67 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:09.285597 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 671/1340] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:37:13.228888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60040f69-684b-43bd-bd8c-4b4a58c9fe8c None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:13.229335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60040f69-684b-43bd-bd8c-4b4a58c9fe8c None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:13.229510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60040f69-684b-43bd-bd8c-4b4a58c9fe8c None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:13.231148 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 670/1341] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:13.239509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d15e1-f8c8-4c20-ae2b-ddc816057587 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:13.239994 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d15e1-f8c8-4c20-ae2b-ddc816057587 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:13.240094 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d15e1-f8c8-4c20-ae2b-ddc816057587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:13.306858 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-0a3d15e1-f8c8-4c20-ae2b-ddc816057587 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:13.308699 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-0a3d15e1-f8c8-4c20-ae2b-ddc816057587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:13.394643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:13.406492 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 672/1342] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:13.697705 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60040f69-684b-43bd-bd8c-4b4a58c9fe8c None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:13.699376 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-60040f69-684b-43bd-bd8c-4b4a58c9fe8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:13.808987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60040f69-684b-43bd-bd8c-4b4a58c9fe8c None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:13.846751 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:13.884786 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de6745-37df-49e0-864c-8973e625a896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:13.885391 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de6745-37df-49e0-864c-8973e625a896 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:13.885758 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de6745-37df-49e0-864c-8973e625a896 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:13.886208 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de6745-37df-49e0-864c-8973e625a896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:13.887883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-f2de6745-37df-49e0-864c-8973e625a896 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:13.998002 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de6745-37df-49e0-864c-8973e625a896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:13.999347 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de6745-37df-49e0-864c-8973e625a896 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:14.017120 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 671/1343] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:37:16.579994 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cd1eb-9589-4498-8143-49bc478fe10c None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:16.580527 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cd1eb-9589-4498-8143-49bc478fe10c None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:16.580527 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cd1eb-9589-4498-8143-49bc478fe10c None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:16.581849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 673/1344] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:16.587306 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbd6d0-0b2b-459f-a503-088f840b6afc None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:16.587685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbd6d0-0b2b-459f-a503-088f840b6afc None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:16.587861 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbd6d0-0b2b-459f-a503-088f840b6afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:16.657993 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-eadbd6d0-0b2b-459f-a503-088f840b6afc None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:16.659221 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-eadbd6d0-0b2b-459f-a503-088f840b6afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:16.679908 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:16.767945 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 672/1345] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:37:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:17.062347 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cd1eb-9589-4498-8143-49bc478fe10c None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:17.063880 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-644cd1eb-9589-4498-8143-49bc478fe10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:17.170998 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644cd1eb-9589-4498-8143-49bc478fe10c None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:17.250630 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b90c0-bdfe-4db3-9b69-53d699ec7491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:17.251259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b90c0-bdfe-4db3-9b69-53d699ec7491 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:17.251541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b90c0-bdfe-4db3-9b69-53d699ec7491 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:17.251817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b90c0-bdfe-4db3-9b69-53d699ec7491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:17.253661 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-8f3b90c0-bdfe-4db3-9b69-53d699ec7491 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:17.306520 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:17.376470 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b90c0-bdfe-4db3-9b69-53d699ec7491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:17.377932 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b90c0-bdfe-4db3-9b69-53d699ec7491 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:17.396950 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 674/1346] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:37:21.583723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f517cfd-811a-460f-85d9-f64acc8301d7 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:21.584268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f517cfd-811a-460f-85d9-f64acc8301d7 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:21.584268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f517cfd-811a-460f-85d9-f64acc8301d7 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:21.585830 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 673/1347] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:21.591848 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431251b-45e7-4b0f-a4e9-315b04f7e686 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:21.592348 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431251b-45e7-4b0f-a4e9-315b04f7e686 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:21.592449 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431251b-45e7-4b0f-a4e9-315b04f7e686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:21.662152 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-7431251b-45e7-4b0f-a4e9-315b04f7e686 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:21.663381 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-7431251b-45e7-4b0f-a4e9-315b04f7e686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:21.764095 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:21.767069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 675/1348] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:22.054194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f517cfd-811a-460f-85d9-f64acc8301d7 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:22.055780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-3f517cfd-811a-460f-85d9-f64acc8301d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:22.165566 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f517cfd-811a-460f-85d9-f64acc8301d7 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:22.214657 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:22.248939 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333d6e7-2617-4bfa-8730-a8fd0a7882f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:22.249586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333d6e7-2617-4bfa-8730-a8fd0a7882f2 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:22.249868 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333d6e7-2617-4bfa-8730-a8fd0a7882f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:22.250141 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333d6e7-2617-4bfa-8730-a8fd0a7882f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:22.251759 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-d333d6e7-2617-4bfa-8730-a8fd0a7882f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:22.368338 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333d6e7-2617-4bfa-8730-a8fd0a7882f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:22.369876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333d6e7-2617-4bfa-8730-a8fd0a7882f2 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:22.388411 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 674/1349] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:37:27.274026 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2b55d-444d-4a6a-8837-190e89cf66d1 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:27.276238 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2b55d-444d-4a6a-8837-190e89cf66d1 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:27.276238 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2b55d-444d-4a6a-8837-190e89cf66d1 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:27.277720 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 676/1350] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 09:37:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:27.283178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf9dcb-7e39-4e97-840c-12f6b10b0c47 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:27.283640 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf9dcb-7e39-4e97-840c-12f6b10b0c47 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:27.287450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf9dcb-7e39-4e97-840c-12f6b10b0c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:27.404129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-06cf9dcb-7e39-4e97-840c-12f6b10b0c47 None None] MFA Rules not processed for user `6983e364f5564ed7854dff06a80f55d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:27.406096 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-06cf9dcb-7e39-4e97-840c-12f6b10b0c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:27.454939 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:27.570051 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 675/1351] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 09:37:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:31.796308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cf53a-9ed5-4e61-bc70-cc5b2a95ae1f None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:31.796833 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cf53a-9ed5-4e61-bc70-cc5b2a95ae1f None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:31.796833 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cf53a-9ed5-4e61-bc70-cc5b2a95ae1f None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:31.798392 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 677/1352] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 09:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:31.803086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fc4c6-ecb8-407d-85d9-51f7a4c227f4 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:31.803507 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fc4c6-ecb8-407d-85d9-51f7a4c227f4 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:31.803695 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fc4c6-ecb8-407d-85d9-51f7a4c227f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:31.883870 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-091fc4c6-ecb8-407d-85d9-51f7a4c227f4 None None] MFA Rules not processed for user `6983e364f5564ed7854dff06a80f55d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:31.885130 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-091fc4c6-ecb8-407d-85d9-51f7a4c227f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:31.960699 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:32.007696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 676/1353] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 09:37:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:37:33.239195 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475d6eb-f715-4d40-aa5a-d0dd3f274851 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:33.239722 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475d6eb-f715-4d40-aa5a-d0dd3f274851 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:33.239722 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475d6eb-f715-4d40-aa5a-d0dd3f274851 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:33.241880 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 678/1354] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 09:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:33.247327 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0084c-9690-4217-bf40-732dd31b16a2 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:33.247769 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0084c-9690-4217-bf40-732dd31b16a2 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:33.248017 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0084c-9690-4217-bf40-732dd31b16a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:33.327466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-24e0084c-9690-4217-bf40-732dd31b16a2 None None] MFA Rules not processed for user `6983e364f5564ed7854dff06a80f55d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:33.328701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-24e0084c-9690-4217-bf40-732dd31b16a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:33.438167 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 677/1355] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 09:37:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:36.883112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78901f72-fb2a-4aee-abab-0e64dd433616 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:36.883857 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78901f72-fb2a-4aee-abab-0e64dd433616 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:36.884150 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78901f72-fb2a-4aee-abab-0e64dd433616 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:36.886003 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 679/1356] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:37:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:36.891509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c4caf-8ec8-4dcc-93b0-9784afb8f19e None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:36.891964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c4caf-8ec8-4dcc-93b0-9784afb8f19e None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:36.892102 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c4caf-8ec8-4dcc-93b0-9784afb8f19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:36.936316 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:36.982065 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-b31c4caf-8ec8-4dcc-93b0-9784afb8f19e None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:36.983737 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b31c4caf-8ec8-4dcc-93b0-9784afb8f19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:37.099697 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 678/1357] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:37.409242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52277a-dddd-4746-8a81-22b45e38987e None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:37.409767 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52277a-dddd-4746-8a81-22b45e38987e None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:37.410188 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52277a-dddd-4746-8a81-22b45e38987e None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:37.411668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 680/1358] 10.222.0.58 () {54 vars in 962 bytes} [Wed Aug 24 09:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:37.420692 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db707c2-c489-4457-9393-7487a330763d None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:37.421003 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db707c2-c489-4457-9393-7487a330763d None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:37.421280 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db707c2-c489-4457-9393-7487a330763d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:37.503734 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-9db707c2-c489-4457-9393-7487a330763d None None] MFA Rules not processed for user `18be8c54c9644c5e9812eea09e60c11c`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:37.504953 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-9db707c2-c489-4457-9393-7487a330763d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:37.556900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:37.652718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 679/1359] 10.222.0.58 () {58 vars in 1059 bytes} [Wed Aug 24 09:37:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:37.660817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52277a-dddd-4746-8a81-22b45e38987e None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:37.662494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-4b52277a-dddd-4746-8a81-22b45e38987e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:37.823555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52277a-dddd-4746-8a81-22b45e38987e None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:37.906178 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:37.948335 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5a43c-a7c2-4a5c-b311-8843f20b238f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:37.949073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5a43c-a7c2-4a5c-b311-8843f20b238f service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:37.949450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5a43c-a7c2-4a5c-b311-8843f20b238f service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:37.949845 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5a43c-a7c2-4a5c-b311-8843f20b238f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:37.951542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-48d5a43c-a7c2-4a5c-b311-8843f20b238f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:38.045388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5a43c-a7c2-4a5c-b311-8843f20b238f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:38.047565 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5a43c-a7c2-4a5c-b311-8843f20b238f service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:38.069844 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 681/1360] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:37:40.230434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210debfa-4ee0-461e-bc19-62e603ab6624 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:40.230863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210debfa-4ee0-461e-bc19-62e603ab6624 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:40.231325 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210debfa-4ee0-461e-bc19-62e603ab6624 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:40.232734 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 680/1361] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:40.237848 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0ef91-da9b-40cd-8a8f-108532c089e0 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:40.238280 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0ef91-da9b-40cd-8a8f-108532c089e0 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:40.238460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0ef91-da9b-40cd-8a8f-108532c089e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:40.309154 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-35a0ef91-da9b-40cd-8a8f-108532c089e0 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:40.310386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-35a0ef91-da9b-40cd-8a8f-108532c089e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:40.354355 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:40.429281 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 682/1362] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:40.722217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210debfa-4ee0-461e-bc19-62e603ab6624 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:40.723762 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-210debfa-4ee0-461e-bc19-62e603ab6624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:40.885507 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210debfa-4ee0-461e-bc19-62e603ab6624 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:40.896995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:41.028097 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389cc7d-d1fb-433b-86b3-6bf7167b3e49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:41.028708 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389cc7d-d1fb-433b-86b3-6bf7167b3e49 service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:41.028990 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389cc7d-d1fb-433b-86b3-6bf7167b3e49 service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:41.029264 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389cc7d-d1fb-433b-86b3-6bf7167b3e49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:41.031034 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-8389cc7d-d1fb-433b-86b3-6bf7167b3e49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:41.146610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389cc7d-d1fb-433b-86b3-6bf7167b3e49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:41.148410 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389cc7d-d1fb-433b-86b3-6bf7167b3e49 service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:41.169013 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 681/1363] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:37:43.432832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2addde-df2e-47da-bc55-42406dbefb9b None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:43.433435 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2addde-df2e-47da-bc55-42406dbefb9b None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:43.433435 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2addde-df2e-47da-bc55-42406dbefb9b None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:43.435066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 683/1364] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:43.440456 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352c155-9661-4663-8393-163e4a4c108a None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:43.440886 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352c155-9661-4663-8393-163e4a4c108a None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:43.441116 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352c155-9661-4663-8393-163e4a4c108a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:43.457808 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:43.513309 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-b352c155-9661-4663-8393-163e4a4c108a None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:43.514480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b352c155-9661-4663-8393-163e4a4c108a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:43.614224 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 682/1365] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:43.910606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8e2b7-6371-421e-b57a-c3d0b9a51668 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:43.910886 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8e2b7-6371-421e-b57a-c3d0b9a51668 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:43.911334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8e2b7-6371-421e-b57a-c3d0b9a51668 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:43.912668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 684/1366] 10.222.0.58 () {54 vars in 962 bytes} [Wed Aug 24 09:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:43.918582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08146af4-d06e-43d0-8499-90cdbeec3d5c None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:43.918871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08146af4-d06e-43d0-8499-90cdbeec3d5c None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:43.919149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08146af4-d06e-43d0-8499-90cdbeec3d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.000275 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-08146af4-d06e-43d0-8499-90cdbeec3d5c None None] MFA Rules not processed for user `18be8c54c9644c5e9812eea09e60c11c`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:44.001515 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-08146af4-d06e-43d0-8499-90cdbeec3d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:44.038816 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:44.131218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 683/1367] 10.222.0.58 () {58 vars in 1059 bytes} [Wed Aug 24 09:37:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:44.139753 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8e2b7-6371-421e-b57a-c3d0b9a51668 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:44.141275 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-87d8e2b7-6371-421e-b57a-c3d0b9a51668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:44.308531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8e2b7-6371-421e-b57a-c3d0b9a51668 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:44.333065 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:44.443397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8053e09-acf9-418d-a105-b5679bd11cf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:44.444063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8053e09-acf9-418d-a105-b5679bd11cf4 service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:44.444371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8053e09-acf9-418d-a105-b5679bd11cf4 service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:44.444553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8053e09-acf9-418d-a105-b5679bd11cf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:44.446262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-d8053e09-acf9-418d-a105-b5679bd11cf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:44.541816 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8053e09-acf9-418d-a105-b5679bd11cf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:44.543326 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8053e09-acf9-418d-a105-b5679bd11cf4 service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:44.562039 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 685/1368] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:37:45.044751 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c781b6-01a9-4bcb-a19d-b23af76a07ff None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:45.045295 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c781b6-01a9-4bcb-a19d-b23af76a07ff None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:45.045295 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c781b6-01a9-4bcb-a19d-b23af76a07ff None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:45.046823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 684/1369] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:45.051916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341fac1-5423-41e4-9a72-1e1b9f9a068c None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:45.052202 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341fac1-5423-41e4-9a72-1e1b9f9a068c None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:45.052475 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341fac1-5423-41e4-9a72-1e1b9f9a068c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:45.085602 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:45.123825 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-7341fac1-5423-41e4-9a72-1e1b9f9a068c None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:45.125030 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-7341fac1-5423-41e4-9a72-1e1b9f9a068c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:45.237785 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 686/1370] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:45.820444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21663637-718f-4269-a829-cc14ef56a5ff None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:45.820444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21663637-718f-4269-a829-cc14ef56a5ff None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:45.820444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21663637-718f-4269-a829-cc14ef56a5ff None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:45.822206 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 685/1371] 10.222.0.58 () {54 vars in 964 bytes} [Wed Aug 24 09:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:45.827101 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680f19e-bf55-4174-9f5a-2b4f41cdfe41 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:45.828194 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680f19e-bf55-4174-9f5a-2b4f41cdfe41 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:45.828194 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680f19e-bf55-4174-9f5a-2b4f41cdfe41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:45.905717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-1680f19e-bf55-4174-9f5a-2b4f41cdfe41 None None] MFA Rules not processed for user `782bdef852d34b9ba3a957962f93994f`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:45.906919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-1680f19e-bf55-4174-9f5a-2b4f41cdfe41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:45.962755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:45.997639 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 687/1372] 10.222.0.58 () {58 vars in 1061 bytes} [Wed Aug 24 09:37:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:37:46.004487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21663637-718f-4269-a829-cc14ef56a5ff None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:46.006058 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-21663637-718f-4269-a829-cc14ef56a5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:46.118022 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21663637-718f-4269-a829-cc14ef56a5ff None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:46.172548 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:46.214770 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eaf95c-b922-4bda-9d06-76697d83bee4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:46.215349 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaf95c-b922-4bda-9d06-76697d83bee4 service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:46.216278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaf95c-b922-4bda-9d06-76697d83bee4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:46.216599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaf95c-b922-4bda-9d06-76697d83bee4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:46.219275 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-16eaf95c-b922-4bda-9d06-76697d83bee4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:46.371508 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eaf95c-b922-4bda-9d06-76697d83bee4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:46.372981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eaf95c-b922-4bda-9d06-76697d83bee4 service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:46.393047 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 686/1373] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:37:46.551713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda0cc6-8106-4ee7-8ee6-acd838dbd76f None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:46.552033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda0cc6-8106-4ee7-8ee6-acd838dbd76f None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:46.552319 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda0cc6-8106-4ee7-8ee6-acd838dbd76f None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:46.554282 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 688/1374] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:46.559646 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263604ea-4899-4cbe-a9c9-de2751cf015c None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:46.559933 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263604ea-4899-4cbe-a9c9-de2751cf015c None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:46.560217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263604ea-4899-4cbe-a9c9-de2751cf015c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:46.639210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-263604ea-4899-4cbe-a9c9-de2751cf015c None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:46.640376 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-263604ea-4899-4cbe-a9c9-de2751cf015c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:46.661840 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:46.741101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 687/1375] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:47.032611 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda0cc6-8106-4ee7-8ee6-acd838dbd76f None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:47.034352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-aeda0cc6-8106-4ee7-8ee6-acd838dbd76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:47.188560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda0cc6-8106-4ee7-8ee6-acd838dbd76f None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:47.241747 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:47.305089 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399ecd7-1717-4919-8e5d-712515a68c8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:47.305705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399ecd7-1717-4919-8e5d-712515a68c8c service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:47.306478 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399ecd7-1717-4919-8e5d-712515a68c8c service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:47.306751 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399ecd7-1717-4919-8e5d-712515a68c8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:47.308393 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f399ecd7-1717-4919-8e5d-712515a68c8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:47.421750 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399ecd7-1717-4919-8e5d-712515a68c8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:47.423338 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399ecd7-1717-4919-8e5d-712515a68c8c service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:47.442039 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 689/1376] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:37:49.428286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b5b95-2548-406f-9424-b8333debafc9 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:49.428841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b5b95-2548-406f-9424-b8333debafc9 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:49.428841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b5b95-2548-406f-9424-b8333debafc9 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:49.430455 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 688/1377] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:49.436260 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54844fca-897f-4aca-979e-c146bfdd15ea None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:49.436816 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54844fca-897f-4aca-979e-c146bfdd15ea None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:49.436816 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54844fca-897f-4aca-979e-c146bfdd15ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:49.506575 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-54844fca-897f-4aca-979e-c146bfdd15ea None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:49.507690 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-54844fca-897f-4aca-979e-c146bfdd15ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:49.515214 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:49.607479 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 690/1378] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:49.900139 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b5b95-2548-406f-9424-b8333debafc9 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:49.902130 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-319b5b95-2548-406f-9424-b8333debafc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:50.082586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b5b95-2548-406f-9424-b8333debafc9 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:50.086608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:50.215607 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726865a-816b-412a-8209-0f4c9d7869e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:50.216240 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726865a-816b-412a-8209-0f4c9d7869e8 service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:50.216519 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726865a-816b-412a-8209-0f4c9d7869e8 service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:50.216789 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726865a-816b-412a-8209-0f4c9d7869e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:50.218425 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7726865a-816b-412a-8209-0f4c9d7869e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:50.326441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726865a-816b-412a-8209-0f4c9d7869e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:50.328204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726865a-816b-412a-8209-0f4c9d7869e8 service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:50.347372 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 689/1379] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:37:52.331917 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ec1b7-5bc9-4e56-b9c0-4106c21841b9 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:52.332843 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ec1b7-5bc9-4e56-b9c0-4106c21841b9 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:52.333124 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ec1b7-5bc9-4e56-b9c0-4106c21841b9 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:52.334660 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 691/1380] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:37:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:52.340863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb9ab7-13ed-4cfe-bcb9-bdd558d9d3f6 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:52.341346 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb9ab7-13ed-4cfe-bcb9-bdd558d9d3f6 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:52.341451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb9ab7-13ed-4cfe-bcb9-bdd558d9d3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:52.354102 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:52.411951 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-e8bb9ab7-13ed-4cfe-bcb9-bdd558d9d3f6 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:52.413086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e8bb9ab7-13ed-4cfe-bcb9-bdd558d9d3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:52.530869 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 690/1381] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:52.830792 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ec1b7-5bc9-4e56-b9c0-4106c21841b9 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:52.832332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-162ec1b7-5bc9-4e56-b9c0-4106c21841b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:52.980140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:52.992901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ec1b7-5bc9-4e56-b9c0-4106c21841b9 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:53.116232 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b9e40-1e3c-4e6c-a9c6-ec51790f4cbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:53.116924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b9e40-1e3c-4e6c-a9c6-ec51790f4cbc service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:53.117274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b9e40-1e3c-4e6c-a9c6-ec51790f4cbc service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:53.117710 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b9e40-1e3c-4e6c-a9c6-ec51790f4cbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:53.119484 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-683b9e40-1e3c-4e6c-a9c6-ec51790f4cbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:53.215601 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b9e40-1e3c-4e6c-a9c6-ec51790f4cbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:53.217168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b9e40-1e3c-4e6c-a9c6-ec51790f4cbc service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:53.234469 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:53.258043 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 692/1382] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:37:55.235266 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec81ed9-3fd8-4ca6-980c-54230441b52a None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:55.236018 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec81ed9-3fd8-4ca6-980c-54230441b52a None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:55.236018 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec81ed9-3fd8-4ca6-980c-54230441b52a None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:55.237162 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 691/1383] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:55.245072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7372a7-d7b4-4c98-bf03-b96c6cb9ec92 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:55.245601 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7372a7-d7b4-4c98-bf03-b96c6cb9ec92 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:55.245977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7372a7-d7b4-4c98-bf03-b96c6cb9ec92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:55.334572 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-ba7372a7-d7b4-4c98-bf03-b96c6cb9ec92 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:55.335853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-ba7372a7-d7b4-4c98-bf03-b96c6cb9ec92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:55.483703 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 693/1384] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:55.774604 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec81ed9-3fd8-4ca6-980c-54230441b52a None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:55.776195 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-cec81ed9-3fd8-4ca6-980c-54230441b52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:55.866116 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:55.929065 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec81ed9-3fd8-4ca6-980c-54230441b52a None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:56.064356 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f8174-52f8-4e1c-b51e-43d135ef4f38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:56.065016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f8174-52f8-4e1c-b51e-43d135ef4f38 service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:56.065369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f8174-52f8-4e1c-b51e-43d135ef4f38 service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:56.065747 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f8174-52f8-4e1c-b51e-43d135ef4f38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:56.067828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-8f0f8174-52f8-4e1c-b51e-43d135ef4f38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:56.132252 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:56.175626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f8174-52f8-4e1c-b51e-43d135ef4f38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:56.177244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f8174-52f8-4e1c-b51e-43d135ef4f38 service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:56.198543 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 692/1385] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:37:58.419935 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61138ad6-8699-4b6d-9c70-af3943940ac8 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:58.420600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61138ad6-8699-4b6d-9c70-af3943940ac8 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:58.420600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61138ad6-8699-4b6d-9c70-af3943940ac8 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:58.421962 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 694/1386] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:37:58.427218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835783b0-bbc8-4800-978a-4078b07c1544 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:58.427714 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835783b0-bbc8-4800-978a-4078b07c1544 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:58.427863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835783b0-bbc8-4800-978a-4078b07c1544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:58.505520 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-835783b0-bbc8-4800-978a-4078b07c1544 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:37:58.506949 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-835783b0-bbc8-4800-978a-4078b07c1544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:58.624792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 693/1387] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:37:58.920439 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61138ad6-8699-4b6d-9c70-af3943940ac8 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:37:58.922072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-61138ad6-8699-4b6d-9c70-af3943940ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:59.004372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:59.088589 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61138ad6-8699-4b6d-9c70-af3943940ac8 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:37:59.207339 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f543d54-c274-450a-bf28-a59380408d78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:37:59.207955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f543d54-c274-450a-bf28-a59380408d78 service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:37:59.208233 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f543d54-c274-450a-bf28-a59380408d78 service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:37:59.208509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f543d54-c274-450a-bf28-a59380408d78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:37:59.210144 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-0f543d54-c274-450a-bf28-a59380408d78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:37:59.262578 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:59.318425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f543d54-c274-450a-bf28-a59380408d78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:37:59.320112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f543d54-c274-450a-bf28-a59380408d78 service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:37:59.340042 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 695/1388] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:37:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:01.309892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48424929-c3b5-4040-b37a-4a9364a10289 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:01.310432 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48424929-c3b5-4040-b37a-4a9364a10289 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:01.310525 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48424929-c3b5-4040-b37a-4a9364a10289 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:01.311955 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 694/1389] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:01.317233 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce079c4-fc70-4141-82e1-8f93d945ffbc None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:01.317682 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce079c4-fc70-4141-82e1-8f93d945ffbc None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:01.317817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce079c4-fc70-4141-82e1-8f93d945ffbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:01.382954 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-4ce079c4-fc70-4141-82e1-8f93d945ffbc None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:01.384719 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-4ce079c4-fc70-4141-82e1-8f93d945ffbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:01.480226 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 696/1390] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:01.638597 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e9ea6-7f7c-4f4c-b243-3917d9ebe079 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:01.638886 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e9ea6-7f7c-4f4c-b243-3917d9ebe079 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:01.639260 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e9ea6-7f7c-4f4c-b243-3917d9ebe079 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:01.640945 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 695/1391] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:01.646442 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231662b-1cfa-4a35-9f51-c40885962819 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:01.646737 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231662b-1cfa-4a35-9f51-c40885962819 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:01.647013 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231662b-1cfa-4a35-9f51-c40885962819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:01.663290 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:01.715230 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-e231662b-1cfa-4a35-9f51-c40885962819 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:01.716441 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-e231662b-1cfa-4a35-9f51-c40885962819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:01.770435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e9ea6-7f7c-4f4c-b243-3917d9ebe079 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:01.771952 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-804e9ea6-7f7c-4f4c-b243-3917d9ebe079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:01.802849 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:01.819187 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 697/1392] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:01.922084 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e9ea6-7f7c-4f4c-b243-3917d9ebe079 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:02.032768 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:02.046408 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa937a-528a-4071-a21c-fc4a7fbad6ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:02.047015 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa937a-528a-4071-a21c-fc4a7fbad6ec service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:02.047294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa937a-528a-4071-a21c-fc4a7fbad6ec service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:02.047568 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa937a-528a-4071-a21c-fc4a7fbad6ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:02.049173 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e6fa937a-528a-4071-a21c-fc4a7fbad6ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:02.121698 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a8709-6208-4443-a36a-e6285baef3ac None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:02.121988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a8709-6208-4443-a36a-e6285baef3ac None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:02.122260 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a8709-6208-4443-a36a-e6285baef3ac None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:02.123794 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 698/1393] 10.222.0.58 () {54 vars in 967 bytes} [Wed Aug 24 09:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:38:02.128281 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c5084-c998-4acf-9eb3-bd277e22c1f7 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:02.128574 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c5084-c998-4acf-9eb3-bd277e22c1f7 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:02.128851 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c5084-c998-4acf-9eb3-bd277e22c1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:02.144741 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa937a-528a-4071-a21c-fc4a7fbad6ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:02.146379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa937a-528a-4071-a21c-fc4a7fbad6ec service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:02.166598 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 696/1394] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:38:02.206857 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-595c5084-c998-4acf-9eb3-bd277e22c1f7 None None] MFA Rules not processed for user `51fe6dfa43d04cdeb0421d2613c8c2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:02.208078 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-595c5084-c998-4acf-9eb3-bd277e22c1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:02.247810 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:02.307781 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 699/1395] 10.222.0.58 () {58 vars in 1064 bytes} [Wed Aug 24 09:38:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:38:02.315505 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa937a-528a-4071-a21c-fc4a7fbad6ec service nova] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:02.316827 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e6fa937a-528a-4071-a21c-fc4a7fbad6ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:02.407124 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa937a-528a-4071-a21c-fc4a7fbad6ec service nova] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:02.448673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:02.485972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b814c-6ef9-4dba-9693-0ae24e5487b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51fe6dfa43d04cdeb0421d2613c8c2ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:02.486590 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b814c-6ef9-4dba-9693-0ae24e5487b3 service glance] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:02.486867 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b814c-6ef9-4dba-9693-0ae24e5487b3 service glance] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:02.487138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b814c-6ef9-4dba-9693-0ae24e5487b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:02.488822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-737b814c-6ef9-4dba-9693-0ae24e5487b3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:02.627271 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b814c-6ef9-4dba-9693-0ae24e5487b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:02.629047 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b814c-6ef9-4dba-9693-0ae24e5487b3 service glance] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:02.660001 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 697/1396] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:03.519068 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80372547-fefd-4e05-8865-7c3272e49c80 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:03.519966 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80372547-fefd-4e05-8865-7c3272e49c80 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:03.520410 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80372547-fefd-4e05-8865-7c3272e49c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:03.594741 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-80372547-fefd-4e05-8865-7c3272e49c80 None None] MFA Rules not processed for user `3ae62427d5914e67b5b4d0237ecccd06`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:03.596275 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-80372547-fefd-4e05-8865-7c3272e49c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:03.686903 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 700/1397] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 09:38:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:03.734626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f17daa-e44d-46c6-857c-f61e79384241 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:03.735154 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f17daa-e44d-46c6-857c-f61e79384241 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:03.735257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f17daa-e44d-46c6-857c-f61e79384241 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:03.736573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 698/1398] 10.222.0.58 () {54 vars in 943 bytes} [Wed Aug 24 09:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:03.743751 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8984495-9df6-465c-adae-68776108c055 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:03.744066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8984495-9df6-465c-adae-68776108c055 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:03.744341 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8984495-9df6-465c-adae-68776108c055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:03.808309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:03.827338 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-b8984495-9df6-465c-adae-68776108c055 None None] MFA Rules not processed for user `ff2db35b94c84ec7bba96117d23baf6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:03.828560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-b8984495-9df6-465c-adae-68776108c055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:03.936463 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 701/1399] 10.222.0.58 () {58 vars in 1040 bytes} [Wed Aug 24 09:38:03 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:03.946151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f17daa-e44d-46c6-857c-f61e79384241 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:03.947812 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-06f17daa-e44d-46c6-857c-f61e79384241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:04.025853 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:04.089943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f17daa-e44d-46c6-857c-f61e79384241 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:04.195047 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fa450-ab3c-45f6-969f-4a42067652f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2db35b94c84ec7bba96117d23baf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:04.196161 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fa450-ab3c-45f6-969f-4a42067652f5 service swift] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:04.197108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fa450-ab3c-45f6-969f-4a42067652f5 service swift] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:04.197483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fa450-ab3c-45f6-969f-4a42067652f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:04.199151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ca6fa450-ab3c-45f6-969f-4a42067652f5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:04.263467 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:04.288158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6fa450-ab3c-45f6-969f-4a42067652f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:04.289814 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6fa450-ab3c-45f6-969f-4a42067652f5 service swift] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:04.297889 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 699/1400] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 09:38:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:38:04.310816 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eac369-58e4-4d66-9047-4c2061705602 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:04.311149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eac369-58e4-4d66-9047-4c2061705602 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:04.311368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eac369-58e4-4d66-9047-4c2061705602 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:04.312715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 702/1401] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:04.318208 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fb24f-3b5b-430b-ae87-4bca533e2b93 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:04.318499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fb24f-3b5b-430b-ae87-4bca533e2b93 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:04.318779 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fb24f-3b5b-430b-ae87-4bca533e2b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:04.392119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-c87fb24f-3b5b-430b-ae87-4bca533e2b93 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:04.393577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-c87fb24f-3b5b-430b-ae87-4bca533e2b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:04.517520 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 700/1402] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:04.810047 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eac369-58e4-4d66-9047-4c2061705602 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:04.811729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-16eac369-58e4-4d66-9047-4c2061705602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:04.934042 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:04.979225 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eac369-58e4-4d66-9047-4c2061705602 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:05.103908 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39225426-b273-4dd5-ab73-f35da648d611 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:05.104517 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39225426-b273-4dd5-ab73-f35da648d611 service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:05.104797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39225426-b273-4dd5-ab73-f35da648d611 service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:05.105071 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39225426-b273-4dd5-ab73-f35da648d611 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:05.106982 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-39225426-b273-4dd5-ab73-f35da648d611 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:05.188268 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:05.211781 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39225426-b273-4dd5-ab73-f35da648d611 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:05.213427 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39225426-b273-4dd5-ab73-f35da648d611 service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:05.235196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 703/1403] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:07.227683 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76a1ed-f81f-4391-8e6f-183f3a9e1d46 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:07.227683 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76a1ed-f81f-4391-8e6f-183f3a9e1d46 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:07.227683 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76a1ed-f81f-4391-8e6f-183f3a9e1d46 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:07.232604 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 701/1404] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:38:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:07.234467 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57be99c-8e78-4425-b990-f4c36c794325 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:07.234916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57be99c-8e78-4425-b990-f4c36c794325 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:07.235017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57be99c-8e78-4425-b990-f4c36c794325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:07.313032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-c57be99c-8e78-4425-b990-f4c36c794325 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:07.314276 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-c57be99c-8e78-4425-b990-f4c36c794325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:07.547135 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 704/1405] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:07.854538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76a1ed-f81f-4391-8e6f-183f3a9e1d46 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:07.856473 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-8a76a1ed-f81f-4391-8e6f-183f3a9e1d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:07.931147 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:08.060606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76a1ed-f81f-4391-8e6f-183f3a9e1d46 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:08.189758 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396940b-6e1c-44ab-b8c0-b85d785f875f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:08.190759 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396940b-6e1c-44ab-b8c0-b85d785f875f service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:08.191099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396940b-6e1c-44ab-b8c0-b85d785f875f service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:08.191396 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396940b-6e1c-44ab-b8c0-b85d785f875f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:08.193146 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-5396940b-6e1c-44ab-b8c0-b85d785f875f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:08.205627 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:08.296416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396940b-6e1c-44ab-b8c0-b85d785f875f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:08.298046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396940b-6e1c-44ab-b8c0-b85d785f875f service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:08.318339 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 702/1406] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:10.294778 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028f68d-266e-4b36-9576-19db2cabff84 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:10.295335 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028f68d-266e-4b36-9576-19db2cabff84 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:10.295335 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028f68d-266e-4b36-9576-19db2cabff84 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:10.296829 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 705/1407] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:10.301938 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47f010-19e3-493c-8351-b08f9106a9e8 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:10.302376 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47f010-19e3-493c-8351-b08f9106a9e8 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:10.302609 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e47f010-19e3-493c-8351-b08f9106a9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:10.374535 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-6e47f010-19e3-493c-8351-b08f9106a9e8 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:10.375765 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-6e47f010-19e3-493c-8351-b08f9106a9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:10.482253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:10.495792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 703/1408] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:10.790189 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028f68d-266e-4b36-9576-19db2cabff84 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:10.791814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-e028f68d-266e-4b36-9576-19db2cabff84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:10.851400 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:10.957029 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028f68d-266e-4b36-9576-19db2cabff84 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:11.085730 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4ef0b-174f-46fc-91ec-40a2babfc5ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:11.086357 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4ef0b-174f-46fc-91ec-40a2babfc5ba service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:11.086643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4ef0b-174f-46fc-91ec-40a2babfc5ba service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:11.086891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4ef0b-174f-46fc-91ec-40a2babfc5ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:11.088509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-17e4ef0b-174f-46fc-91ec-40a2babfc5ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:11.098022 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:11.195665 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4ef0b-174f-46fc-91ec-40a2babfc5ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:11.199570 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4ef0b-174f-46fc-91ec-40a2babfc5ba service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:11.217011 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 706/1409] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:20.493894 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=5 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:21.214648 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=41 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:26.837794 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e147bb-e924-4a5d-a6fe-aa13fb26da71 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:26.838362 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e147bb-e924-4a5d-a6fe-aa13fb26da71 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:26.838362 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e147bb-e924-4a5d-a6fe-aa13fb26da71 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:26.839757 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 704/1410] 10.222.0.58 () {54 vars in 918 bytes} [Wed Aug 24 09:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:26.845053 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dceaf71-76e6-487a-8874-e61424fd00da None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:26.845516 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dceaf71-76e6-487a-8874-e61424fd00da None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:26.845638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dceaf71-76e6-487a-8874-e61424fd00da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:26.921562 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-8dceaf71-76e6-487a-8874-e61424fd00da None None] MFA Rules not processed for user `6983e364f5564ed7854dff06a80f55d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:26.922761 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-8dceaf71-76e6-487a-8874-e61424fd00da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:27.028445 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 707/1411] 10.222.0.58 () {58 vars in 1015 bytes} [Wed Aug 24 09:38:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:27.043189 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad856c-2ced-4309-b0dc-987118035d8e None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:27.043494 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad856c-2ced-4309-b0dc-987118035d8e None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:27.043772 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad856c-2ced-4309-b0dc-987118035d8e None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:27.045092 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 705/1412] 10.222.0.58 () {54 vars in 918 bytes} [Wed Aug 24 09:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:27.049773 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d08a6-5e72-44e5-9f0d-63e56d7b5cac None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:27.050059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d08a6-5e72-44e5-9f0d-63e56d7b5cac None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:27.050336 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d08a6-5e72-44e5-9f0d-63e56d7b5cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:27.123653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:27.126254 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-ea0d08a6-5e72-44e5-9f0d-63e56d7b5cac None None] MFA Rules not processed for user `18be8c54c9644c5e9812eea09e60c11c`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:27.128005 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-ea0d08a6-5e72-44e5-9f0d-63e56d7b5cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:27.244394 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 708/1413] 10.222.0.58 () {58 vars in 1015 bytes} [Wed Aug 24 09:38:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:29.652616 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98c9b4-c767-4865-8dbd-707f53845c84 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:29.653164 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98c9b4-c767-4865-8dbd-707f53845c84 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:29.653278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98c9b4-c767-4865-8dbd-707f53845c84 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:29.654596 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:29.660138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9656071-94e0-4e8a-8f14-50a7869f3d5e None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:29.660554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9656071-94e0-4e8a-8f14-50a7869f3d5e None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:29.660671 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9656071-94e0-4e8a-8f14-50a7869f3d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:29.726738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-e9656071-94e0-4e8a-8f14-50a7869f3d5e None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:29.728074 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-e9656071-94e0-4e8a-8f14-50a7869f3d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:29.783362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:29.826864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:30.122664 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98c9b4-c767-4865-8dbd-707f53845c84 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:30.124240 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ab98c9b4-c767-4865-8dbd-707f53845c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:30.272194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98c9b4-c767-4865-8dbd-707f53845c84 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:30.344442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:30.385623 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f42c6-ba24-4f3f-bb0a-30e69bf1cc4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:30.386159 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f42c6-ba24-4f3f-bb0a-30e69bf1cc4e service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:30.386442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f42c6-ba24-4f3f-bb0a-30e69bf1cc4e service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:30.386719 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f42c6-ba24-4f3f-bb0a-30e69bf1cc4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:30.388329 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-469f42c6-ba24-4f3f-bb0a-30e69bf1cc4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:30.478010 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f42c6-ba24-4f3f-bb0a-30e69bf1cc4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:30.479835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f42c6-ba24-4f3f-bb0a-30e69bf1cc4e service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:30.498077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 707/1416] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:31.391182 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd66119-ddf5-4f58-9118-f5a39bc0e45c None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:31.391724 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd66119-ddf5-4f58-9118-f5a39bc0e45c None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:31.391851 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd66119-ddf5-4f58-9118-f5a39bc0e45c None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:31.393105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:38:31.398546 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d9e8e-0fe3-48d8-ac0a-5e6b9098fb77 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:31.398997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d9e8e-0fe3-48d8-ac0a-5e6b9098fb77 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:31.399095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d9e8e-0fe3-48d8-ac0a-5e6b9098fb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:31.478623 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-4e5d9e8e-0fe3-48d8-ac0a-5e6b9098fb77 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:31.480160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-4e5d9e8e-0fe3-48d8-ac0a-5e6b9098fb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:31.508894 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:31.591385 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:31.749934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd66119-ddf5-4f58-9118-f5a39bc0e45c None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:31.751381 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-afd66119-ddf5-4f58-9118-f5a39bc0e45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:31.899193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd66119-ddf5-4f58-9118-f5a39bc0e45c None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:31.938785 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:32.018131 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82340a9f-40cc-4309-85f4-63823a5fdc2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:32.018645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82340a9f-40cc-4309-85f4-63823a5fdc2a service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:32.018925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82340a9f-40cc-4309-85f4-63823a5fdc2a service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:32.019196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82340a9f-40cc-4309-85f4-63823a5fdc2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:32.020832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-82340a9f-40cc-4309-85f4-63823a5fdc2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:32.108381 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82340a9f-40cc-4309-85f4-63823a5fdc2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:32.109998 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82340a9f-40cc-4309-85f4-63823a5fdc2a service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:32.128354 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 711/1419] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:38:33.029490 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec3446-0b78-41de-bbd5-f2d89518ade5 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:33.030075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec3446-0b78-41de-bbd5-f2d89518ade5 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:33.030075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec3446-0b78-41de-bbd5-f2d89518ade5 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:33.031431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:33.036592 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d3787-8f70-4985-b0af-3524f5776a4b None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:33.037024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d3787-8f70-4985-b0af-3524f5776a4b None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:33.037132 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d3787-8f70-4985-b0af-3524f5776a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:33.094579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:33.117545 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-f98d3787-8f70-4985-b0af-3524f5776a4b None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:33.118772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f98d3787-8f70-4985-b0af-3524f5776a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:33.215350 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:33.369160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec3446-0b78-41de-bbd5-f2d89518ade5 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:33.371394 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-23ec3446-0b78-41de-bbd5-f2d89518ade5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:33.525026 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec3446-0b78-41de-bbd5-f2d89518ade5 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:33.537390 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:33.638822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da061c5-7741-4970-87ca-69b662635c7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:33.639333 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da061c5-7741-4970-87ca-69b662635c7b service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:33.639609 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da061c5-7741-4970-87ca-69b662635c7b service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:33.639876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da061c5-7741-4970-87ca-69b662635c7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:33.641459 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-9da061c5-7741-4970-87ca-69b662635c7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:33.729944 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da061c5-7741-4970-87ca-69b662635c7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:33.731535 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da061c5-7741-4970-87ca-69b662635c7b service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:33.749885 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 710/1422] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:34.621348 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6d501-ed98-4874-aef1-f649e99955f7 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:34.621940 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6d501-ed98-4874-aef1-f649e99955f7 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:34.621940 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6d501-ed98-4874-aef1-f649e99955f7 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:34.623265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:34.628525 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302f33b-a50d-4cd3-a93c-ba4955569511 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:34.628960 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302f33b-a50d-4cd3-a93c-ba4955569511 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:34.629104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302f33b-a50d-4cd3-a93c-ba4955569511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:34.649721 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:34.707137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-7302f33b-a50d-4cd3-a93c-ba4955569511 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:34.708362 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7302f33b-a50d-4cd3-a93c-ba4955569511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:34.805671 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:34.956525 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6d501-ed98-4874-aef1-f649e99955f7 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:34.958236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-e6d6d501-ed98-4874-aef1-f649e99955f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:35.071375 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:35.107499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6d501-ed98-4874-aef1-f649e99955f7 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:35.228727 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8db66-829e-463d-a875-5a7a89f91e6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:35.229208 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8db66-829e-463d-a875-5a7a89f91e6d service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:35.229767 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8db66-829e-463d-a875-5a7a89f91e6d service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:35.230044 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8db66-829e-463d-a875-5a7a89f91e6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:35.231659 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-95a8db66-829e-463d-a875-5a7a89f91e6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:35.312560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:35.326816 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8db66-829e-463d-a875-5a7a89f91e6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:35.328398 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8db66-829e-463d-a875-5a7a89f91e6d service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:35.346434 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 714/1425] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:36.219725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5bf36-7ad6-4643-a2c9-e91705e3ba07 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:36.220277 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5bf36-7ad6-4643-a2c9-e91705e3ba07 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:36.220376 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5bf36-7ad6-4643-a2c9-e91705e3ba07 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:36.221824 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:36.227861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed55403-763d-4929-809d-8ce33713ddbf None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:36.228277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed55403-763d-4929-809d-8ce33713ddbf None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:36.228277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed55403-763d-4929-809d-8ce33713ddbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:36.306461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-0ed55403-763d-4929-809d-8ce33713ddbf None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:36.307676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-0ed55403-763d-4929-809d-8ce33713ddbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:36.406664 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:36.566296 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5bf36-7ad6-4643-a2c9-e91705e3ba07 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:36.567841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-47e5bf36-7ad6-4643-a2c9-e91705e3ba07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:36.652514 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:36.716891 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5bf36-7ad6-4643-a2c9-e91705e3ba07 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:36.831360 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2b7ea-719e-477f-823c-59c00e4864de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:36.831967 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2b7ea-719e-477f-823c-59c00e4864de service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:36.832244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2b7ea-719e-477f-823c-59c00e4864de service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:36.832515 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2b7ea-719e-477f-823c-59c00e4864de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:36.834790 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7ba2b7ea-719e-477f-823c-59c00e4864de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:36.883817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:36.925324 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2b7ea-719e-477f-823c-59c00e4864de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:36.926948 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2b7ea-719e-477f-823c-59c00e4864de service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:36.946078 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 713/1428] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:37.759671 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821ea1b-e8ef-4366-967b-1d8a49d5fe59 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:37.760250 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821ea1b-e8ef-4366-967b-1d8a49d5fe59 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:37.760250 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821ea1b-e8ef-4366-967b-1d8a49d5fe59 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:37.761598 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:37.766608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787db095-099a-419e-a110-108aeb0e2269 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:37.767064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787db095-099a-419e-a110-108aeb0e2269 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:37.767199 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787db095-099a-419e-a110-108aeb0e2269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:37.846320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-787db095-099a-419e-a110-108aeb0e2269 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:37.847463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-787db095-099a-419e-a110-108aeb0e2269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:37.945680 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:38:38.095580 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821ea1b-e8ef-4366-967b-1d8a49d5fe59 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:38.097153 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-b821ea1b-e8ef-4366-967b-1d8a49d5fe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:38.145666 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:38.246425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821ea1b-e8ef-4366-967b-1d8a49d5fe59 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:38.358506 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e768adc-0f8e-4f31-9e24-98bea6f84e46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:38.359023 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e768adc-0f8e-4f31-9e24-98bea6f84e46 service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:38.359303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e768adc-0f8e-4f31-9e24-98bea6f84e46 service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:38.359572 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e768adc-0f8e-4f31-9e24-98bea6f84e46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:38.361164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2e768adc-0f8e-4f31-9e24-98bea6f84e46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:38.368731 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:38.450055 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e768adc-0f8e-4f31-9e24-98bea6f84e46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:38.451631 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e768adc-0f8e-4f31-9e24-98bea6f84e46 service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:38.469507 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 717/1431] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:39.287904 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd570b-88c2-4516-b8c2-bc3e4bda3ff4 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:39.288547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd570b-88c2-4516-b8c2-bc3e4bda3ff4 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:39.288547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd570b-88c2-4516-b8c2-bc3e4bda3ff4 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:39.289859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:39.295060 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6e263-bb73-484a-9138-1a179c707158 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:39.295507 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6e263-bb73-484a-9138-1a179c707158 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:39.295617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6e263-bb73-484a-9138-1a179c707158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:39.371901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-26c6e263-bb73-484a-9138-1a179c707158 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:39.373117 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-26c6e263-bb73-484a-9138-1a179c707158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:39.441647 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:39.473164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:38:39.625156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd570b-88c2-4516-b8c2-bc3e4bda3ff4 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:39.626711 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-80bd570b-88c2-4516-b8c2-bc3e4bda3ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:39.644883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:39.784445 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd570b-88c2-4516-b8c2-bc3e4bda3ff4 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:39.874233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:39.900743 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5991e-119c-40b3-90a2-abad50e2c3ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:39.901309 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5991e-119c-40b3-90a2-abad50e2c3ed service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:39.901620 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5991e-119c-40b3-90a2-abad50e2c3ed service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:39.901895 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5991e-119c-40b3-90a2-abad50e2c3ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:39.903512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-fcd5991e-119c-40b3-90a2-abad50e2c3ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:39.995735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5991e-119c-40b3-90a2-abad50e2c3ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:39.997344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5991e-119c-40b3-90a2-abad50e2c3ed service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:40.015298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 716/1434] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:40.827078 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd9e7f-bcf8-40fd-bb8c-2bec91c3aa05 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:40.827618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd9e7f-bcf8-40fd-bb8c-2bec91c3aa05 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:40.827618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd9e7f-bcf8-40fd-bb8c-2bec91c3aa05 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:40.828928 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:40.834624 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9445d-5116-4848-99e8-1a79f833ff2c None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:40.835150 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9445d-5116-4848-99e8-1a79f833ff2c None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:40.835560 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9445d-5116-4848-99e8-1a79f833ff2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:40.913721 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-2ee9445d-5116-4848-99e8-1a79f833ff2c None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:40.914933 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-2ee9445d-5116-4848-99e8-1a79f833ff2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:40.956228 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:41.011551 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:38:41.163462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd9e7f-bcf8-40fd-bb8c-2bec91c3aa05 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:41.164988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f5bd9e7f-bcf8-40fd-bb8c-2bec91c3aa05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:41.311653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd9e7f-bcf8-40fd-bb8c-2bec91c3aa05 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:41.370980 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:41.429537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee7174-cc9d-4aee-8893-8771dc0688da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:41.430086 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee7174-cc9d-4aee-8893-8771dc0688da service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:41.430365 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee7174-cc9d-4aee-8893-8771dc0688da service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:41.430638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee7174-cc9d-4aee-8893-8771dc0688da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:41.432247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-b5ee7174-cc9d-4aee-8893-8771dc0688da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:41.523260 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee7174-cc9d-4aee-8893-8771dc0688da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:41.524853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee7174-cc9d-4aee-8893-8771dc0688da service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:41.542816 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 720/1437] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:42.377321 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2048814-3e3b-474b-9191-ceb9172c549a None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:42.377936 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2048814-3e3b-474b-9191-ceb9172c549a None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:42.377936 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2048814-3e3b-474b-9191-ceb9172c549a None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:42.379286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:42.384443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d05944-8a27-475a-8bff-1d84485ea004 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:42.384928 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d05944-8a27-475a-8bff-1d84485ea004 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:42.385174 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d05944-8a27-475a-8bff-1d84485ea004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:42.466504 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-a1d05944-8a27-475a-8bff-1d84485ea004 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:42.467717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a1d05944-8a27-475a-8bff-1d84485ea004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:42.469773 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:42.565585 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:42.716039 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2048814-3e3b-474b-9191-ceb9172c549a None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:42.717540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-a2048814-3e3b-474b-9191-ceb9172c549a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:42.863135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2048814-3e3b-474b-9191-ceb9172c549a None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:42.889863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:42.975806 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3acdb-cf05-41c2-b712-ae0422c80799 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:42.976333 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3acdb-cf05-41c2-b712-ae0422c80799 service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:42.976610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3acdb-cf05-41c2-b712-ae0422c80799 service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:42.976883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3acdb-cf05-41c2-b712-ae0422c80799 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:42.978516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-92e3acdb-cf05-41c2-b712-ae0422c80799 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:43.065507 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3acdb-cf05-41c2-b712-ae0422c80799 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:43.067237 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3acdb-cf05-41c2-b712-ae0422c80799 service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:43.087798 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 719/1440] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:44.938567 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d405b8-149b-4363-b8fe-42ff2dcd7cf7 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:44.939123 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d405b8-149b-4363-b8fe-42ff2dcd7cf7 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:44.939123 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d405b8-149b-4363-b8fe-42ff2dcd7cf7 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:44.940478 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:44.946786 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1645c3e-e07c-47df-8ed6-d7e35f2c6f48 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:44.947266 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1645c3e-e07c-47df-8ed6-d7e35f2c6f48 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:44.947636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1645c3e-e07c-47df-8ed6-d7e35f2c6f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:44.990506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:45.015778 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-d1645c3e-e07c-47df-8ed6-d7e35f2c6f48 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:45.016994 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-d1645c3e-e07c-47df-8ed6-d7e35f2c6f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:45.114132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:38:45.402058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d405b8-149b-4363-b8fe-42ff2dcd7cf7 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:45.403555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-19d405b8-149b-4363-b8fe-42ff2dcd7cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:45.511817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d405b8-149b-4363-b8fe-42ff2dcd7cf7 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:45.545146 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:45.587236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47380eb7-0c21-4cf9-86b4-097d48ce1688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:45.587832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47380eb7-0c21-4cf9-86b4-097d48ce1688 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:45.588106 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47380eb7-0c21-4cf9-86b4-097d48ce1688 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:45.588372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47380eb7-0c21-4cf9-86b4-097d48ce1688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:45.590114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-47380eb7-0c21-4cf9-86b4-097d48ce1688 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:45.699392 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47380eb7-0c21-4cf9-86b4-097d48ce1688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:45.700810 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47380eb7-0c21-4cf9-86b4-097d48ce1688 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:45.719364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 723/1443] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:47.807901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a43f9b-62e5-4cdc-bff1-f2ae6404c47c None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:47.808470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a43f9b-62e5-4cdc-bff1-f2ae6404c47c None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:47.808470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a43f9b-62e5-4cdc-bff1-f2ae6404c47c None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:47.809844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:47.815290 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc002e5-14bd-4bcc-ad09-29cbe2554449 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:47.815700 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc002e5-14bd-4bcc-ad09-29cbe2554449 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:47.815833 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc002e5-14bd-4bcc-ad09-29cbe2554449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:47.886198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-8fc002e5-14bd-4bcc-ad09-29cbe2554449 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:47.887320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-8fc002e5-14bd-4bcc-ad09-29cbe2554449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:47.900003 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:47.983884 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:48.269837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a43f9b-62e5-4cdc-bff1-f2ae6404c47c None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:48.271374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-d1a43f9b-62e5-4cdc-bff1-f2ae6404c47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:48.376328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a43f9b-62e5-4cdc-bff1-f2ae6404c47c None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:48.388518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:48.450611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ea079-0227-4420-be8b-1d4181b6834e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:48.451140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ea079-0227-4420-be8b-1d4181b6834e service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:48.451442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ea079-0227-4420-be8b-1d4181b6834e service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:48.451702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ea079-0227-4420-be8b-1d4181b6834e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:48.453313 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-780ea079-0227-4420-be8b-1d4181b6834e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:48.568784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ea079-0227-4420-be8b-1d4181b6834e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:48.571221 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ea079-0227-4420-be8b-1d4181b6834e service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:48.589042 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 722/1446] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:50.936587 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31870f6-a475-450e-a182-37c889ad4976 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:50.937136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31870f6-a475-450e-a182-37c889ad4976 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:50.937136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31870f6-a475-450e-a182-37c889ad4976 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:50.938565 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:50.943896 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66f427-38ca-4cf8-991a-bf6732a59ac4 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:50.944885 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66f427-38ca-4cf8-991a-bf6732a59ac4 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:50.945013 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66f427-38ca-4cf8-991a-bf6732a59ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:50.994033 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:51.011678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-bb66f427-38ca-4cf8-991a-bf6732a59ac4 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:51.012918 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-bb66f427-38ca-4cf8-991a-bf6732a59ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:51.111511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:51.397840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31870f6-a475-450e-a182-37c889ad4976 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:51.399391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-b31870f6-a475-450e-a182-37c889ad4976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:51.503395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31870f6-a475-450e-a182-37c889ad4976 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:51.546755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:51.581151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f30551-9921-4b5c-b741-b5195470685e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:51.581844 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f30551-9921-4b5c-b741-b5195470685e service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:51.582137 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f30551-9921-4b5c-b741-b5195470685e service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:51.582410 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f30551-9921-4b5c-b741-b5195470685e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:51.584026 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-22f30551-9921-4b5c-b741-b5195470685e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:51.693031 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f30551-9921-4b5c-b741-b5195470685e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:51.695227 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f30551-9921-4b5c-b741-b5195470685e service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:51.713696 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 726/1449] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:53.761904 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c9f37-576f-46f9-9c85-e9f769317c90 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:53.762471 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c9f37-576f-46f9-9c85-e9f769317c90 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:53.762471 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c9f37-576f-46f9-9c85-e9f769317c90 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:53.763793 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:53.769357 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcd4e7-f33e-41ed-a8c0-48529d8c6396 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:53.769825 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcd4e7-f33e-41ed-a8c0-48529d8c6396 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:53.769930 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcd4e7-f33e-41ed-a8c0-48529d8c6396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:53.841132 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-4ddcd4e7-f33e-41ed-a8c0-48529d8c6396 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:53.842383 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-4ddcd4e7-f33e-41ed-a8c0-48529d8c6396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:53.863945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:53.952246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:54.244733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c9f37-576f-46f9-9c85-e9f769317c90 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:54.246382 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-0d8c9f37-576f-46f9-9c85-e9f769317c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:54.352707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c9f37-576f-46f9-9c85-e9f769317c90 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:54.372901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:54.427066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81ebec-1eb6-4148-a6c4-d4d109b30533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:54.427609 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81ebec-1eb6-4148-a6c4-d4d109b30533 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:54.427901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81ebec-1eb6-4148-a6c4-d4d109b30533 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:54.428170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81ebec-1eb6-4148-a6c4-d4d109b30533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:54.429852 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7a81ebec-1eb6-4148-a6c4-d4d109b30533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:54.538843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81ebec-1eb6-4148-a6c4-d4d109b30533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:54.540296 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81ebec-1eb6-4148-a6c4-d4d109b30533 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:54.558464 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 725/1452] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:38:56.569804 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42c5b9-33b3-42fe-b1ef-5f7a85d9da4f None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:56.570321 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42c5b9-33b3-42fe-b1ef-5f7a85d9da4f None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:56.570431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42c5b9-33b3-42fe-b1ef-5f7a85d9da4f None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:56.571824 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:38:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:56.577286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4bac6-20cc-4dc6-8822-2dee26b10ab9 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:56.577759 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4bac6-20cc-4dc6-8822-2dee26b10ab9 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:56.577903 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4bac6-20cc-4dc6-8822-2dee26b10ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:56.643148 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:56.646029 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-5af4bac6-20cc-4dc6-8822-2dee26b10ab9 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:56.647911 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-5af4bac6-20cc-4dc6-8822-2dee26b10ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:56.748216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:38:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:57.039675 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42c5b9-33b3-42fe-b1ef-5f7a85d9da4f None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:57.041291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-1c42c5b9-33b3-42fe-b1ef-5f7a85d9da4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:57.143877 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42c5b9-33b3-42fe-b1ef-5f7a85d9da4f None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:57.192752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:57.218773 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df7e93-c899-4ff8-b1b0-6859992c193b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:38:57.219386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df7e93-c899-4ff8-b1b0-6859992c193b service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:57.219667 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df7e93-c899-4ff8-b1b0-6859992c193b service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:57.219942 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df7e93-c899-4ff8-b1b0-6859992c193b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:57.221584 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-38df7e93-c899-4ff8-b1b0-6859992c193b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:57.332152 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df7e93-c899-4ff8-b1b0-6859992c193b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:38:57.333612 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df7e93-c899-4ff8-b1b0-6859992c193b service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:38:57.352578 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 729/1455] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:38:59.373970 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e8399-b0f2-464e-9b1a-c6405e2dd1d1 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:59.374544 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e8399-b0f2-464e-9b1a-c6405e2dd1d1 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:59.374544 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e8399-b0f2-464e-9b1a-c6405e2dd1d1 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:59.375876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:38:59.381301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7128700-ed1d-4cb6-a884-392cd48e63b9 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:38:59.381929 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7128700-ed1d-4cb6-a884-392cd48e63b9 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:38:59.381929 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7128700-ed1d-4cb6-a884-392cd48e63b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:38:59.447231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-e7128700-ed1d-4cb6-a884-392cd48e63b9 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:38:59.448437 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-e7128700-ed1d-4cb6-a884-392cd48e63b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:59.482466 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:59.551283 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:38:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:38:59.843499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e8399-b0f2-464e-9b1a-c6405e2dd1d1 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:38:59.845073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ad1e8399-b0f2-464e-9b1a-c6405e2dd1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:38:59.953029 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e8399-b0f2-464e-9b1a-c6405e2dd1d1 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:38:59.985554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:00.032100 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010fb50-fab5-4257-9a58-9b8910ca74c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:00.032699 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010fb50-fab5-4257-9a58-9b8910ca74c9 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:00.032976 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010fb50-fab5-4257-9a58-9b8910ca74c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:00.033265 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010fb50-fab5-4257-9a58-9b8910ca74c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:00.034909 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-3010fb50-fab5-4257-9a58-9b8910ca74c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:00.146113 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010fb50-fab5-4257-9a58-9b8910ca74c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:00.147882 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010fb50-fab5-4257-9a58-9b8910ca74c9 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:00.166519 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 728/1458] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:38:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:02.175465 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7eff4f-e51e-4e94-8409-4ecd6fe2b88c None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:02.175879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7eff4f-e51e-4e94-8409-4ecd6fe2b88c None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:02.176155 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7eff4f-e51e-4e94-8409-4ecd6fe2b88c None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:02.184894 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:39:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:39:02.190386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7d148-8c0a-43f7-9850-5a03f251d4dd None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:02.190846 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7d148-8c0a-43f7-9850-5a03f251d4dd None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:02.190953 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7d148-8c0a-43f7-9850-5a03f251d4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:02.262774 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-1ea7d148-8c0a-43f7-9850-5a03f251d4dd None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:02.264013 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-1ea7d148-8c0a-43f7-9850-5a03f251d4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:02.274692 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:02.365913 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:02.750997 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7eff4f-e51e-4e94-8409-4ecd6fe2b88c None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:02.752890 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-4e7eff4f-e51e-4e94-8409-4ecd6fe2b88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:02.875770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7eff4f-e51e-4e94-8409-4ecd6fe2b88c None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:02.957091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:02.980868 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47cede-5911-43a6-ad4f-ba2e42164203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:02.981506 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47cede-5911-43a6-ad4f-ba2e42164203 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:02.981794 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47cede-5911-43a6-ad4f-ba2e42164203 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:02.982068 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47cede-5911-43a6-ad4f-ba2e42164203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:02.983856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-ca47cede-5911-43a6-ad4f-ba2e42164203 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:03.113750 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47cede-5911-43a6-ad4f-ba2e42164203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:03.115198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47cede-5911-43a6-ad4f-ba2e42164203 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:03.135584 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 732/1461] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:05.162024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cd9bd-0751-49a1-99d1-91622301f370 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:05.163176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cd9bd-0751-49a1-99d1-91622301f370 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:05.163176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cd9bd-0751-49a1-99d1-91622301f370 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:05.164486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:39:05.169839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070dbe4-644f-41ff-8b3e-278a8cdfd9c3 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:05.170276 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070dbe4-644f-41ff-8b3e-278a8cdfd9c3 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:05.170375 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070dbe4-644f-41ff-8b3e-278a8cdfd9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:05.237835 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-2070dbe4-644f-41ff-8b3e-278a8cdfd9c3 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:05.239097 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2070dbe4-644f-41ff-8b3e-278a8cdfd9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:05.278677 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:05.341322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:05.625036 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cd9bd-0751-49a1-99d1-91622301f370 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:05.626751 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-043cd9bd-0751-49a1-99d1-91622301f370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:05.734272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cd9bd-0751-49a1-99d1-91622301f370 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:05.773674 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:05.811045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4584b7-3778-4bd4-9432-99287256e145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:05.811648 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4584b7-3778-4bd4-9432-99287256e145 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:05.811930 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4584b7-3778-4bd4-9432-99287256e145 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:05.812205 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4584b7-3778-4bd4-9432-99287256e145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:05.813873 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-5e4584b7-3778-4bd4-9432-99287256e145 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:05.922907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4584b7-3778-4bd4-9432-99287256e145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:05.924262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4584b7-3778-4bd4-9432-99287256e145 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:05.942491 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 731/1464] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:07.926315 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b7a4b-2a4d-4209-93f4-6ee04981149e None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:07.926927 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b7a4b-2a4d-4209-93f4-6ee04981149e None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:07.926927 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b7a4b-2a4d-4209-93f4-6ee04981149e None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:07.928572 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:39:07.933863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bea1c0-6805-4a5d-b49e-eee300f09894 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:07.934325 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bea1c0-6805-4a5d-b49e-eee300f09894 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:07.934434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bea1c0-6805-4a5d-b49e-eee300f09894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:08.001186 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-81bea1c0-6805-4a5d-b49e-eee300f09894 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:08.002525 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-81bea1c0-6805-4a5d-b49e-eee300f09894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:08.020511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:08.104474 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:08.394498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b7a4b-2a4d-4209-93f4-6ee04981149e None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:08.396045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-6f2b7a4b-2a4d-4209-93f4-6ee04981149e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:08.507718 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b7a4b-2a4d-4209-93f4-6ee04981149e None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:08.575026 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:08.582436 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71337655-c52a-449d-bd18-dd1519866fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:08.583040 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71337655-c52a-449d-bd18-dd1519866fae service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:08.583311 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71337655-c52a-449d-bd18-dd1519866fae service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:08.583599 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71337655-c52a-449d-bd18-dd1519866fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:08.585793 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-71337655-c52a-449d-bd18-dd1519866fae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:08.697224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71337655-c52a-449d-bd18-dd1519866fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:08.698680 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71337655-c52a-449d-bd18-dd1519866fae service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:08.718563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 735/1467] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:10.681381 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfddd4-ba4c-4f49-a7dc-2e48fc556d4a None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:10.682027 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfddd4-ba4c-4f49-a7dc-2e48fc556d4a None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:10.682027 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfddd4-ba4c-4f49-a7dc-2e48fc556d4a None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:10.683447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:39:10.688722 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b65aa-fe0d-403d-a5d2-8a9f92f004ed None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:10.689133 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b65aa-fe0d-403d-a5d2-8a9f92f004ed None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:10.689278 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b65aa-fe0d-403d-a5d2-8a9f92f004ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:10.755609 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-0a6b65aa-fe0d-403d-a5d2-8a9f92f004ed None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:10.756774 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-0a6b65aa-fe0d-403d-a5d2-8a9f92f004ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:10.806552 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:10.857081 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:11.149415 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfddd4-ba4c-4f49-a7dc-2e48fc556d4a None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:11.151033 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-55bfddd4-ba4c-4f49-a7dc-2e48fc556d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:11.257284 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfddd4-ba4c-4f49-a7dc-2e48fc556d4a None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:11.306290 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:11.337831 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a97646-1d67-4b3b-8b76-903928f91d10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:11.338452 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a97646-1d67-4b3b-8b76-903928f91d10 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:11.338735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a97646-1d67-4b3b-8b76-903928f91d10 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:11.339012 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a97646-1d67-4b3b-8b76-903928f91d10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:11.340646 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-43a97646-1d67-4b3b-8b76-903928f91d10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:11.573126 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a97646-1d67-4b3b-8b76-903928f91d10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:11.574487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a97646-1d67-4b3b-8b76-903928f91d10 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:11.592954 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 734/1470] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:20.855286 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=22 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:21.590624 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=66 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:32.258071 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aee8e-bfe0-4916-bc99-1c9ee69606af None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:32.258587 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aee8e-bfe0-4916-bc99-1c9ee69606af None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:32.258691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aee8e-bfe0-4916-bc99-1c9ee69606af None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:32.259977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 737/1471] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:39:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:39:32.265344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e8cc1-a86b-4603-8506-faa0c52e9740 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:32.265795 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e8cc1-a86b-4603-8506-faa0c52e9740 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:32.265929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e8cc1-a86b-4603-8506-faa0c52e9740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:32.332576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-925e8cc1-a86b-4603-8506-faa0c52e9740 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:32.333817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-925e8cc1-a86b-4603-8506-faa0c52e9740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:32.427355 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 735/1472] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:32.727493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8370c58-6620-4bd3-88ad-2355e142c8dc None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:32.727781 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8370c58-6620-4bd3-88ad-2355e142c8dc None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:32.728311 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8370c58-6620-4bd3-88ad-2355e142c8dc None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:32.729693 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 738/1473] 10.222.0.58 () {54 vars in 967 bytes} [Wed Aug 24 09:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:39:32.734569 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d6589-2dc0-4dc5-9953-4bc3ead15369 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:32.734859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d6589-2dc0-4dc5-9953-4bc3ead15369 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:32.735160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d6589-2dc0-4dc5-9953-4bc3ead15369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:32.811032 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-455d6589-2dc0-4dc5-9953-4bc3ead15369 None None] MFA Rules not processed for user `51fe6dfa43d04cdeb0421d2613c8c2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:32.812249 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-455d6589-2dc0-4dc5-9953-4bc3ead15369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:32.833112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:32.889874 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 736/1474] 10.222.0.58 () {58 vars in 1064 bytes} [Wed Aug 24 09:39:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:32.897689 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8370c58-6620-4bd3-88ad-2355e142c8dc None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:32.899156 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-d8370c58-6620-4bd3-88ad-2355e142c8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:33.003454 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8370c58-6620-4bd3-88ad-2355e142c8dc None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:33.075770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd384150-0cea-4e95-afe7-1f5dc0c05e43 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51fe6dfa43d04cdeb0421d2613c8c2ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:33.076404 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd384150-0cea-4e95-afe7-1f5dc0c05e43 service glance] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:33.076681 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd384150-0cea-4e95-afe7-1f5dc0c05e43 service glance] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:33.076953 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd384150-0cea-4e95-afe7-1f5dc0c05e43 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:33.078589 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-dd384150-0cea-4e95-afe7-1f5dc0c05e43 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:33.134041 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:33.191210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd384150-0cea-4e95-afe7-1f5dc0c05e43 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:33.192654 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd384150-0cea-4e95-afe7-1f5dc0c05e43 service glance] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:33.211970 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 739/1475] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:35.214007 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3733f7d-39e2-4612-bd95-4b29ea0e1f90 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:35.214677 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3733f7d-39e2-4612-bd95-4b29ea0e1f90 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:35.214677 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3733f7d-39e2-4612-bd95-4b29ea0e1f90 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:35.215891 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 737/1476] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:39:35.221168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae1169-32f6-4922-99fb-6de0f666fe08 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:35.221664 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae1169-32f6-4922-99fb-6de0f666fe08 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:35.221773 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae1169-32f6-4922-99fb-6de0f666fe08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:35.288455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-d4ae1169-32f6-4922-99fb-6de0f666fe08 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:35.289799 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-d4ae1169-32f6-4922-99fb-6de0f666fe08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:35.385825 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 740/1477] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:35.660348 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3733f7d-39e2-4612-bd95-4b29ea0e1f90 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:35.661972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-c3733f7d-39e2-4612-bd95-4b29ea0e1f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:35.787554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3733f7d-39e2-4612-bd95-4b29ea0e1f90 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:35.836450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:35.882176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9a86a-503d-4b15-9f47-ce0769aa0540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:35.883156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9a86a-503d-4b15-9f47-ce0769aa0540 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:35.883426 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9a86a-503d-4b15-9f47-ce0769aa0540 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:35.883701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9a86a-503d-4b15-9f47-ce0769aa0540 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:35.884338 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9a86a-503d-4b15-9f47-ce0769aa0540 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:35.886106 dv-cinder-854271-2-smb devstack@keystone.service[82884]: WARNING py.warnings [None req-ecd9a86a-503d-4b15-9f47-ce0769aa0540 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:39:35.886106 dv-cinder-854271-2-smb devstack@keystone.service[82884]: warnings.warn(msg) Aug 24 09:39:35.886106 dv-cinder-854271-2-smb devstack@keystone.service[82884]: Aug 24 09:39:35.887250 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9a86a-503d-4b15-9f47-ce0769aa0540 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:35.905571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 738/1478] 10.222.0.58 () {56 vars in 1108 bytes} [Wed Aug 24 09:39:35 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:39:37.841820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb151922-a8ae-49e4-97af-031628568457 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:37.842399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb151922-a8ae-49e4-97af-031628568457 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:37.842399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb151922-a8ae-49e4-97af-031628568457 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:37.843997 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 741/1479] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:39:37.849523 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267f8ea-22f4-40dd-b2e4-5f7b31b8d6bb None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:37.849964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267f8ea-22f4-40dd-b2e4-5f7b31b8d6bb None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:37.850069 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267f8ea-22f4-40dd-b2e4-5f7b31b8d6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:37.916633 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-7267f8ea-22f4-40dd-b2e4-5f7b31b8d6bb None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:37.917890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7267f8ea-22f4-40dd-b2e4-5f7b31b8d6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:38.012033 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 739/1480] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:38.309399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb151922-a8ae-49e4-97af-031628568457 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:38.311109 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-cb151922-a8ae-49e4-97af-031628568457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:38.321571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:38.461804 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb151922-a8ae-49e4-97af-031628568457 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:38.540500 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:38.574227 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617bc964-1b83-4985-b5ae-a05fa9eda1f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:38.574835 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bc964-1b83-4985-b5ae-a05fa9eda1f9 service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:38.575111 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bc964-1b83-4985-b5ae-a05fa9eda1f9 service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:38.575380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bc964-1b83-4985-b5ae-a05fa9eda1f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:38.576975 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-617bc964-1b83-4985-b5ae-a05fa9eda1f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:38.681760 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617bc964-1b83-4985-b5ae-a05fa9eda1f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:38.683354 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617bc964-1b83-4985-b5ae-a05fa9eda1f9 service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:38.701875 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 742/1481] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:40.776120 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dc676-738b-46b4-a42e-4b23338ab90e None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:40.776679 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dc676-738b-46b4-a42e-4b23338ab90e None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:40.776989 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dc676-738b-46b4-a42e-4b23338ab90e None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:40.778371 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 740/1482] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:39:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:39:40.783898 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2793ca-058a-4d8c-9c9d-b041b9bb23ff None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:40.784300 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2793ca-058a-4d8c-9c9d-b041b9bb23ff None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:40.784472 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2793ca-058a-4d8c-9c9d-b041b9bb23ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:40.850919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-6d2793ca-058a-4d8c-9c9d-b041b9bb23ff None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:40.852155 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-6d2793ca-058a-4d8c-9c9d-b041b9bb23ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:40.898789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:40.950166 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 743/1483] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:41.236941 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4dc676-738b-46b4-a42e-4b23338ab90e None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:41.238579 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ae4dc676-738b-46b4-a42e-4b23338ab90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:41.262945 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:41.343881 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4dc676-738b-46b4-a42e-4b23338ab90e None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:41.417971 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc7a47-330d-4644-a953-c35dc8f88e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:41.418573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc7a47-330d-4644-a953-c35dc8f88e64 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:41.418851 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc7a47-330d-4644-a953-c35dc8f88e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:41.419121 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc7a47-330d-4644-a953-c35dc8f88e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:41.420718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-63bc7a47-330d-4644-a953-c35dc8f88e64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:41.493886 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:41.528434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc7a47-330d-4644-a953-c35dc8f88e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:41.529891 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc7a47-330d-4644-a953-c35dc8f88e64 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:41.548346 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 741/1484] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:43.542812 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399ca8e-35f2-4285-b41b-053840a5b7ee None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:43.543346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399ca8e-35f2-4285-b41b-053840a5b7ee None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:43.543346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399ca8e-35f2-4285-b41b-053840a5b7ee None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:43.544670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 744/1485] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:39:43.550105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4148bd4-f578-4906-8303-1e346b67b6fa None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:43.550538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4148bd4-f578-4906-8303-1e346b67b6fa None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:43.550642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4148bd4-f578-4906-8303-1e346b67b6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:43.617995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-b4148bd4-f578-4906-8303-1e346b67b6fa None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:43.619214 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b4148bd4-f578-4906-8303-1e346b67b6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:43.714902 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 742/1486] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:44.010047 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399ca8e-35f2-4285-b41b-053840a5b7ee None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:44.011584 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2399ca8e-35f2-4285-b41b-053840a5b7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:44.115605 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399ca8e-35f2-4285-b41b-053840a5b7ee None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:44.187349 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:44.189551 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad92fc0-8e89-46c0-a1f5-c162a4be1359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:44.190168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad92fc0-8e89-46c0-a1f5-c162a4be1359 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:44.190629 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad92fc0-8e89-46c0-a1f5-c162a4be1359 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:44.191217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad92fc0-8e89-46c0-a1f5-c162a4be1359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:44.193025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-3ad92fc0-8e89-46c0-a1f5-c162a4be1359 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:44.301111 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad92fc0-8e89-46c0-a1f5-c162a4be1359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:44.302486 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad92fc0-8e89-46c0-a1f5-c162a4be1359 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:44.320865 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 745/1487] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:46.346076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25862c6a-bdd2-41c7-90fa-83e68aa9c3a8 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:46.346638 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25862c6a-bdd2-41c7-90fa-83e68aa9c3a8 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:46.346638 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25862c6a-bdd2-41c7-90fa-83e68aa9c3a8 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:46.347937 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 743/1488] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:39:46.354136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3021ca-1abf-4313-b8ac-67606f3bd715 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:46.354590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3021ca-1abf-4313-b8ac-67606f3bd715 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:46.354692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3021ca-1abf-4313-b8ac-67606f3bd715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:46.422578 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-9e3021ca-1abf-4313-b8ac-67606f3bd715 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:46.423814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-9e3021ca-1abf-4313-b8ac-67606f3bd715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:46.476611 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:46.524462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 746/1489] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:46.816146 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25862c6a-bdd2-41c7-90fa-83e68aa9c3a8 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:46.817729 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-25862c6a-bdd2-41c7-90fa-83e68aa9c3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:46.854751 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:46.933457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25862c6a-bdd2-41c7-90fa-83e68aa9c3a8 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:47.006540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7f8c8-357b-434f-92db-cb09d41b7116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:47.007245 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7f8c8-357b-434f-92db-cb09d41b7116 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:47.008186 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7f8c8-357b-434f-92db-cb09d41b7116 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:47.008463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7f8c8-357b-434f-92db-cb09d41b7116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:47.010100 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-9dd7f8c8-357b-434f-92db-cb09d41b7116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:47.089997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:47.120244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7f8c8-357b-434f-92db-cb09d41b7116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:47.121704 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7f8c8-357b-434f-92db-cb09d41b7116 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:47.139589 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 744/1490] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:49.248459 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162aa45-2635-41dd-9ead-44ee67df5aff None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:49.248949 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162aa45-2635-41dd-9ead-44ee67df5aff None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:49.249059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162aa45-2635-41dd-9ead-44ee67df5aff None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:49.250404 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 747/1491] 10.222.0.58 () {54 vars in 927 bytes} [Wed Aug 24 09:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:39:49.255712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922002a-caaf-4dc6-a719-f60ff65c5fc8 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:49.256094 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922002a-caaf-4dc6-a719-f60ff65c5fc8 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:49.256262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922002a-caaf-4dc6-a719-f60ff65c5fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:49.321938 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-3922002a-caaf-4dc6-a719-f60ff65c5fc8 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:39:49.323135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-3922002a-caaf-4dc6-a719-f60ff65c5fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:49.421229 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 745/1492] 10.222.0.58 () {58 vars in 1024 bytes} [Wed Aug 24 09:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:39:49.709810 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162aa45-2635-41dd-9ead-44ee67df5aff None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:39:49.711933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-8162aa45-2635-41dd-9ead-44ee67df5aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:49.817799 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162aa45-2635-41dd-9ead-44ee67df5aff None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:39:49.890973 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25390b90-b036-44b0-8fe3-9072232c2c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:39:49.891576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25390b90-b036-44b0-8fe3-9072232c2c2f service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:39:49.891856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25390b90-b036-44b0-8fe3-9072232c2c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:39:49.892126 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25390b90-b036-44b0-8fe3-9072232c2c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:39:49.893764 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-25390b90-b036-44b0-8fe3-9072232c2c2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:39:49.903351 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:50.005098 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25390b90-b036-44b0-8fe3-9072232c2c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:39:50.006471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25390b90-b036-44b0-8fe3-9072232c2c2f service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:39:50.025084 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 748/1493] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:39:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:39:59.419410 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=82 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:00.022126 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=50 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:41:02.217204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ecab3-59f4-429d-bb8e-8d6248374994 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:02.217853 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ecab3-59f4-429d-bb8e-8d6248374994 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:02.217853 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ecab3-59f4-429d-bb8e-8d6248374994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:02.294569 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-1d0ecab3-59f4-429d-bb8e-8d6248374994 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:41:02.295780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-1d0ecab3-59f4-429d-bb8e-8d6248374994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:02.391848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 746/1494] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:41:02.400763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f655e35-5d62-4800-a7cb-49b7fe8c730a None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:02.401273 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f655e35-5d62-4800-a7cb-49b7fe8c730a None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:02.401371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f655e35-5d62-4800-a7cb-49b7fe8c730a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:02.477450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-5f655e35-5d62-4800-a7cb-49b7fe8c730a None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:41:02.478625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-5f655e35-5d62-4800-a7cb-49b7fe8c730a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:02.577794 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 749/1495] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:41:02.582499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ecab3-59f4-429d-bb8e-8d6248374994 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:41:02.583729 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-1d0ecab3-59f4-429d-bb8e-8d6248374994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:02.595409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ecab3-59f4-429d-bb8e-8d6248374994 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:41:02.656351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:41:02.690809 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c6d57-1ed7-41f9-991f-25d7c47cd22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:41:02.691400 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c6d57-1ed7-41f9-991f-25d7c47cd22c admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:02.691671 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c6d57-1ed7-41f9-991f-25d7c47cd22c admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:02.691935 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c6d57-1ed7-41f9-991f-25d7c47cd22c admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:02.692565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c6d57-1ed7-41f9-991f-25d7c47cd22c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:41:02.692862 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c6d57-1ed7-41f9-991f-25d7c47cd22c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:41:02.694474 dv-cinder-854271-2-smb devstack@keystone.service[82884]: WARNING py.warnings [None req-f63c6d57-1ed7-41f9-991f-25d7c47cd22c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:41:02.694474 dv-cinder-854271-2-smb devstack@keystone.service[82884]: warnings.warn(msg) Aug 24 09:41:02.694474 dv-cinder-854271-2-smb devstack@keystone.service[82884]: Aug 24 09:41:02.695343 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c6d57-1ed7-41f9-991f-25d7c47cd22c admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:41:02.706155 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 747/1496] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:41:02.714625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f655e35-5d62-4800-a7cb-49b7fe8c730a None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:41:02.723991 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f655e35-5d62-4800-a7cb-49b7fe8c730a None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:41:02.786859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:41:02.822630 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629b769-a742-47e9-a921-a819028dbd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:41:02.823236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629b769-a742-47e9-a921-a819028dbd9b admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:02.823513 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629b769-a742-47e9-a921-a819028dbd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:02.823783 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629b769-a742-47e9-a921-a819028dbd9b admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:02.824416 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629b769-a742-47e9-a921-a819028dbd9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:41:02.826178 dv-cinder-854271-2-smb devstack@keystone.service[82885]: WARNING py.warnings [None req-2629b769-a742-47e9-a921-a819028dbd9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:41:02.826178 dv-cinder-854271-2-smb devstack@keystone.service[82885]: warnings.warn(msg) Aug 24 09:41:02.826178 dv-cinder-854271-2-smb devstack@keystone.service[82885]: Aug 24 09:41:02.827374 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629b769-a742-47e9-a921-a819028dbd9b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:41:02.883839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 750/1497] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:41:02 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:41:02.888070 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c6d57-1ed7-41f9-991f-25d7c47cd22c admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:41:02.889625 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-f63c6d57-1ed7-41f9-991f-25d7c47cd22c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:02.922417 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c6d57-1ed7-41f9-991f-25d7c47cd22c admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:41:03.015941 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377b58f-0c0a-4b57-91ac-e4321e045e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:41:03.016536 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377b58f-0c0a-4b57-91ac-e4321e045e34 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:03.016806 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377b58f-0c0a-4b57-91ac-e4321e045e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:03.017070 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377b58f-0c0a-4b57-91ac-e4321e045e34 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:03.017717 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377b58f-0c0a-4b57-91ac-e4321e045e34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:41:03.018713 dv-cinder-854271-2-smb devstack@keystone.service[82884]: WARNING py.warnings [None req-b377b58f-0c0a-4b57-91ac-e4321e045e34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:41:03.018713 dv-cinder-854271-2-smb devstack@keystone.service[82884]: warnings.warn(msg) Aug 24 09:41:03.018713 dv-cinder-854271-2-smb devstack@keystone.service[82884]: Aug 24 09:41:03.019905 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377b58f-0c0a-4b57-91ac-e4321e045e34 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:41:03.062911 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 748/1498] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:41:02 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:41:03.067213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629b769-a742-47e9-a921-a819028dbd9b admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:41:03.069457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2629b769-a742-47e9-a921-a819028dbd9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:03.133388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629b769-a742-47e9-a921-a819028dbd9b admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:41:03.219999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:41:03.232601 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583190c-fcdf-40f1-a286-16fdf40e2d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:41:03.233215 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583190c-fcdf-40f1-a286-16fdf40e2d94 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:03.233524 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583190c-fcdf-40f1-a286-16fdf40e2d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:03.233799 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583190c-fcdf-40f1-a286-16fdf40e2d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:03.234441 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583190c-fcdf-40f1-a286-16fdf40e2d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:41:03.235467 dv-cinder-854271-2-smb devstack@keystone.service[82885]: WARNING py.warnings [None req-d583190c-fcdf-40f1-a286-16fdf40e2d94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:41:03.235467 dv-cinder-854271-2-smb devstack@keystone.service[82885]: warnings.warn(msg) Aug 24 09:41:03.235467 dv-cinder-854271-2-smb devstack@keystone.service[82885]: Aug 24 09:41:03.236346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583190c-fcdf-40f1-a286-16fdf40e2d94 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:41:03.250327 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 751/1499] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:41:03.253796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377b58f-0c0a-4b57-91ac-e4321e045e34 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:41:03.255355 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b377b58f-0c0a-4b57-91ac-e4321e045e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:03.267627 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377b58f-0c0a-4b57-91ac-e4321e045e34 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:41:03.292262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:41:03.363363 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41733acc-b290-4797-a78a-df3159e3d8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:41:03.363969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41733acc-b290-4797-a78a-df3159e3d8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:03.364250 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41733acc-b290-4797-a78a-df3159e3d8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:03.364525 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41733acc-b290-4797-a78a-df3159e3d8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:03.366007 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41733acc-b290-4797-a78a-df3159e3d8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:41:03.367027 dv-cinder-854271-2-smb devstack@keystone.service[82884]: WARNING py.warnings [None req-41733acc-b290-4797-a78a-df3159e3d8c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:41:03.367027 dv-cinder-854271-2-smb devstack@keystone.service[82884]: warnings.warn(msg) Aug 24 09:41:03.367027 dv-cinder-854271-2-smb devstack@keystone.service[82884]: Aug 24 09:41:03.367917 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41733acc-b290-4797-a78a-df3159e3d8c4 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:41:03.380113 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 749/1500] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:41:03.385204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583190c-fcdf-40f1-a286-16fdf40e2d94 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:41:03.386749 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-d583190c-fcdf-40f1-a286-16fdf40e2d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:03.419772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583190c-fcdf-40f1-a286-16fdf40e2d94 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:41:03.520383 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e02139-319d-4215-9711-c2f6386005db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:41:03.521077 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e02139-319d-4215-9711-c2f6386005db admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:03.521372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e02139-319d-4215-9711-c2f6386005db admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:03.521765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e02139-319d-4215-9711-c2f6386005db admin admin] PATH_INFO: `/v3/projects/3ee993edc788442dbf0394f67f9aaaf2/users/9e8e1584148540a287a1e8a7dbb6e5d6/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:03.544149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e02139-319d-4215-9711-c2f6386005db admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee993edc788442dbf0394f67f9aaaf2, user_id=9e8e1584148540a287a1e8a7dbb6e5d6, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:41:03.545183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: WARNING py.warnings [None req-54e02139-319d-4215-9711-c2f6386005db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:41:03.545183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: warnings.warn(msg) Aug 24 09:41:03.545183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: Aug 24 09:41:03.547160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e02139-319d-4215-9711-c2f6386005db admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:41:03.572256 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 752/1501] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:41:03 2022] PUT /identity/v3/projects/3ee993edc788442dbf0394f67f9aaaf2/users/9e8e1584148540a287a1e8a7dbb6e5d6/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:41:03.584514 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76517fdc-fa6f-48fa-a8bf-3e1d4e2cfe65 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:03.584799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76517fdc-fa6f-48fa-a8bf-3e1d4e2cfe65 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:03.585072 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76517fdc-fa6f-48fa-a8bf-3e1d4e2cfe65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:03.641331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-76517fdc-fa6f-48fa-a8bf-3e1d4e2cfe65 None None] MFA Rules not processed for user `9e8e1584148540a287a1e8a7dbb6e5d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:41:03.642544 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-76517fdc-fa6f-48fa-a8bf-3e1d4e2cfe65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:03.719278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 750/1502] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:41:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:41:03.733052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366e406-66df-4e15-ae49-83b197ff0271 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:03.733365 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366e406-66df-4e15-ae49-83b197ff0271 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:03.733690 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366e406-66df-4e15-ae49-83b197ff0271 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:03.735032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 753/1503] 10.222.0.58 () {54 vars in 964 bytes} [Wed Aug 24 09:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:41:03.739681 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdb18a-6405-46c9-95a3-d2e02555c9db None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:03.740045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdb18a-6405-46c9-95a3-d2e02555c9db None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:03.740326 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdb18a-6405-46c9-95a3-d2e02555c9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:03.772176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:41:03.819149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-f6cdb18a-6405-46c9-95a3-d2e02555c9db None None] MFA Rules not processed for user `782bdef852d34b9ba3a957962f93994f`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:41:03.820371 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-f6cdb18a-6405-46c9-95a3-d2e02555c9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:03.896973 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 751/1504] 10.222.0.58 () {58 vars in 1061 bytes} [Wed Aug 24 09:41:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:41:03.904666 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366e406-66df-4e15-ae49-83b197ff0271 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:41:03.906243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2366e406-66df-4e15-ae49-83b197ff0271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:03.956519 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:41:04.011409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366e406-66df-4e15-ae49-83b197ff0271 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:41:04.083797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc68f4-0d55-4317-9741-7ea2b5029286 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:41:04.084401 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc68f4-0d55-4317-9741-7ea2b5029286 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:04.084675 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc68f4-0d55-4317-9741-7ea2b5029286 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:04.084943 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc68f4-0d55-4317-9741-7ea2b5029286 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:04.086580 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-87fc68f4-0d55-4317-9741-7ea2b5029286 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:04.186963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc68f4-0d55-4317-9741-7ea2b5029286 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:41:04.188317 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc68f4-0d55-4317-9741-7ea2b5029286 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:41:04.191849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:41:04.207599 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 754/1505] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:41:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:41:04.253124 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53266f-c4df-4dd4-a5d3-19640d1a7408 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:04.253406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53266f-c4df-4dd4-a5d3-19640d1a7408 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:04.253707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53266f-c4df-4dd4-a5d3-19640d1a7408 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:04.254958 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 752/1506] 10.222.0.58 () {52 vars in 830 bytes} [Wed Aug 24 09:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:41:04.259390 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc68f4-0d55-4317-9741-7ea2b5029286 service cinder] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:41:04.260617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-87fc68f4-0d55-4317-9741-7ea2b5029286 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:04.365906 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc68f4-0d55-4317-9741-7ea2b5029286 service cinder] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:41:04.468055 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da72bf-67e2-4acd-884f-924eb5fdfd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:41:04.468765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da72bf-67e2-4acd-884f-924eb5fdfd19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:04.468866 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da72bf-67e2-4acd-884f-924eb5fdfd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:04.469119 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da72bf-67e2-4acd-884f-924eb5fdfd19 admin admin] PATH_INFO: `/v3/users/9e8e1584148540a287a1e8a7dbb6e5d6` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:04.484330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da72bf-67e2-4acd-884f-924eb5fdfd19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e8e1584148540a287a1e8a7dbb6e5d6)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:41:04.485895 dv-cinder-854271-2-smb devstack@keystone.service[82885]: WARNING py.warnings [None req-11da72bf-67e2-4acd-884f-924eb5fdfd19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:41:04.485895 dv-cinder-854271-2-smb devstack@keystone.service[82885]: warnings.warn(msg) Aug 24 09:41:04.485895 dv-cinder-854271-2-smb devstack@keystone.service[82885]: Aug 24 09:41:04.487828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da72bf-67e2-4acd-884f-924eb5fdfd19 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:41:04.499498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:41:04.569746 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-11da72bf-67e2-4acd-884f-924eb5fdfd19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e8e1584148540a287a1e8a7dbb6e5d6'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:41:04.570408 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-11da72bf-67e2-4acd-884f-924eb5fdfd19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e8e1584148540a287a1e8a7dbb6e5d6'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:41:04.612281 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-11da72bf-67e2-4acd-884f-924eb5fdfd19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e8e1584148540a287a1e8a7dbb6e5d6'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:41:04.625874 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-11da72bf-67e2-4acd-884f-924eb5fdfd19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e8e1584148540a287a1e8a7dbb6e5d6'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:41:04.642614 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-11da72bf-67e2-4acd-884f-924eb5fdfd19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e8e1584148540a287a1e8a7dbb6e5d6'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:41:04.648937 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 755/1507] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:41:04 2022] DELETE /identity/v3/users/9e8e1584148540a287a1e8a7dbb6e5d6 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:41:04.653513 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ef8e8-5757-4324-8e7d-59303249f774 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:04.653814 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ef8e8-5757-4324-8e7d-59303249f774 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:04.654089 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ef8e8-5757-4324-8e7d-59303249f774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:04.725624 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-9d9ef8e8-5757-4324-8e7d-59303249f774 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:41:04.727052 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-9d9ef8e8-5757-4324-8e7d-59303249f774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:04.821698 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:41:04.837370 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 753/1508] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:41:04.848100 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da72bf-67e2-4acd-884f-924eb5fdfd19 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:41:04.849983 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-11da72bf-67e2-4acd-884f-924eb5fdfd19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:04.963960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da72bf-67e2-4acd-884f-924eb5fdfd19 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:41:05.025443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:41:05.049904 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71d8e7-6555-4911-8d8e-7b9490acbfaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:41:05.050520 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71d8e7-6555-4911-8d8e-7b9490acbfaa service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:05.050800 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71d8e7-6555-4911-8d8e-7b9490acbfaa service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:05.051074 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71d8e7-6555-4911-8d8e-7b9490acbfaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:05.052986 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-db71d8e7-6555-4911-8d8e-7b9490acbfaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:05.180685 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71d8e7-6555-4911-8d8e-7b9490acbfaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:41:05.182172 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71d8e7-6555-4911-8d8e-7b9490acbfaa service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:41:05.207681 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 756/1509] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:41:05.537050 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ef8e8-5757-4324-8e7d-59303249f774 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:41:05.538536 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-9d9ef8e8-5757-4324-8e7d-59303249f774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:41:05.550077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ef8e8-5757-4324-8e7d-59303249f774 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:41:05.648252 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd802504-969b-4439-a742-6185cd75c74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:41:05.648879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd802504-969b-4439-a742-6185cd75c74c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:41:05.649180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd802504-969b-4439-a742-6185cd75c74c admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:41:05.649455 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd802504-969b-4439-a742-6185cd75c74c admin admin] PATH_INFO: `/v3/projects/3ee993edc788442dbf0394f67f9aaaf2` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:41:05.659450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd802504-969b-4439-a742-6185cd75c74c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee993edc788442dbf0394f67f9aaaf2)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:41:05.660475 dv-cinder-854271-2-smb devstack@keystone.service[82884]: WARNING py.warnings [None req-bd802504-969b-4439-a742-6185cd75c74c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:41:05.660475 dv-cinder-854271-2-smb devstack@keystone.service[82884]: warnings.warn(msg) Aug 24 09:41:05.660475 dv-cinder-854271-2-smb devstack@keystone.service[82884]: Aug 24 09:41:05.661875 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd802504-969b-4439-a742-6185cd75c74c admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:41:05.719959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-bd802504-969b-4439-a742-6185cd75c74c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee993edc788442dbf0394f67f9aaaf2', 'request_id': 'req-bd802504-969b-4439-a742-6185cd75c74c'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:41:05.729507 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-bd802504-969b-4439-a742-6185cd75c74c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee993edc788442dbf0394f67f9aaaf2', 'request_id': 'req-bd802504-969b-4439-a742-6185cd75c74c'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:41:05.745457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-bd802504-969b-4439-a742-6185cd75c74c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee993edc788442dbf0394f67f9aaaf2', 'request_id': 'req-bd802504-969b-4439-a742-6185cd75c74c'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:41:05.768876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-bd802504-969b-4439-a742-6185cd75c74c admin admin] The token cache is being invalidate because project 3ee993edc788442dbf0394f67f9aaaf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:41:05.769163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-bd802504-969b-4439-a742-6185cd75c74c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:41:05.769754 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-bd802504-969b-4439-a742-6185cd75c74c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:41:05.771072 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 754/1510] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:41:05 2022] DELETE /identity/v3/projects/3ee993edc788442dbf0394f67f9aaaf2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:41:15.205352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=62 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:41:15.766882 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:42:48.358650 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2cf29-049a-4719-b7fe-feaf5c03badb None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:48.359222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2cf29-049a-4719-b7fe-feaf5c03badb None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:48.359222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2cf29-049a-4719-b7fe-feaf5c03badb None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:48.360558 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:42:48.365286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece79175-6d36-40b9-9ecc-a7b3e87997fa None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:48.365769 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece79175-6d36-40b9-9ecc-a7b3e87997fa None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:48.365958 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece79175-6d36-40b9-9ecc-a7b3e87997fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:48.446019 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-ece79175-6d36-40b9-9ecc-a7b3e87997fa None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:42:48.447233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ece79175-6d36-40b9-9ecc-a7b3e87997fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:48.556826 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:42:48.714187 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2cf29-049a-4719-b7fe-feaf5c03badb None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:48.716342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-50c2cf29-049a-4719-b7fe-feaf5c03badb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:48.838555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2cf29-049a-4719-b7fe-feaf5c03badb None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:48.846702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7c73a-ddaf-4b5a-b6e7-2ba01a367970 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:48.847488 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7c73a-ddaf-4b5a-b6e7-2ba01a367970 service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:48.847811 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7c73a-ddaf-4b5a-b6e7-2ba01a367970 service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:48.848223 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7c73a-ddaf-4b5a-b6e7-2ba01a367970 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:48.857118 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7c73a-ddaf-4b5a-b6e7-2ba01a367970 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:48.858748 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7c73a-ddaf-4b5a-b6e7-2ba01a367970 service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:48.868195 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 758/1513] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:42:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:42:49.713929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b3ec0-bece-45fc-b22d-a8d9e5ad1278 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:49.714480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b3ec0-bece-45fc-b22d-a8d9e5ad1278 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:49.714480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b3ec0-bece-45fc-b22d-a8d9e5ad1278 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:49.715812 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:42:49.720554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cedc49-9dda-4666-8df4-252f1f0eeaa2 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:49.720985 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cedc49-9dda-4666-8df4-252f1f0eeaa2 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:49.721084 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cedc49-9dda-4666-8df4-252f1f0eeaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:49.741282 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-80cedc49-9dda-4666-8df4-252f1f0eeaa2 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:42:49.742496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-80cedc49-9dda-4666-8df4-252f1f0eeaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:49.750548 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:42:49.903800 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b3ec0-bece-45fc-b22d-a8d9e5ad1278 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:49.918253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b3ec0-bece-45fc-b22d-a8d9e5ad1278 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:49.923671 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a30b73-4de9-4cdd-b408-1f3d2ead2cc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:49.924262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a30b73-4de9-4cdd-b408-1f3d2ead2cc6 service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:49.924542 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a30b73-4de9-4cdd-b408-1f3d2ead2cc6 service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:49.924816 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a30b73-4de9-4cdd-b408-1f3d2ead2cc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:49.933416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a30b73-4de9-4cdd-b408-1f3d2ead2cc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:49.935048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a30b73-4de9-4cdd-b408-1f3d2ead2cc6 service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:49.945043 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 757/1516] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:42:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:42:50.177153 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f479c-65cf-4774-926c-3947a02efefe None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:50.177441 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f479c-65cf-4774-926c-3947a02efefe None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:50.178067 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f479c-65cf-4774-926c-3947a02efefe None None] PATH_INFO: `/v3` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:50.179559 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 760/1517] 10.222.0.40 () {54 vars in 925 bytes} [Wed Aug 24 09:42:50 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:42:50.186564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa9769-5275-4bd4-b566-5716daf7c549 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:50.186852 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa9769-5275-4bd4-b566-5716daf7c549 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:50.187127 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa9769-5275-4bd4-b566-5716daf7c549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:50.248573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-a8aa9769-5275-4bd4-b566-5716daf7c549 None None] MFA Rules not processed for user `6983e364f5564ed7854dff06a80f55d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:42:50.249832 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-a8aa9769-5275-4bd4-b566-5716daf7c549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:50.266837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:42:50.323286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 758/1518] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Aug 24 09:42:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:42:59.235495 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470f060-34da-4f81-993e-13bd69cd3514 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:59.235958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470f060-34da-4f81-993e-13bd69cd3514 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:59.236072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470f060-34da-4f81-993e-13bd69cd3514 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:59.237397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 761/1519] 10.222.0.58 () {54 vars in 961 bytes} [Wed Aug 24 09:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:42:59.242986 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b5428-e3aa-43f2-9d47-7d35a14888de None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:59.243451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b5428-e3aa-43f2-9d47-7d35a14888de None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:59.243671 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b5428-e3aa-43f2-9d47-7d35a14888de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:59.262873 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-056b5428-e3aa-43f2-9d47-7d35a14888de None None] MFA Rules not processed for user `6983e364f5564ed7854dff06a80f55d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:42:59.264073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-056b5428-e3aa-43f2-9d47-7d35a14888de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:42:59.273058 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 759/1520] 10.222.0.58 () {58 vars in 1058 bytes} [Wed Aug 24 09:42:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:42:59.280590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470f060-34da-4f81-993e-13bd69cd3514 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:42:59.295104 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470f060-34da-4f81-993e-13bd69cd3514 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:42:59.300051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cc104-8918-4255-b37b-58d4772df88e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983e364f5564ed7854dff06a80f55d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:42:59.300646 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cc104-8918-4255-b37b-58d4772df88e service placement] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:42:59.300925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cc104-8918-4255-b37b-58d4772df88e service placement] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:42:59.301202 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cc104-8918-4255-b37b-58d4772df88e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:42:59.309369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842cc104-8918-4255-b37b-58d4772df88e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:42:59.310973 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842cc104-8918-4255-b37b-58d4772df88e service placement] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:42:59.321431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 762/1521] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:42:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:01.157249 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb17c23-bf13-439f-949c-ae69062c9d6f None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:01.157832 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb17c23-bf13-439f-949c-ae69062c9d6f None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:01.157832 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb17c23-bf13-439f-949c-ae69062c9d6f None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:01.159138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:43:01.164393 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef4a90-4c65-4185-815e-49053f128cfb None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:01.164830 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef4a90-4c65-4185-815e-49053f128cfb None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:01.164934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef4a90-4c65-4185-815e-49053f128cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:01.184511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-06ef4a90-4c65-4185-815e-49053f128cfb None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:01.185731 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-06ef4a90-4c65-4185-815e-49053f128cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:01.194121 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:01.347734 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb17c23-bf13-439f-949c-ae69062c9d6f None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:01.362589 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb17c23-bf13-439f-949c-ae69062c9d6f None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:01.368642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66894e-c432-467c-afb2-5d6be559bdcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:01.369237 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66894e-c432-467c-afb2-5d6be559bdcf service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:01.369549 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66894e-c432-467c-afb2-5d6be559bdcf service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:01.369827 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66894e-c432-467c-afb2-5d6be559bdcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:01.377753 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66894e-c432-467c-afb2-5d6be559bdcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:01.379322 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66894e-c432-467c-afb2-5d6be559bdcf service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:01.389201 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 761/1524] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:02.205077 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5127e0-61c1-431c-b4ad-1533a3bb318d None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:02.205650 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5127e0-61c1-431c-b4ad-1533a3bb318d None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:02.205650 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5127e0-61c1-431c-b4ad-1533a3bb318d None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:02.207056 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 09:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:43:02.212388 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b2a77-eb3e-4645-b77a-5a2205cd6b77 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:02.212830 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b2a77-eb3e-4645-b77a-5a2205cd6b77 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:02.212964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b2a77-eb3e-4645-b77a-5a2205cd6b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:02.233362 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-d53b2a77-eb3e-4645-b77a-5a2205cd6b77 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:02.234584 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-d53b2a77-eb3e-4645-b77a-5a2205cd6b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:02.242421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 09:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:02.392667 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5127e0-61c1-431c-b4ad-1533a3bb318d None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:02.406881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5127e0-61c1-431c-b4ad-1533a3bb318d None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:02.412804 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd04e79-8f28-4b08-b93a-4bba46b260ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:02.413360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd04e79-8f28-4b08-b93a-4bba46b260ee service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:02.413664 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd04e79-8f28-4b08-b93a-4bba46b260ee service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:02.413932 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd04e79-8f28-4b08-b93a-4bba46b260ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:02.421861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd04e79-8f28-4b08-b93a-4bba46b260ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:02.423413 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd04e79-8f28-4b08-b93a-4bba46b260ee service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:02.433716 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 765/1527] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:06.503894 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc154b7c-d244-4fef-a121-6e59f4bcc03f None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:06.504473 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc154b7c-d244-4fef-a121-6e59f4bcc03f None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:06.504473 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc154b7c-d244-4fef-a121-6e59f4bcc03f None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:06.505788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:43:06.511076 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6221d8-90b8-4858-8eef-d75c8c243634 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:06.511511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6221d8-90b8-4858-8eef-d75c8c243634 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:06.511638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6221d8-90b8-4858-8eef-d75c8c243634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:06.531933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-ed6221d8-90b8-4858-8eef-d75c8c243634 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:06.533146 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-ed6221d8-90b8-4858-8eef-d75c8c243634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:06.541946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:06.834406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc154b7c-d244-4fef-a121-6e59f4bcc03f None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:06.836157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-fc154b7c-d244-4fef-a121-6e59f4bcc03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:06.916879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc154b7c-d244-4fef-a121-6e59f4bcc03f None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:06.920872 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed214230-bd88-4d59-81f9-af41f5dc5b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:06.921656 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed214230-bd88-4d59-81f9-af41f5dc5b04 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:06.921985 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed214230-bd88-4d59-81f9-af41f5dc5b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:06.922307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed214230-bd88-4d59-81f9-af41f5dc5b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:06.932022 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed214230-bd88-4d59-81f9-af41f5dc5b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:06.933439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed214230-bd88-4d59-81f9-af41f5dc5b04 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:06.943398 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 764/1530] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:08.827487 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8456f-c554-4e0a-bdc4-ca6aecf5ee72 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:08.828057 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8456f-c554-4e0a-bdc4-ca6aecf5ee72 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:08.828057 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8456f-c554-4e0a-bdc4-ca6aecf5ee72 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:08.829419 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:43:08.834771 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bf1e0-5b83-4c58-b6c8-548322e2c554 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:08.835218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bf1e0-5b83-4c58-b6c8-548322e2c554 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:08.835369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bf1e0-5b83-4c58-b6c8-548322e2c554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:08.856901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-660bf1e0-5b83-4c58-b6c8-548322e2c554 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:08.860005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-660bf1e0-5b83-4c58-b6c8-548322e2c554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:08.868256 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:09.153486 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8456f-c554-4e0a-bdc4-ca6aecf5ee72 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:09.164876 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8456f-c554-4e0a-bdc4-ca6aecf5ee72 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:09.168374 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fb1f8-7fb5-4137-8954-fa32ace2df11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:09.168964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fb1f8-7fb5-4137-8954-fa32ace2df11 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:09.169243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fb1f8-7fb5-4137-8954-fa32ace2df11 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:09.169579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fb1f8-7fb5-4137-8954-fa32ace2df11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:09.179230 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fb1f8-7fb5-4137-8954-fa32ace2df11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:09.180640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fb1f8-7fb5-4137-8954-fa32ace2df11 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:09.189979 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 768/1533] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:13.084107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e94603-7929-4dbb-833d-39d7533561c0 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:13.084701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e94603-7929-4dbb-833d-39d7533561c0 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:13.084701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e94603-7929-4dbb-833d-39d7533561c0 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:13.086015 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:43:13 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:43:13.091565 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949ed85-d746-4530-8357-ccff776221a0 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:13.092025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949ed85-d746-4530-8357-ccff776221a0 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:13.092138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949ed85-d746-4530-8357-ccff776221a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:13.112565 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-a949ed85-d746-4530-8357-ccff776221a0 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:13.113901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a949ed85-d746-4530-8357-ccff776221a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:13.122018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:13.668612 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e94603-7929-4dbb-833d-39d7533561c0 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:13.670321 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-21e94603-7929-4dbb-833d-39d7533561c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:13.735241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:13.749100 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e94603-7929-4dbb-833d-39d7533561c0 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:13.752652 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88d494-9c41-435f-ad4b-c401bb1f9efb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:13.753249 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88d494-9c41-435f-ad4b-c401bb1f9efb service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:13.753557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88d494-9c41-435f-ad4b-c401bb1f9efb service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:13.754039 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88d494-9c41-435f-ad4b-c401bb1f9efb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:13.764115 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88d494-9c41-435f-ad4b-c401bb1f9efb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:13.765562 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88d494-9c41-435f-ad4b-c401bb1f9efb service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:13.774905 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 767/1536] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:43:15.716051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4219e2b-831c-410f-bd80-41f182772655 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:15.716627 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4219e2b-831c-410f-bd80-41f182772655 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:15.716627 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4219e2b-831c-410f-bd80-41f182772655 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:15.718004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 09:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:43:15.723171 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd111dc-642e-4bc5-acab-a50f0dfc0038 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:15.723878 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd111dc-642e-4bc5-acab-a50f0dfc0038 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:15.724314 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd111dc-642e-4bc5-acab-a50f0dfc0038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:15.743960 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-7cd111dc-642e-4bc5-acab-a50f0dfc0038 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:43:15.745147 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7cd111dc-642e-4bc5-acab-a50f0dfc0038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:15.752743 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 09:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:43:16.300041 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4219e2b-831c-410f-bd80-41f182772655 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:43:16.302367 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f4219e2b-831c-410f-bd80-41f182772655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:43:16.310085 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=84 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:16.316740 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4219e2b-831c-410f-bd80-41f182772655 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:43:16.321322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabad67-8b0b-4e3f-a59e-a2c9378f34e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:43:16.321985 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabad67-8b0b-4e3f-a59e-a2c9378f34e4 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:43:16.322266 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabad67-8b0b-4e3f-a59e-a2c9378f34e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:43:16.322537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabad67-8b0b-4e3f-a59e-a2c9378f34e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:43:16.331602 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabad67-8b0b-4e3f-a59e-a2c9378f34e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:43:16.333017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabad67-8b0b-4e3f-a59e-a2c9378f34e4 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:43:16.342441 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 771/1539] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:43:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:43:25.738600 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=11 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:26.338251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=5 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:49.148633 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af970713-5ffd-46ac-a15e-3961870cbfb8 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.149258 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af970713-5ffd-46ac-a15e-3961870cbfb8 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.149258 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af970713-5ffd-46ac-a15e-3961870cbfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.170898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-af970713-5ffd-46ac-a15e-3961870cbfb8 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:49.172531 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-af970713-5ffd-46ac-a15e-3961870cbfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:49.185940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 769/1540] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:49.196136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f4093-bb3b-4f39-bcbe-2035cd214900 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.196749 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f4093-bb3b-4f39-bcbe-2035cd214900 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.196749 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f4093-bb3b-4f39-bcbe-2035cd214900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.229733 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-087f4093-bb3b-4f39-bcbe-2035cd214900 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:49.230990 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-087f4093-bb3b-4f39-bcbe-2035cd214900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:49.248300 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 772/1541] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:49.249607 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af970713-5ffd-46ac-a15e-3961870cbfb8 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:49.269719 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af970713-5ffd-46ac-a15e-3961870cbfb8 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:49.282150 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135f5f-4c5c-4369-848b-7789923c332b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:49.282782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135f5f-4c5c-4369-848b-7789923c332b admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.283136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135f5f-4c5c-4369-848b-7789923c332b admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.283468 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135f5f-4c5c-4369-848b-7789923c332b admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.284105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1135f5f-4c5c-4369-848b-7789923c332b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:44:49.284412 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1135f5f-4c5c-4369-848b-7789923c332b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:49.286058 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1135f5f-4c5c-4369-848b-7789923c332b admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:49.302970 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 770/1542] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:44:49.311229 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f4093-bb3b-4f39-bcbe-2035cd214900 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:49.325427 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f4093-bb3b-4f39-bcbe-2035cd214900 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:49.333808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a871b-83d3-434f-a5e2-82d59f351ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:49.334670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a871b-83d3-434f-a5e2-82d59f351ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.334956 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a871b-83d3-434f-a5e2-82d59f351ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.335233 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a871b-83d3-434f-a5e2-82d59f351ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.336055 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a871b-83d3-434f-a5e2-82d59f351ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:49.337998 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a871b-83d3-434f-a5e2-82d59f351ee5 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:49.367048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0bbef-3730-4a18-b288-35e19d9924b3 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.367334 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0bbef-3730-4a18-b288-35e19d9924b3 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.368057 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0bbef-3730-4a18-b288-35e19d9924b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.393190 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 773/1543] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/projects => generated 393 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:49.397414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a871b-83d3-434f-a5e2-82d59f351ee5 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:49.398758 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-84e0bbef-3730-4a18-b288-35e19d9924b3 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:49.400432 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-84e0bbef-3730-4a18-b288-35e19d9924b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:49.500470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 771/1544] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:49.504245 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caac4a-da00-4639-8dd0-528322b82658 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.504800 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caac4a-da00-4639-8dd0-528322b82658 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.505299 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caac4a-da00-4639-8dd0-528322b82658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.513321 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a871b-83d3-434f-a5e2-82d59f351ee5 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:49.528286 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d5191-64de-4c17-b90c-d38d9ff46bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:49.529397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d5191-64de-4c17-b90c-d38d9ff46bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.529939 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d5191-64de-4c17-b90c-d38d9ff46bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.530443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d5191-64de-4c17-b90c-d38d9ff46bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.531323 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d5191-64de-4c17-b90c-d38d9ff46bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:49.532736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: WARNING py.warnings [None req-e40d5191-64de-4c17-b90c-d38d9ff46bc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:44:49.532736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: warnings.warn(msg) Aug 24 09:44:49.532736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: Aug 24 09:44:49.535113 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d5191-64de-4c17-b90c-d38d9ff46bc6 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:49.542440 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-29caac4a-da00-4639-8dd0-528322b82658 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:49.543678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-29caac4a-da00-4639-8dd0-528322b82658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:49.557405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 772/1545] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:49.558694 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f41b57-e48d-4827-ab12-24308f7066cb None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.566534 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 774/1546] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:49.566735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f41b57-e48d-4827-ab12-24308f7066cb None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.566735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f41b57-e48d-4827-ab12-24308f7066cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.567210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c490c5-2fbe-4954-af0e-c360d0b655e5 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.567442 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c490c5-2fbe-4954-af0e-c360d0b655e5 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.567724 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c490c5-2fbe-4954-af0e-c360d0b655e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.592205 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-a2c490c5-2fbe-4954-af0e-c360d0b655e5 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:49.593414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a2c490c5-2fbe-4954-af0e-c360d0b655e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:49.597146 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-14f41b57-e48d-4827-ab12-24308f7066cb None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:49.598341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-14f41b57-e48d-4827-ab12-24308f7066cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:49.602218 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 775/1547] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:49.603526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e4934-f986-47dc-b411-16810422dd8c None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.603925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e4934-f986-47dc-b411-16810422dd8c None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.604219 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e4934-f986-47dc-b411-16810422dd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.613511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 773/1548] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:49.613511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3cd36-c6c2-4f39-a1d0-c28f2e10aa32 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.613511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3cd36-c6c2-4f39-a1d0-c28f2e10aa32 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.613511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3cd36-c6c2-4f39-a1d0-c28f2e10aa32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.629154 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-22a3cd36-c6c2-4f39-a1d0-c28f2e10aa32 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:49.630401 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-22a3cd36-c6c2-4f39-a1d0-c28f2e10aa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:49.630549 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-0e1e4934-f986-47dc-b411-16810422dd8c None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:49.631693 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-0e1e4934-f986-47dc-b411-16810422dd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:49.638798 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 774/1549] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:49.640130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 776/1550] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:49.640258 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68587b6-473c-4097-8288-3bc3ef7724b0 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.640258 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68587b6-473c-4097-8288-3bc3ef7724b0 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.640577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68587b6-473c-4097-8288-3bc3ef7724b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.640838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e4934-f986-47dc-b411-16810422dd8c None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:49.650936 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e4934-f986-47dc-b411-16810422dd8c None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:49.655704 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fb60d-ffbe-46e0-a345-4a0ffe476c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:49.656296 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fb60d-ffbe-46e0-a345-4a0ffe476c58 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.656571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fb60d-ffbe-46e0-a345-4a0ffe476c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.656840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fb60d-ffbe-46e0-a345-4a0ffe476c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.657491 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010fb60d-ffbe-46e0-a345-4a0ffe476c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:49.659607 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010fb60d-ffbe-46e0-a345-4a0ffe476c58 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:49.664078 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-c68587b6-473c-4097-8288-3bc3ef7724b0 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:49.665400 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-c68587b6-473c-4097-8288-3bc3ef7724b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:49.669711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 777/1551] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:49.670906 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494477e8-2303-4eb5-a6a6-7d39f6655c30 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.671187 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494477e8-2303-4eb5-a6a6-7d39f6655c30 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.671457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494477e8-2303-4eb5-a6a6-7d39f6655c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.677151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 775/1552] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:49.678581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2f3e1-1297-496a-979a-73be6d2d60ba None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.678872 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2f3e1-1297-496a-979a-73be6d2d60ba None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.679153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2f3e1-1297-496a-979a-73be6d2d60ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.691654 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-494477e8-2303-4eb5-a6a6-7d39f6655c30 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:49.692869 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-494477e8-2303-4eb5-a6a6-7d39f6655c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:49.698397 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-a9d2f3e1-1297-496a-979a-73be6d2d60ba None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:49.699556 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-a9d2f3e1-1297-496a-979a-73be6d2d60ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:49.701028 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 778/1553] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:49.702302 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ba422-b516-4a0c-968f-ed9c3e2292ce None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.702585 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ba422-b516-4a0c-968f-ed9c3e2292ce None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.702858 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ba422-b516-4a0c-968f-ed9c3e2292ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.707695 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 776/1554] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:49.708947 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b7be9-573e-4af0-a27b-3c6deb5ca5d2 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.709294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b7be9-573e-4af0-a27b-3c6deb5ca5d2 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.709613 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b7be9-573e-4af0-a27b-3c6deb5ca5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.723460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-870ba422-b516-4a0c-968f-ed9c3e2292ce None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:49.724660 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-870ba422-b516-4a0c-968f-ed9c3e2292ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:49.731259 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-517b7be9-573e-4af0-a27b-3c6deb5ca5d2 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:49.732445 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-517b7be9-573e-4af0-a27b-3c6deb5ca5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:49.732559 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 779/1555] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:49.733271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ba422-b516-4a0c-968f-ed9c3e2292ce None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:49.741683 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 777/1556] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:49.742908 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cd291-f0d2-4180-8481-885b70a017dc None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.743190 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cd291-f0d2-4180-8481-885b70a017dc None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.743302 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ba422-b516-4a0c-968f-ed9c3e2292ce None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:49.743472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cd291-f0d2-4180-8481-885b70a017dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.748341 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac0aa4-0dfe-40a4-9a76-a25f6c641f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:49.748929 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac0aa4-0dfe-40a4-9a76-a25f6c641f50 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.749210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac0aa4-0dfe-40a4-9a76-a25f6c641f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.749506 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac0aa4-0dfe-40a4-9a76-a25f6c641f50 admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.750161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac0aa4-0dfe-40a4-9a76-a25f6c641f50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:44:49.750470 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac0aa4-0dfe-40a4-9a76-a25f6c641f50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:49.753141 dv-cinder-854271-2-smb devstack@keystone.service[82885]: WARNING py.warnings [None req-77ac0aa4-0dfe-40a4-9a76-a25f6c641f50 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:44:49.753141 dv-cinder-854271-2-smb devstack@keystone.service[82885]: warnings.warn(msg) Aug 24 09:44:49.753141 dv-cinder-854271-2-smb devstack@keystone.service[82885]: Aug 24 09:44:49.754082 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac0aa4-0dfe-40a4-9a76-a25f6c641f50 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:49.762987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-719cd291-f0d2-4180-8481-885b70a017dc None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:49.764839 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-719cd291-f0d2-4180-8481-885b70a017dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:49.766083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 780/1557] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:44:49.767054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac0aa4-0dfe-40a4-9a76-a25f6c641f50 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:49.773362 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 778/1558] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:49.774419 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0545f0-b023-4b8c-9625-1795cdf38a8f None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.774704 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0545f0-b023-4b8c-9625-1795cdf38a8f None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.774977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0545f0-b023-4b8c-9625-1795cdf38a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.779322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac0aa4-0dfe-40a4-9a76-a25f6c641f50 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:49.785221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fe489-6876-4300-81a5-d66eb9d15408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:49.785910 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fe489-6876-4300-81a5-d66eb9d15408 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.786215 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fe489-6876-4300-81a5-d66eb9d15408 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.786486 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fe489-6876-4300-81a5-d66eb9d15408 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.787115 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fe489-6876-4300-81a5-d66eb9d15408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:49.788680 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fe489-6876-4300-81a5-d66eb9d15408 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:49.794557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-6c0545f0-b023-4b8c-9625-1795cdf38a8f None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:49.796018 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-6c0545f0-b023-4b8c-9625-1795cdf38a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:49.800375 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 781/1559] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:49.801834 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fe489-6876-4300-81a5-d66eb9d15408 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:49.809353 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 779/1560] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:49.810883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfec59-83f8-4f33-b3b8-234fdc2d0131 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.811136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfec59-83f8-4f33-b3b8-234fdc2d0131 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.811404 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfec59-83f8-4f33-b3b8-234fdc2d0131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.818257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fe489-6876-4300-81a5-d66eb9d15408 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:49.822863 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50addb41-91bc-405c-8ca5-13ec980cbd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:49.823470 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50addb41-91bc-405c-8ca5-13ec980cbd8b admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.823754 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50addb41-91bc-405c-8ca5-13ec980cbd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.824032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50addb41-91bc-405c-8ca5-13ec980cbd8b admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.824679 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50addb41-91bc-405c-8ca5-13ec980cbd8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:44:49.825041 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50addb41-91bc-405c-8ca5-13ec980cbd8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:49.826676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50addb41-91bc-405c-8ca5-13ec980cbd8b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:49.832406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-3cdfec59-83f8-4f33-b3b8-234fdc2d0131 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:49.833627 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-3cdfec59-83f8-4f33-b3b8-234fdc2d0131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:49.839511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 782/1561] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:44:49.840226 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50addb41-91bc-405c-8ca5-13ec980cbd8b admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:49.842130 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 780/1562] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:49.842763 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfec59-83f8-4f33-b3b8-234fdc2d0131 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:49.852461 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfec59-83f8-4f33-b3b8-234fdc2d0131 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:49.853769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50addb41-91bc-405c-8ca5-13ec980cbd8b admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:49.857056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986463c2-ed15-4ad8-b651-1ab828c3f71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:49.857679 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986463c2-ed15-4ad8-b651-1ab828c3f71c admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.858011 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986463c2-ed15-4ad8-b651-1ab828c3f71c admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.858287 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986463c2-ed15-4ad8-b651-1ab828c3f71c admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.858934 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986463c2-ed15-4ad8-b651-1ab828c3f71c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:44:49.859043 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82aa49-edec-4fc2-adc7-8f39a6856fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:49.859232 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986463c2-ed15-4ad8-b651-1ab828c3f71c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:49.859698 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82aa49-edec-4fc2-adc7-8f39a6856fcd admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.859981 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82aa49-edec-4fc2-adc7-8f39a6856fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.860256 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82aa49-edec-4fc2-adc7-8f39a6856fcd admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.860809 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986463c2-ed15-4ad8-b651-1ab828c3f71c admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:49.860919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82aa49-edec-4fc2-adc7-8f39a6856fcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:44:49.861289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82aa49-edec-4fc2-adc7-8f39a6856fcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:49.863714 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82aa49-edec-4fc2-adc7-8f39a6856fcd admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:49.872515 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 781/1563] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:44:49.874298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986463c2-ed15-4ad8-b651-1ab828c3f71c admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:49.884369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 783/1564] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:44:49.884369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82aa49-edec-4fc2-adc7-8f39a6856fcd admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:49.885364 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986463c2-ed15-4ad8-b651-1ab828c3f71c admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:49.890008 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46652c-0a24-410a-8dd3-7809387491c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:49.890596 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46652c-0a24-410a-8dd3-7809387491c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.890875 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46652c-0a24-410a-8dd3-7809387491c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.891148 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46652c-0a24-410a-8dd3-7809387491c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.891771 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46652c-0a24-410a-8dd3-7809387491c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:49.893395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: WARNING py.warnings [None req-0d46652c-0a24-410a-8dd3-7809387491c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:44:49.893395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: warnings.warn(msg) Aug 24 09:44:49.893395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: Aug 24 09:44:49.893822 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82aa49-edec-4fc2-adc7-8f39a6856fcd admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:49.894607 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46652c-0a24-410a-8dd3-7809387491c5 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:49.898486 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff579068-53c4-44e4-bdb9-cd84fd7c620e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:49.899077 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff579068-53c4-44e4-bdb9-cd84fd7c620e admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.899355 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff579068-53c4-44e4-bdb9-cd84fd7c620e admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.899629 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff579068-53c4-44e4-bdb9-cd84fd7c620e admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:49.900299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff579068-53c4-44e4-bdb9-cd84fd7c620e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:44:49.900598 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff579068-53c4-44e4-bdb9-cd84fd7c620e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:49.902253 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff579068-53c4-44e4-bdb9-cd84fd7c620e admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:49.914087 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 784/1565] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:44:49.915144 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff579068-53c4-44e4-bdb9-cd84fd7c620e admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:49.927214 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 782/1566] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:44:49 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:49.927400 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff579068-53c4-44e4-bdb9-cd84fd7c620e admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:49.927991 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46652c-0a24-410a-8dd3-7809387491c5 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:49.938524 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:49.982098 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:49.989992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4dcaf4-cbb4-4210-b1db-69f799efa44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:49.990664 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4dcaf4-cbb4-4210-b1db-69f799efa44d admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:49.990940 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4dcaf4-cbb4-4210-b1db-69f799efa44d admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:49.991217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4dcaf4-cbb4-4210-b1db-69f799efa44d admin admin] PATH_INFO: `/v3/projects/6610b09646374657aef5dfe84929577e/users/f197b03d644e4176bf6a0800aae31b4d/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.002327 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46652c-0a24-410a-8dd3-7809387491c5 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.006309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4dcaf4-cbb4-4210-b1db-69f799efa44d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6610b09646374657aef5dfe84929577e, user_id=f197b03d644e4176bf6a0800aae31b4d, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.008944 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4dcaf4-cbb4-4210-b1db-69f799efa44d admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.010256 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f7a39-f9b5-4bc3-8cca-f2116853e9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.011308 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f7a39-f9b5-4bc3-8cca-f2116853e9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.011792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f7a39-f9b5-4bc3-8cca-f2116853e9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.012133 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f7a39-f9b5-4bc3-8cca-f2116853e9d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.013075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f7a39-f9b5-4bc3-8cca-f2116853e9d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:44:50.013400 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f7a39-f9b5-4bc3-8cca-f2116853e9d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.015374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f7a39-f9b5-4bc3-8cca-f2116853e9d2 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.023650 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 785/1567] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:49 2022] PUT /identity/v3/projects/6610b09646374657aef5dfe84929577e/users/f197b03d644e4176bf6a0800aae31b4d/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:50.024400 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4dcaf4-cbb4-4210-b1db-69f799efa44d admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.029179 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 783/1568] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:44:50.030137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f7a39-f9b5-4bc3-8cca-f2116853e9d2 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.041005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f7a39-f9b5-4bc3-8cca-f2116853e9d2 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.086528 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4dcaf4-cbb4-4210-b1db-69f799efa44d admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.091338 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08373bc6-cf4e-49f6-ae0e-4c3fd6f856de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.091951 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08373bc6-cf4e-49f6-ae0e-4c3fd6f856de admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.092231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08373bc6-cf4e-49f6-ae0e-4c3fd6f856de admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.092514 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08373bc6-cf4e-49f6-ae0e-4c3fd6f856de admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.093157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08373bc6-cf4e-49f6-ae0e-4c3fd6f856de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:44:50.093479 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08373bc6-cf4e-49f6-ae0e-4c3fd6f856de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.095078 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08373bc6-cf4e-49f6-ae0e-4c3fd6f856de admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.100420 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f4acd-68ae-4be0-b058-9769428dc5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.101024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f4acd-68ae-4be0-b058-9769428dc5a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.101300 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f4acd-68ae-4be0-b058-9769428dc5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.101606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f4acd-68ae-4be0-b058-9769428dc5a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.102228 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f4acd-68ae-4be0-b058-9769428dc5a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.104222 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f4acd-68ae-4be0-b058-9769428dc5a1 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.108928 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 786/1569] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:44:50.109838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08373bc6-cf4e-49f6-ae0e-4c3fd6f856de admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.119893 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08373bc6-cf4e-49f6-ae0e-4c3fd6f856de admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.125173 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2a5d8-80d9-4cd3-b5fc-e4cb2bec5c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.125900 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2a5d8-80d9-4cd3-b5fc-e4cb2bec5c8f admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.126179 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2a5d8-80d9-4cd3-b5fc-e4cb2bec5c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.126451 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2a5d8-80d9-4cd3-b5fc-e4cb2bec5c8f admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.127569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2a5d8-80d9-4cd3-b5fc-e4cb2bec5c8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.129676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2a5d8-80d9-4cd3-b5fc-e4cb2bec5c8f admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.131756 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 784/1570] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:44:50 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:50.132424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f4acd-68ae-4be0-b058-9769428dc5a1 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.158858 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 787/1571] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:44:50 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:50.159966 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2a5d8-80d9-4cd3-b5fc-e4cb2bec5c8f admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.199165 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f4acd-68ae-4be0-b058-9769428dc5a1 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.222145 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2a5d8-80d9-4cd3-b5fc-e4cb2bec5c8f admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.227585 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88030156-962a-491a-b063-a1280df5cf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.228381 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88030156-962a-491a-b063-a1280df5cf58 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.228482 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88030156-962a-491a-b063-a1280df5cf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.228734 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88030156-962a-491a-b063-a1280df5cf58 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.229361 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88030156-962a-491a-b063-a1280df5cf58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.231337 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88030156-962a-491a-b063-a1280df5cf58 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.245487 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:50.263050 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42047b71-f6e8-413a-9c17-db49ab90c3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.263653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 788/1572] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:44:50 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:50.263884 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42047b71-f6e8-413a-9c17-db49ab90c3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.264446 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88030156-962a-491a-b063-a1280df5cf58 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.267124 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42047b71-f6e8-413a-9c17-db49ab90c3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.267437 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42047b71-f6e8-413a-9c17-db49ab90c3a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.268078 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42047b71-f6e8-413a-9c17-db49ab90c3a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.270009 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42047b71-f6e8-413a-9c17-db49ab90c3a6 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.291130 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:50.303187 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 785/1573] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:44:50 2022] POST /identity/v3/projects => generated 403 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:50.303187 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652307c-fad2-41d5-b5c2-4d9a06b999ce None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.303187 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652307c-fad2-41d5-b5c2-4d9a06b999ce None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.303187 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652307c-fad2-41d5-b5c2-4d9a06b999ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.320589 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-3652307c-fad2-41d5-b5c2-4d9a06b999ce None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:50.321866 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-3652307c-fad2-41d5-b5c2-4d9a06b999ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:50.328951 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88030156-962a-491a-b063-a1280df5cf58 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.383895 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 786/1574] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:50.386343 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652307c-fad2-41d5-b5c2-4d9a06b999ce None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.390373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb00374-88c9-46e7-84b8-b763ea993669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.391003 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb00374-88c9-46e7-84b8-b763ea993669 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.391288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb00374-88c9-46e7-84b8-b763ea993669 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.391562 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb00374-88c9-46e7-84b8-b763ea993669 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.392192 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb00374-88c9-46e7-84b8-b763ea993669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.394418 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb00374-88c9-46e7-84b8-b763ea993669 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.397899 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652307c-fad2-41d5-b5c2-4d9a06b999ce None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.402844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705078b0-7f8d-444f-9d21-0b4765582ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.403891 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705078b0-7f8d-444f-9d21-0b4765582ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.404179 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705078b0-7f8d-444f-9d21-0b4765582ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.404840 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705078b0-7f8d-444f-9d21-0b4765582ec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.405832 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705078b0-7f8d-444f-9d21-0b4765582ec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.408778 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705078b0-7f8d-444f-9d21-0b4765582ec7 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.422310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 789/1575] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:44:50 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:50.422310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb00374-88c9-46e7-84b8-b763ea993669 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.430765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb00374-88c9-46e7-84b8-b763ea993669 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.436369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71dceb-155d-437d-a42d-c7f89cfeb6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.436968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71dceb-155d-437d-a42d-c7f89cfeb6ea admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.437266 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71dceb-155d-437d-a42d-c7f89cfeb6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.437567 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71dceb-155d-437d-a42d-c7f89cfeb6ea admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.438174 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71dceb-155d-437d-a42d-c7f89cfeb6ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.440228 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71dceb-155d-437d-a42d-c7f89cfeb6ea admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.441602 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 787/1576] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:44:50 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:50.442402 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705078b0-7f8d-444f-9d21-0b4765582ec7 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.474236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 790/1577] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:44:50 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:50.474236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71dceb-155d-437d-a42d-c7f89cfeb6ea admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.510142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705078b0-7f8d-444f-9d21-0b4765582ec7 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.535444 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71dceb-155d-437d-a42d-c7f89cfeb6ea admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.540573 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86759ad6-3f72-4a95-b661-e1c3bd8112c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.541177 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86759ad6-3f72-4a95-b661-e1c3bd8112c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.541457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86759ad6-3f72-4a95-b661-e1c3bd8112c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.541811 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86759ad6-3f72-4a95-b661-e1c3bd8112c3 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.542441 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86759ad6-3f72-4a95-b661-e1c3bd8112c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.544855 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86759ad6-3f72-4a95-b661-e1c3bd8112c3 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.556931 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:50.569610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 791/1578] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:44:50 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:50.569867 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10883d27-dc5d-4d26-95e6-12c5e9b8f808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.570489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10883d27-dc5d-4d26-95e6-12c5e9b8f808 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.570616 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86759ad6-3f72-4a95-b661-e1c3bd8112c3 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.570784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10883d27-dc5d-4d26-95e6-12c5e9b8f808 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.571039 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10883d27-dc5d-4d26-95e6-12c5e9b8f808 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.571660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10883d27-dc5d-4d26-95e6-12c5e9b8f808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.573747 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10883d27-dc5d-4d26-95e6-12c5e9b8f808 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.583373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86759ad6-3f72-4a95-b661-e1c3bd8112c3 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.588431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a34ba-8d1a-4e69-8fb6-46cf21d6b1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.589340 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a34ba-8d1a-4e69-8fb6-46cf21d6b1f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.589340 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a34ba-8d1a-4e69-8fb6-46cf21d6b1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.590153 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a34ba-8d1a-4e69-8fb6-46cf21d6b1f4 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.590894 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a34ba-8d1a-4e69-8fb6-46cf21d6b1f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.593230 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a34ba-8d1a-4e69-8fb6-46cf21d6b1f4 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.605599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 788/1579] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:44:50 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:50.605599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10883d27-dc5d-4d26-95e6-12c5e9b8f808 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.614205 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10883d27-dc5d-4d26-95e6-12c5e9b8f808 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.618888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145d1d2-f21e-49ad-91b4-f0f6cae34fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.619356 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 792/1580] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:44:50 2022] POST /identity/v3/users => generated 285 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:50.619495 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145d1d2-f21e-49ad-91b4-f0f6cae34fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.619731 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145d1d2-f21e-49ad-91b4-f0f6cae34fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.619998 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145d1d2-f21e-49ad-91b4-f0f6cae34fb8 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.620197 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a34ba-8d1a-4e69-8fb6-46cf21d6b1f4 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.620614 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145d1d2-f21e-49ad-91b4-f0f6cae34fb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.622542 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145d1d2-f21e-49ad-91b4-f0f6cae34fb8 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.634472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:50.650496 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 789/1581] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:44:50 2022] POST /identity/v3/users => generated 302 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:50.650496 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145d1d2-f21e-49ad-91b4-f0f6cae34fb8 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.659506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145d1d2-f21e-49ad-91b4-f0f6cae34fb8 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.664054 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5f556-a5e8-45a4-847a-3ef0d497122a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.664633 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5f556-a5e8-45a4-847a-3ef0d497122a admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.664910 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5f556-a5e8-45a4-847a-3ef0d497122a admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.665177 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5f556-a5e8-45a4-847a-3ef0d497122a admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.665835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5f556-a5e8-45a4-847a-3ef0d497122a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.667431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5f556-a5e8-45a4-847a-3ef0d497122a admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.678103 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 790/1582] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:50.678801 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5f556-a5e8-45a4-847a-3ef0d497122a admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.679510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a34ba-8d1a-4e69-8fb6-46cf21d6b1f4 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.683512 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e05359-205e-486b-be62-081d4054863c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.684119 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e05359-205e-486b-be62-081d4054863c service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.684397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e05359-205e-486b-be62-081d4054863c service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.684672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e05359-205e-486b-be62-081d4054863c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.690598 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5f556-a5e8-45a4-847a-3ef0d497122a admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.694195 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e05359-205e-486b-be62-081d4054863c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.695349 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6198c-ddd3-4079-80f6-901d0e93f627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.695655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e05359-205e-486b-be62-081d4054863c service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.695933 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6198c-ddd3-4079-80f6-901d0e93f627 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.696212 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6198c-ddd3-4079-80f6-901d0e93f627 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.696489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6198c-ddd3-4079-80f6-901d0e93f627 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.697135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6198c-ddd3-4079-80f6-901d0e93f627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.699204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6198c-ddd3-4079-80f6-901d0e93f627 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.705912 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 793/1583] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:44:50.706485 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e05359-205e-486b-be62-081d4054863c service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.717725 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e05359-205e-486b-be62-081d4054863c service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.722990 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 791/1584] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:44:50 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:50.724026 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313df82b-b009-4fe2-8854-0c97c355da17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.724685 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313df82b-b009-4fe2-8854-0c97c355da17 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.724966 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313df82b-b009-4fe2-8854-0c97c355da17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.725236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313df82b-b009-4fe2-8854-0c97c355da17 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.725907 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313df82b-b009-4fe2-8854-0c97c355da17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.727141 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6198c-ddd3-4079-80f6-901d0e93f627 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.727981 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313df82b-b009-4fe2-8854-0c97c355da17 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.740593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6198c-ddd3-4079-80f6-901d0e93f627 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.746706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b8898-f667-4128-a062-2ee6ee4d6f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.747316 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b8898-f667-4128-a062-2ee6ee4d6f0e admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.747599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b8898-f667-4128-a062-2ee6ee4d6f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.747887 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b8898-f667-4128-a062-2ee6ee4d6f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.748519 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b8898-f667-4128-a062-2ee6ee4d6f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.750294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b8898-f667-4128-a062-2ee6ee4d6f0e admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.752241 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 794/1585] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:44:50 2022] POST /identity/v3/users => generated 290 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:50.753030 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313df82b-b009-4fe2-8854-0c97c355da17 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.764191 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 792/1586] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:50.764681 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313df82b-b009-4fe2-8854-0c97c355da17 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.765864 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b8898-f667-4128-a062-2ee6ee4d6f0e admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.770435 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789797e0-9b1f-4603-a485-60bbaabd2b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.771084 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789797e0-9b1f-4603-a485-60bbaabd2b22 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.771365 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789797e0-9b1f-4603-a485-60bbaabd2b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.771642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789797e0-9b1f-4603-a485-60bbaabd2b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.772291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789797e0-9b1f-4603-a485-60bbaabd2b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.774249 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789797e0-9b1f-4603-a485-60bbaabd2b22 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.778425 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b8898-f667-4128-a062-2ee6ee4d6f0e admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.784115 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f4914-a809-4164-bc03-c45624dcc355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.785431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f4914-a809-4164-bc03-c45624dcc355 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.785999 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f4914-a809-4164-bc03-c45624dcc355 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.786466 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 795/1587] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:50.786722 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f4914-a809-4164-bc03-c45624dcc355 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.787445 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789797e0-9b1f-4603-a485-60bbaabd2b22 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.787763 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f4914-a809-4164-bc03-c45624dcc355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.789554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f4914-a809-4164-bc03-c45624dcc355 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.800754 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789797e0-9b1f-4603-a485-60bbaabd2b22 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.803559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 793/1588] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:50.804716 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f4914-a809-4164-bc03-c45624dcc355 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.807686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8c95e-0e69-4c4f-88a2-dd6bee566a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.808429 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8c95e-0e69-4c4f-88a2-dd6bee566a3a admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.808746 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8c95e-0e69-4c4f-88a2-dd6bee566a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.809014 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8c95e-0e69-4c4f-88a2-dd6bee566a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.809811 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8c95e-0e69-4c4f-88a2-dd6bee566a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.811613 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8c95e-0e69-4c4f-88a2-dd6bee566a3a admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.816079 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f4914-a809-4164-bc03-c45624dcc355 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.821659 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21ec5c-1290-48e9-98cc-8e481d11e1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.822336 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21ec5c-1290-48e9-98cc-8e481d11e1ef admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.822683 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21ec5c-1290-48e9-98cc-8e481d11e1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.823022 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21ec5c-1290-48e9-98cc-8e481d11e1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.823241 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 796/1589] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:50.823997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21ec5c-1290-48e9-98cc-8e481d11e1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.824108 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8c95e-0e69-4c4f-88a2-dd6bee566a3a admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.825788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21ec5c-1290-48e9-98cc-8e481d11e1ef admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.835056 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8c95e-0e69-4c4f-88a2-dd6bee566a3a admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.840362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770c5c3-6ff9-4c7c-8ba2-c88f850c7d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.841163 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770c5c3-6ff9-4c7c-8ba2-c88f850c7d47 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.841523 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 794/1590] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:50.841721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770c5c3-6ff9-4c7c-8ba2-c88f850c7d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.842041 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770c5c3-6ff9-4c7c-8ba2-c88f850c7d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.842530 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21ec5c-1290-48e9-98cc-8e481d11e1ef admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.842715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770c5c3-6ff9-4c7c-8ba2-c88f850c7d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.844775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770c5c3-6ff9-4c7c-8ba2-c88f850c7d47 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.855352 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21ec5c-1290-48e9-98cc-8e481d11e1ef admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.856368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 797/1591] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:50.857435 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770c5c3-6ff9-4c7c-8ba2-c88f850c7d47 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.864676 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cae189-f63f-426e-a86d-8977e617103a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.865349 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cae189-f63f-426e-a86d-8977e617103a admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.865658 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cae189-f63f-426e-a86d-8977e617103a admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.865932 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cae189-f63f-426e-a86d-8977e617103a admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.866717 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cae189-f63f-426e-a86d-8977e617103a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.868357 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cae189-f63f-426e-a86d-8977e617103a admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.868579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770c5c3-6ff9-4c7c-8ba2-c88f850c7d47 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.877500 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fca95e-968a-4dea-9a81-18e0a522ee20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.878284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fca95e-968a-4dea-9a81-18e0a522ee20 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.878485 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fca95e-968a-4dea-9a81-18e0a522ee20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.878749 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fca95e-968a-4dea-9a81-18e0a522ee20 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.879393 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fca95e-968a-4dea-9a81-18e0a522ee20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.880411 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 795/1592] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:50.881133 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cae189-f63f-426e-a86d-8977e617103a admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.881252 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fca95e-968a-4dea-9a81-18e0a522ee20 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.894573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cae189-f63f-426e-a86d-8977e617103a admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.898413 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 798/1593] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:50.898413 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fca95e-968a-4dea-9a81-18e0a522ee20 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.903970 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3334a2-7817-4e4a-ab92-f1574c9b5452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.904507 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3334a2-7817-4e4a-ab92-f1574c9b5452 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.904788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3334a2-7817-4e4a-ab92-f1574c9b5452 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.905260 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3334a2-7817-4e4a-ab92-f1574c9b5452 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.905850 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3334a2-7817-4e4a-ab92-f1574c9b5452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.909132 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fca95e-968a-4dea-9a81-18e0a522ee20 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.909243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3334a2-7817-4e4a-ab92-f1574c9b5452 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.919314 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c875f-8449-4fd5-9416-af14eb424275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.921181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c875f-8449-4fd5-9416-af14eb424275 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.921588 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c875f-8449-4fd5-9416-af14eb424275 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.922109 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c875f-8449-4fd5-9416-af14eb424275 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.922978 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c875f-8449-4fd5-9416-af14eb424275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.924166 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 796/1594] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:50.925935 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3334a2-7817-4e4a-ab92-f1574c9b5452 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.929029 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c875f-8449-4fd5-9416-af14eb424275 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.938071 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3334a2-7817-4e4a-ab92-f1574c9b5452 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.943783 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 799/1595] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:50.944181 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426f330-3d6c-4f5c-82cd-45d4842eb80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.944423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c875f-8449-4fd5-9416-af14eb424275 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.944872 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426f330-3d6c-4f5c-82cd-45d4842eb80d admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.945138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426f330-3d6c-4f5c-82cd-45d4842eb80d admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.945536 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426f330-3d6c-4f5c-82cd-45d4842eb80d admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.946489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426f330-3d6c-4f5c-82cd-45d4842eb80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.948249 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426f330-3d6c-4f5c-82cd-45d4842eb80d admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.955173 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c875f-8449-4fd5-9416-af14eb424275 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.960224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe55c91-3d50-4a04-8986-98f0e12409b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.960565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 797/1596] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:50.960908 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe55c91-3d50-4a04-8986-98f0e12409b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.961165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe55c91-3d50-4a04-8986-98f0e12409b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.961441 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe55c91-3d50-4a04-8986-98f0e12409b7 admin admin] PATH_INFO: `/v3/projects/c53ab7bed5a748e8be861f370e5693f4/users/6a42998888a34c099624c08e64013a13/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.961581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426f330-3d6c-4f5c-82cd-45d4842eb80d admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.971427 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426f330-3d6c-4f5c-82cd-45d4842eb80d admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:50.976630 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6cec7-7cf3-4c5d-b1e4-53eab351e922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:50.977222 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6cec7-7cf3-4c5d-b1e4-53eab351e922 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:50.977524 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6cec7-7cf3-4c5d-b1e4-53eab351e922 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:50.977798 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6cec7-7cf3-4c5d-b1e4-53eab351e922 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:50.978370 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe55c91-3d50-4a04-8986-98f0e12409b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c53ab7bed5a748e8be861f370e5693f4, user_id=6a42998888a34c099624c08e64013a13, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.978564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6cec7-7cf3-4c5d-b1e4-53eab351e922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:50.980149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6cec7-7cf3-4c5d-b1e4-53eab351e922 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.981249 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe55c91-3d50-4a04-8986-98f0e12409b7 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:50.993648 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 798/1597] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:50.995065 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6cec7-7cf3-4c5d-b1e4-53eab351e922 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:50.998734 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 800/1598] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:50 2022] PUT /identity/v3/projects/c53ab7bed5a748e8be861f370e5693f4/users/6a42998888a34c099624c08e64013a13/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:50.999660 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe55c91-3d50-4a04-8986-98f0e12409b7 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:51.006674 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6cec7-7cf3-4c5d-b1e4-53eab351e922 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:51.072977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:51.096104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d22e3b-39f2-4e24-a520-e9e0a4a31465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:51.096568 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe55c91-3d50-4a04-8986-98f0e12409b7 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:51.097021 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d22e3b-39f2-4e24-a520-e9e0a4a31465 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:51.097519 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d22e3b-39f2-4e24-a520-e9e0a4a31465 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:51.097750 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d22e3b-39f2-4e24-a520-e9e0a4a31465 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:51.098373 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d22e3b-39f2-4e24-a520-e9e0a4a31465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:51.099970 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d22e3b-39f2-4e24-a520-e9e0a4a31465 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:51.101751 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02916883-6f73-4aee-986f-d37976cd618c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:51.102494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02916883-6f73-4aee-986f-d37976cd618c admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:51.102775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02916883-6f73-4aee-986f-d37976cd618c admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:51.103051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02916883-6f73-4aee-986f-d37976cd618c admin admin] PATH_INFO: `/v3/projects/98c8349e887c4c81bc5985f436eb457d/users/c8cfca97da3248988fbefb68e2d18692/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:51.121519 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02916883-6f73-4aee-986f-d37976cd618c admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c8349e887c4c81bc5985f436eb457d, user_id=c8cfca97da3248988fbefb68e2d18692, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:51.124173 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02916883-6f73-4aee-986f-d37976cd618c admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:51.128593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 799/1599] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:51.128593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d22e3b-39f2-4e24-a520-e9e0a4a31465 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:51.143268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d22e3b-39f2-4e24-a520-e9e0a4a31465 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:51.147328 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 801/1600] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:50 2022] PUT /identity/v3/projects/98c8349e887c4c81bc5985f436eb457d/users/c8cfca97da3248988fbefb68e2d18692/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:51.148374 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02916883-6f73-4aee-986f-d37976cd618c admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:51.218484 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:51.232187 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02916883-6f73-4aee-986f-d37976cd618c admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:51.238006 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e91ab-f0e6-4288-b77d-4c707fc4c339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:51.238667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e91ab-f0e6-4288-b77d-4c707fc4c339 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:51.238955 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e91ab-f0e6-4288-b77d-4c707fc4c339 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:51.239209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e91ab-f0e6-4288-b77d-4c707fc4c339 admin admin] PATH_INFO: `/v3/projects/0044a66b68e546869fe041d33aa78deb/users/3124a048f8194e149dc3fffd113f55ea/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:51.242409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e313b6-a3c7-439f-aa55-807f79aad384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:51.244238 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e313b6-a3c7-439f-aa55-807f79aad384 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:51.244522 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e313b6-a3c7-439f-aa55-807f79aad384 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:51.244805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e313b6-a3c7-439f-aa55-807f79aad384 admin admin] PATH_INFO: `/v3/projects/88238029e80e4f66ab5ebaf6744f628b/users/7c66ca183f204c0f9d37b3edac740128/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:51.260730 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e91ab-f0e6-4288-b77d-4c707fc4c339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0044a66b68e546869fe041d33aa78deb, user_id=3124a048f8194e149dc3fffd113f55ea, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:51.261842 dv-cinder-854271-2-smb devstack@keystone.service[82884]: WARNING py.warnings [None req-7b2e91ab-f0e6-4288-b77d-4c707fc4c339 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:44:51.261842 dv-cinder-854271-2-smb devstack@keystone.service[82884]: warnings.warn(msg) Aug 24 09:44:51.261842 dv-cinder-854271-2-smb devstack@keystone.service[82884]: Aug 24 09:44:51.262147 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e313b6-a3c7-439f-aa55-807f79aad384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88238029e80e4f66ab5ebaf6744f628b, user_id=7c66ca183f204c0f9d37b3edac740128, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:51.263782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e91ab-f0e6-4288-b77d-4c707fc4c339 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:51.264804 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e313b6-a3c7-439f-aa55-807f79aad384 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:51.278946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 802/1601] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:51 2022] PUT /identity/v3/projects/88238029e80e4f66ab5ebaf6744f628b/users/7c66ca183f204c0f9d37b3edac740128/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:51.279679 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 800/1602] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:51 2022] PUT /identity/v3/projects/0044a66b68e546869fe041d33aa78deb/users/3124a048f8194e149dc3fffd113f55ea/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:51.280291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e313b6-a3c7-439f-aa55-807f79aad384 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:51.281175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e91ab-f0e6-4288-b77d-4c707fc4c339 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:51.367782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e91ab-f0e6-4288-b77d-4c707fc4c339 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:51.370306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e313b6-a3c7-439f-aa55-807f79aad384 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:51.372913 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74973cf2-4cc3-470d-bd6b-eebc916f5abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:51.373708 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74973cf2-4cc3-470d-bd6b-eebc916f5abf admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:51.374061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74973cf2-4cc3-470d-bd6b-eebc916f5abf admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:51.374426 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74973cf2-4cc3-470d-bd6b-eebc916f5abf admin admin] PATH_INFO: `/v3/projects/65b228befe8446fa82809a13ffd6bb2f/users/1b1b38b0aa504cd1ac7e851be5b6e266/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:51.376310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af1f9d-e14c-4e0d-9508-ceee4e3ae5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:51.379068 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af1f9d-e14c-4e0d-9508-ceee4e3ae5b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:51.379362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af1f9d-e14c-4e0d-9508-ceee4e3ae5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:51.379643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af1f9d-e14c-4e0d-9508-ceee4e3ae5b3 admin admin] PATH_INFO: `/v3/projects/7da8b5a85e6a431abc1dae053bcf8f5b/users/eaaa3676d00248dfbebdb89ed535ea45/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:51.392355 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74973cf2-4cc3-470d-bd6b-eebc916f5abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b228befe8446fa82809a13ffd6bb2f, user_id=1b1b38b0aa504cd1ac7e851be5b6e266, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:51.395194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74973cf2-4cc3-470d-bd6b-eebc916f5abf admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:51.398373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af1f9d-e14c-4e0d-9508-ceee4e3ae5b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7da8b5a85e6a431abc1dae053bcf8f5b, user_id=eaaa3676d00248dfbebdb89ed535ea45, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:51.401857 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af1f9d-e14c-4e0d-9508-ceee4e3ae5b3 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:51.411138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 801/1603] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:51 2022] PUT /identity/v3/projects/65b228befe8446fa82809a13ffd6bb2f/users/1b1b38b0aa504cd1ac7e851be5b6e266/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:51.412589 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47b8a9-85d6-4751-bd05-938a36e08728 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:51.412881 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47b8a9-85d6-4751-bd05-938a36e08728 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:51.413159 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47b8a9-85d6-4751-bd05-938a36e08728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:51.420677 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 803/1604] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:51 2022] PUT /identity/v3/projects/7da8b5a85e6a431abc1dae053bcf8f5b/users/eaaa3676d00248dfbebdb89ed535ea45/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:51.433537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af1f9d-e14c-4e0d-9508-ceee4e3ae5b3 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:51.445902 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-ab47b8a9-85d6-4751-bd05-938a36e08728 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:51.447286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ab47b8a9-85d6-4751-bd05-938a36e08728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:51.495477 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:51.538068 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af1f9d-e14c-4e0d-9508-ceee4e3ae5b3 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:51.544896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b561385-4c48-44ef-9a2c-243d23b10da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:51.545784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b561385-4c48-44ef-9a2c-243d23b10da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:51.546203 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b561385-4c48-44ef-9a2c-243d23b10da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:51.546584 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b561385-4c48-44ef-9a2c-243d23b10da1 admin admin] PATH_INFO: `/v3/projects/6cca418a0bb54f728c67515702b1086c/users/8985c6b6a96a4f8ba785876fb3508302/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:51.552804 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 802/1605] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:51.554163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc9e27-2ce3-4688-bd27-9c70fda3cdb2 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:51.554448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc9e27-2ce3-4688-bd27-9c70fda3cdb2 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:51.554724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc9e27-2ce3-4688-bd27-9c70fda3cdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:51.565969 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b561385-4c48-44ef-9a2c-243d23b10da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cca418a0bb54f728c67515702b1086c, user_id=8985c6b6a96a4f8ba785876fb3508302, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:51.568937 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b561385-4c48-44ef-9a2c-243d23b10da1 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:51.593845 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 804/1606] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:51 2022] PUT /identity/v3/projects/6cca418a0bb54f728c67515702b1086c/users/8985c6b6a96a4f8ba785876fb3508302/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:51.605013 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-c7bc9e27-2ce3-4688-bd27-9c70fda3cdb2 None None] MFA Rules not processed for user `c8cfca97da3248988fbefb68e2d18692`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:51.605638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744da4f2-92cc-49b4-8293-3c8fa66c4fe6 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:51.606020 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744da4f2-92cc-49b4-8293-3c8fa66c4fe6 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:51.606300 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-c7bc9e27-2ce3-4688-bd27-9c70fda3cdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:51.606427 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744da4f2-92cc-49b4-8293-3c8fa66c4fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:51.644838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-744da4f2-92cc-49b4-8293-3c8fa66c4fe6 None None] MFA Rules not processed for user `3124a048f8194e149dc3fffd113f55ea`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:51.646214 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-744da4f2-92cc-49b4-8293-3c8fa66c4fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:51.665924 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:51.698956 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 803/1607] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:51.703447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d105786-d8b5-4725-a1e5-e6879298fb4d None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:51.704159 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d105786-d8b5-4725-a1e5-e6879298fb4d None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:51.704442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d105786-d8b5-4725-a1e5-e6879298fb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:51.736693 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 805/1608] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:51.736693 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49e333-1bbf-4b89-947d-bf6e696d54cd None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:51.736693 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49e333-1bbf-4b89-947d-bf6e696d54cd None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:51.736693 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49e333-1bbf-4b89-947d-bf6e696d54cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:51.759030 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-2d105786-d8b5-4725-a1e5-e6879298fb4d None None] MFA Rules not processed for user `7c66ca183f204c0f9d37b3edac740128`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:51.760583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-2d105786-d8b5-4725-a1e5-e6879298fb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:51.795736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-7f49e333-1bbf-4b89-947d-bf6e696d54cd None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:51.802259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-7f49e333-1bbf-4b89-947d-bf6e696d54cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:51.879180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 804/1609] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:51.880353 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e88b0a-74d0-4637-9500-98459d560b7a None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:51.880643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e88b0a-74d0-4637-9500-98459d560b7a None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:51.881173 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e88b0a-74d0-4637-9500-98459d560b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:51.894679 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 806/1610] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:51.899496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49e333-1bbf-4b89-947d-bf6e696d54cd None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:51.944254 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-f7e88b0a-74d0-4637-9500-98459d560b7a None None] MFA Rules not processed for user `eaaa3676d00248dfbebdb89ed535ea45`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:51.946012 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-f7e88b0a-74d0-4637-9500-98459d560b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:51.977355 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:51.988147 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49e333-1bbf-4b89-947d-bf6e696d54cd None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:51.994160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a322d-7cac-44a6-9104-9b78337d2221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:51.996273 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a322d-7cac-44a6-9104-9b78337d2221 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:51.996556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a322d-7cac-44a6-9104-9b78337d2221 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:51.997314 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a322d-7cac-44a6-9104-9b78337d2221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:52.015493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a322d-7cac-44a6-9104-9b78337d2221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:52.017563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a322d-7cac-44a6-9104-9b78337d2221 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:52.031037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 807/1611] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:44:52.033899 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8c557-c708-468f-82d5-12bdf05568ac None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:52.034486 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8c557-c708-468f-82d5-12bdf05568ac None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:52.034924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8c557-c708-468f-82d5-12bdf05568ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:52.035269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 805/1612] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:51 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:52.036217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e88b0a-74d0-4637-9500-98459d560b7a None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:52.060105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-9bc8c557-c708-468f-82d5-12bdf05568ac None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:52.061678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-9bc8c557-c708-468f-82d5-12bdf05568ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:52.073075 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 808/1613] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:52.073075 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edc0a5-eeba-4ae2-93a9-3e08c70d51c5 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:52.073075 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edc0a5-eeba-4ae2-93a9-3e08c70d51c5 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:52.073075 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edc0a5-eeba-4ae2-93a9-3e08c70d51c5 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:52.073835 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 809/1614] 10.222.0.58 () {54 vars in 962 bytes} [Wed Aug 24 09:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:44:52.074540 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edc0a5-eeba-4ae2-93a9-3e08c70d51c5 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:52.098227 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edc0a5-eeba-4ae2-93a9-3e08c70d51c5 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:52.103885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412775f3-b910-4855-882f-41a89a8eb6b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:52.104933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412775f3-b910-4855-882f-41a89a8eb6b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:52.105443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412775f3-b910-4855-882f-41a89a8eb6b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:52.106001 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412775f3-b910-4855-882f-41a89a8eb6b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:52.129949 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412775f3-b910-4855-882f-41a89a8eb6b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:52.132010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412775f3-b910-4855-882f-41a89a8eb6b4 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:52.142802 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e88b0a-74d0-4637-9500-98459d560b7a None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:52.148063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6053d02-8b85-48ee-9ce4-f98a44260fc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:52.149534 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6053d02-8b85-48ee-9ce4-f98a44260fc0 service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:52.153893 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6053d02-8b85-48ee-9ce4-f98a44260fc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:52.154218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6053d02-8b85-48ee-9ce4-f98a44260fc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:52.158412 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 810/1615] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:44:52.163420 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910ab70-e13c-4c6a-a722-128a1f78aa23 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:52.163943 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910ab70-e13c-4c6a-a722-128a1f78aa23 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:52.165405 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910ab70-e13c-4c6a-a722-128a1f78aa23 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:52.166471 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6053d02-8b85-48ee-9ce4-f98a44260fc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:52.167930 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 811/1616] 10.222.0.58 () {54 vars in 962 bytes} [Wed Aug 24 09:44:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:44:52.168070 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6053d02-8b85-48ee-9ce4-f98a44260fc0 service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:52.176924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910ab70-e13c-4c6a-a722-128a1f78aa23 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:52.181659 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 806/1617] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:44:52.183370 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e8d49-5f4e-444d-9b16-9e63199d6865 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:52.183778 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e8d49-5f4e-444d-9b16-9e63199d6865 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:52.184053 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e8d49-5f4e-444d-9b16-9e63199d6865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:52.194204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:52.237289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910ab70-e13c-4c6a-a722-128a1f78aa23 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:52.241026 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-e03e8d49-5f4e-444d-9b16-9e63199d6865 None None] MFA Rules not processed for user `18be8c54c9644c5e9812eea09e60c11c`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:52.242371 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e03e8d49-5f4e-444d-9b16-9e63199d6865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:52.264290 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708597f8-047d-47bb-82df-3503640488db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:52.268370 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708597f8-047d-47bb-82df-3503640488db admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:52.268667 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708597f8-047d-47bb-82df-3503640488db admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:52.271999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708597f8-047d-47bb-82df-3503640488db admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:52.272786 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708597f8-047d-47bb-82df-3503640488db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:52.280056 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708597f8-047d-47bb-82df-3503640488db admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:52.351791 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 807/1618] 10.222.0.58 () {58 vars in 1059 bytes} [Wed Aug 24 09:44:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:52.353498 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e8d49-5f4e-444d-9b16-9e63199d6865 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:52.358468 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 812/1619] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:44:52 2022] POST /identity/v3/projects => generated 403 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:52.358468 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712b7f8-27bf-424f-a53a-20973f578829 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:52.358468 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712b7f8-27bf-424f-a53a-20973f578829 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:52.358468 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712b7f8-27bf-424f-a53a-20973f578829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:52.374568 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e8d49-5f4e-444d-9b16-9e63199d6865 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:52.401957 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-7712b7f8-27bf-424f-a53a-20973f578829 None None] MFA Rules not processed for user `18be8c54c9644c5e9812eea09e60c11c`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:52.404711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-7712b7f8-27bf-424f-a53a-20973f578829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:52.475965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136de2a-8358-4d99-8b72-5cc63a61e7e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:52.477738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136de2a-8358-4d99-8b72-5cc63a61e7e6 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:52.478024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136de2a-8358-4d99-8b72-5cc63a61e7e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:52.478299 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136de2a-8358-4d99-8b72-5cc63a61e7e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:52.579746 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 813/1620] 10.222.0.58 () {58 vars in 1059 bytes} [Wed Aug 24 09:44:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:52.582223 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712b7f8-27bf-424f-a53a-20973f578829 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:52.600704 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136de2a-8358-4d99-8b72-5cc63a61e7e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:52.604094 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136de2a-8358-4d99-8b72-5cc63a61e7e6 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:52.614147 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712b7f8-27bf-424f-a53a-20973f578829 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:52.618850 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 808/1621] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:44:52.619781 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136de2a-8358-4d99-8b72-5cc63a61e7e6 service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:52.629497 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce36943-d418-4ad5-97db-448447d15b3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:52.630106 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce36943-d418-4ad5-97db-448447d15b3a service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:52.630544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce36943-d418-4ad5-97db-448447d15b3a service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:52.630828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce36943-d418-4ad5-97db-448447d15b3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:52.633974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136de2a-8358-4d99-8b72-5cc63a61e7e6 service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:52.642204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3271a5-dc0c-409c-b9fa-9823dee76f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:52.643526 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3271a5-dc0c-409c-b9fa-9823dee76f48 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:52.644459 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3271a5-dc0c-409c-b9fa-9823dee76f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:52.644744 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3271a5-dc0c-409c-b9fa-9823dee76f48 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:52.645949 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3271a5-dc0c-409c-b9fa-9823dee76f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:52.648494 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3271a5-dc0c-409c-b9fa-9823dee76f48 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:52.686561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 809/1622] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:44:52 2022] POST /identity/v3/users => generated 308 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:52.686561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3271a5-dc0c-409c-b9fa-9823dee76f48 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:52.704713 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3271a5-dc0c-409c-b9fa-9823dee76f48 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:52.735822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daeced2-2097-4a25-b576-b846728b7ab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:52.737396 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daeced2-2097-4a25-b576-b846728b7ab7 service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:52.738590 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daeced2-2097-4a25-b576-b846728b7ab7 service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:52.738590 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daeced2-2097-4a25-b576-b846728b7ab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:52.758728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:52.778415 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce36943-d418-4ad5-97db-448447d15b3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:52.780033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce36943-d418-4ad5-97db-448447d15b3a service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:52.814743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 814/1623] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:44:52.815942 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce36943-d418-4ad5-97db-448447d15b3a service nova] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:52.850091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce36943-d418-4ad5-97db-448447d15b3a service nova] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:52.864096 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97b3d1-7c98-42dd-a590-c9a2f52bd2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:52.864769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97b3d1-7c98-42dd-a590-c9a2f52bd2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:52.865057 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97b3d1-7c98-42dd-a590-c9a2f52bd2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:52.873672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97b3d1-7c98-42dd-a590-c9a2f52bd2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:52.874403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97b3d1-7c98-42dd-a590-c9a2f52bd2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:52.879985 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97b3d1-7c98-42dd-a590-c9a2f52bd2c6 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:52.912994 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 815/1624] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:52.916852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97b3d1-7c98-42dd-a590-c9a2f52bd2c6 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:52.937938 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daeced2-2097-4a25-b576-b846728b7ab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:52.942504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daeced2-2097-4a25-b576-b846728b7ab7 service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:52.945945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97b3d1-7c98-42dd-a590-c9a2f52bd2c6 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:52.962135 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec218517-4b90-4181-933a-5c59ec7701fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:52.962818 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec218517-4b90-4181-933a-5c59ec7701fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:52.963372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec218517-4b90-4181-933a-5c59ec7701fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:52.963625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec218517-4b90-4181-933a-5c59ec7701fc admin admin] PATH_INFO: `/v3/projects/1026673373334d76a743d7ea41e36bf1/users/7f947c55b0f7440aa599128f0392748f/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:53.035369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 810/1625] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:44:53.068633 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec218517-4b90-4181-933a-5c59ec7701fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1026673373334d76a743d7ea41e36bf1, user_id=7f947c55b0f7440aa599128f0392748f, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:53.068633 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec218517-4b90-4181-933a-5c59ec7701fc admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:53.068633 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 816/1626] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:52 2022] PUT /identity/v3/projects/1026673373334d76a743d7ea41e36bf1/users/7f947c55b0f7440aa599128f0392748f/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:53.071491 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daeced2-2097-4a25-b576-b846728b7ab7 service nova] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:53.086446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daeced2-2097-4a25-b576-b846728b7ab7 service nova] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:53.232731 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5752b-586e-4884-85fd-a8916356b30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:53.233763 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5752b-586e-4884-85fd-a8916356b30b admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:53.235542 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5752b-586e-4884-85fd-a8916356b30b admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:53.235898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5752b-586e-4884-85fd-a8916356b30b admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:53.238126 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5752b-586e-4884-85fd-a8916356b30b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:53.242742 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5752b-586e-4884-85fd-a8916356b30b admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:53.279382 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 811/1627] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:53.284380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec218517-4b90-4181-933a-5c59ec7701fc admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:53.291163 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:53.301358 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec218517-4b90-4181-933a-5c59ec7701fc admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:53.319986 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b06fc8-157c-4fb8-b9c6-dbdde6b44685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:53.320737 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b06fc8-157c-4fb8-b9c6-dbdde6b44685 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:53.321022 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b06fc8-157c-4fb8-b9c6-dbdde6b44685 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:53.321296 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b06fc8-157c-4fb8-b9c6-dbdde6b44685 admin admin] PATH_INFO: `/v3/projects/1026673373334d76a743d7ea41e36bf1/users/7f947c55b0f7440aa599128f0392748f/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:53.326983 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b06fc8-157c-4fb8-b9c6-dbdde6b44685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1026673373334d76a743d7ea41e36bf1, user_id=7f947c55b0f7440aa599128f0392748f, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:53.332112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b06fc8-157c-4fb8-b9c6-dbdde6b44685 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:53.369907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28a767-a646-4bdd-893a-f667c2aed1fb None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:53.370282 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28a767-a646-4bdd-893a-f667c2aed1fb None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:53.370559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28a767-a646-4bdd-893a-f667c2aed1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:53.379809 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 817/1628] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:53 2022] PUT /identity/v3/projects/1026673373334d76a743d7ea41e36bf1/users/7f947c55b0f7440aa599128f0392748f/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:53.427813 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-4d28a767-a646-4bdd-893a-f667c2aed1fb None None] MFA Rules not processed for user `7f947c55b0f7440aa599128f0392748f`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:53.429328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-4d28a767-a646-4bdd-893a-f667c2aed1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:53.472794 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f94a54-7424-4453-b612-616ffc325b61 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:53.473274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f94a54-7424-4453-b612-616ffc325b61 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:53.473740 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f94a54-7424-4453-b612-616ffc325b61 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:53.475972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 818/1629] 10.222.0.58 () {54 vars in 912 bytes} [Wed Aug 24 09:44:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:44:53.487925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64342865-126e-49c0-a82f-44528ebf445c None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:53.488225 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64342865-126e-49c0-a82f-44528ebf445c None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:53.488540 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64342865-126e-49c0-a82f-44528ebf445c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:53.530303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-64342865-126e-49c0-a82f-44528ebf445c None None] MFA Rules not processed for user `18be8c54c9644c5e9812eea09e60c11c`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:53.531531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-64342865-126e-49c0-a82f-44528ebf445c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:53.604841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 812/1630] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:53 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:53.605718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28a767-a646-4bdd-893a-f667c2aed1fb None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:53.720145 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:53.742989 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 819/1631] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 09:44:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:53.746884 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd34b2-bcf3-4eb5-abda-f81ca2d4d676 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:53.747173 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd34b2-bcf3-4eb5-abda-f81ca2d4d676 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:53.747971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd34b2-bcf3-4eb5-abda-f81ca2d4d676 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:53.752893 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 820/1632] 10.222.0.58 () {54 vars in 912 bytes} [Wed Aug 24 09:44:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:44:53.757581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bee7d2-6e4d-42a4-8ac6-9f95085b2dc7 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:53.757866 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bee7d2-6e4d-42a4-8ac6-9f95085b2dc7 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:53.758136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bee7d2-6e4d-42a4-8ac6-9f95085b2dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:53.763415 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28a767-a646-4bdd-893a-f667c2aed1fb None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:53.773929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71252365-7890-4763-a88e-06c3334c006f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:53.775573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71252365-7890-4763-a88e-06c3334c006f service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:53.776470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71252365-7890-4763-a88e-06c3334c006f service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:53.776750 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71252365-7890-4763-a88e-06c3334c006f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:53.811319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71252365-7890-4763-a88e-06c3334c006f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:53.813248 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71252365-7890-4763-a88e-06c3334c006f service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:53.814761 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-70bee7d2-6e4d-42a4-8ac6-9f95085b2dc7 None None] MFA Rules not processed for user `18be8c54c9644c5e9812eea09e60c11c`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:53.816740 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-70bee7d2-6e4d-42a4-8ac6-9f95085b2dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:53.840604 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 813/1633] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:53 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:44:53.855599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71252365-7890-4763-a88e-06c3334c006f service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:53.858345 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 821/1634] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 09:44:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:44:53.883990 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71252365-7890-4763-a88e-06c3334c006f service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:53.892231 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4da8fa-cef1-4901-ba52-f459047dc6a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:53.893743 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4da8fa-cef1-4901-ba52-f459047dc6a0 service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:53.894029 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4da8fa-cef1-4901-ba52-f459047dc6a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:53.894379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4da8fa-cef1-4901-ba52-f459047dc6a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:53.932178 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bee7d2-6e4d-42a4-8ac6-9f95085b2dc7 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:53.939784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4da8fa-cef1-4901-ba52-f459047dc6a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:53.943272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4da8fa-cef1-4901-ba52-f459047dc6a0 service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:53.946568 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bee7d2-6e4d-42a4-8ac6-9f95085b2dc7 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:53.959189 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b68daf-d880-43ab-a31e-51cd86aa73c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:53.960052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b68daf-d880-43ab-a31e-51cd86aa73c2 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:53.960554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b68daf-d880-43ab-a31e-51cd86aa73c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:53.961095 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b68daf-d880-43ab-a31e-51cd86aa73c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:53.981136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 814/1635] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:44:53.991107 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b68daf-d880-43ab-a31e-51cd86aa73c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:53.992594 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b68daf-d880-43ab-a31e-51cd86aa73c2 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:54.015709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 822/1636] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:44:54.306950 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4da8fa-cef1-4901-ba52-f459047dc6a0 service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:54.366639 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b68daf-d880-43ab-a31e-51cd86aa73c2 service cinder] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:54.406425 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4da8fa-cef1-4901-ba52-f459047dc6a0 service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:54.413521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cfeef-4420-4e06-b7eb-c4d1eeeca850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:54.414383 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cfeef-4420-4e06-b7eb-c4d1eeeca850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:54.414767 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cfeef-4420-4e06-b7eb-c4d1eeeca850 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:54.415225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cfeef-4420-4e06-b7eb-c4d1eeeca850 admin admin] PATH_INFO: `/v3/users/eaaa3676d00248dfbebdb89ed535ea45` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:54.417993 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cfeef-4420-4e06-b7eb-c4d1eeeca850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaaa3676d00248dfbebdb89ed535ea45)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:54.421139 dv-cinder-854271-2-smb devstack@keystone.service[82884]: WARNING py.warnings [None req-9a8cfeef-4420-4e06-b7eb-c4d1eeeca850 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:44:54.421139 dv-cinder-854271-2-smb devstack@keystone.service[82884]: warnings.warn(msg) Aug 24 09:44:54.421139 dv-cinder-854271-2-smb devstack@keystone.service[82884]: Aug 24 09:44:54.422896 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cfeef-4420-4e06-b7eb-c4d1eeeca850 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:54.510799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-9a8cfeef-4420-4e06-b7eb-c4d1eeeca850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaaa3676d00248dfbebdb89ed535ea45'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:54.512926 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-9a8cfeef-4420-4e06-b7eb-c4d1eeeca850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaaa3676d00248dfbebdb89ed535ea45'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:54.515323 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-9a8cfeef-4420-4e06-b7eb-c4d1eeeca850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaaa3676d00248dfbebdb89ed535ea45'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:54.550808 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-9a8cfeef-4420-4e06-b7eb-c4d1eeeca850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaaa3676d00248dfbebdb89ed535ea45'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:54.564095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-9a8cfeef-4420-4e06-b7eb-c4d1eeeca850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaaa3676d00248dfbebdb89ed535ea45'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:54.568787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b68daf-d880-43ab-a31e-51cd86aa73c2 service cinder] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:54.582135 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fec204-462c-4aae-ad5a-adcf21fc8662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:54.582802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fec204-462c-4aae-ad5a-adcf21fc8662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:54.583086 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fec204-462c-4aae-ad5a-adcf21fc8662 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:54.583385 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fec204-462c-4aae-ad5a-adcf21fc8662 admin admin] PATH_INFO: `/v3/users/3124a048f8194e149dc3fffd113f55ea` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:54.584615 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fec204-462c-4aae-ad5a-adcf21fc8662 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3124a048f8194e149dc3fffd113f55ea)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:54.586576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fec204-462c-4aae-ad5a-adcf21fc8662 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:54.596587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 815/1637] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:44:54 2022] DELETE /identity/v3/users/eaaa3676d00248dfbebdb89ed535ea45 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:54.598672 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de734aa2-66d4-4221-9ad3-bf5f42dcd288 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:54.599140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de734aa2-66d4-4221-9ad3-bf5f42dcd288 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:54.599516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de734aa2-66d4-4221-9ad3-bf5f42dcd288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:54.632120 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-de734aa2-66d4-4221-9ad3-bf5f42dcd288 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:54.633921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-de734aa2-66d4-4221-9ad3-bf5f42dcd288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:54.682169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b8fec204-462c-4aae-ad5a-adcf21fc8662 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3124a048f8194e149dc3fffd113f55ea'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:54.684589 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b8fec204-462c-4aae-ad5a-adcf21fc8662 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3124a048f8194e149dc3fffd113f55ea'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:54.717245 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:54.719116 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b8fec204-462c-4aae-ad5a-adcf21fc8662 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3124a048f8194e149dc3fffd113f55ea'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:54.737915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b8fec204-462c-4aae-ad5a-adcf21fc8662 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3124a048f8194e149dc3fffd113f55ea'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:54.754330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b8fec204-462c-4aae-ad5a-adcf21fc8662 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3124a048f8194e149dc3fffd113f55ea'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:54.761315 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 823/1638] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:44:54 2022] DELETE /identity/v3/users/3124a048f8194e149dc3fffd113f55ea => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:54.767033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3686c40-6c9a-4376-b74f-ccb08a5d0aca None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:54.767544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3686c40-6c9a-4376-b74f-ccb08a5d0aca None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:54.768090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3686c40-6c9a-4376-b74f-ccb08a5d0aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:54.794209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:54.815385 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-a3686c40-6c9a-4376-b74f-ccb08a5d0aca None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:54.818698 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a3686c40-6c9a-4376-b74f-ccb08a5d0aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:54.831384 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 816/1639] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:55.015898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de734aa2-66d4-4221-9ad3-bf5f42dcd288 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:55.018070 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-de734aa2-66d4-4221-9ad3-bf5f42dcd288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:55.089316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 824/1640] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:55.152054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3686c40-6c9a-4376-b74f-ccb08a5d0aca None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:55.153254 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a3686c40-6c9a-4376-b74f-ccb08a5d0aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:55.302695 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3686c40-6c9a-4376-b74f-ccb08a5d0aca None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:55.311281 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72b43b-1bc5-4b64-b638-250df21d9354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:55.312043 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72b43b-1bc5-4b64-b638-250df21d9354 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:55.312534 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72b43b-1bc5-4b64-b638-250df21d9354 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:55.312697 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72b43b-1bc5-4b64-b638-250df21d9354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:55.321028 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de734aa2-66d4-4221-9ad3-bf5f42dcd288 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:55.325268 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72b43b-1bc5-4b64-b638-250df21d9354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:55.329499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72b43b-1bc5-4b64-b638-250df21d9354 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:55.337010 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21b689-508e-487c-aee0-7e6dcff35d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:55.341739 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21b689-508e-487c-aee0-7e6dcff35d7b service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:55.342087 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21b689-508e-487c-aee0-7e6dcff35d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:55.344325 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21b689-508e-487c-aee0-7e6dcff35d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:55.359231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 825/1641] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:44:55.393816 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21b689-508e-487c-aee0-7e6dcff35d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:55.395304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21b689-508e-487c-aee0-7e6dcff35d7b service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:55.426547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 817/1642] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:44:56.596391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72b43b-1bc5-4b64-b638-250df21d9354 service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:56.598476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-8b72b43b-1bc5-4b64-b638-250df21d9354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:56.621402 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72b43b-1bc5-4b64-b638-250df21d9354 service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:56.621639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21b689-508e-487c-aee0-7e6dcff35d7b service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:56.623296 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-3b21b689-508e-487c-aee0-7e6dcff35d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:56.626982 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973cc15-c5ad-4d96-82c8-4960cb999ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:56.628437 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973cc15-c5ad-4d96-82c8-4960cb999ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:56.628727 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973cc15-c5ad-4d96-82c8-4960cb999ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:56.629006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973cc15-c5ad-4d96-82c8-4960cb999ef3 admin admin] PATH_INFO: `/v3/projects/0044a66b68e546869fe041d33aa78deb` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:56.630264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973cc15-c5ad-4d96-82c8-4960cb999ef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0044a66b68e546869fe041d33aa78deb)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:56.631563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: WARNING py.warnings [None req-7973cc15-c5ad-4d96-82c8-4960cb999ef3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:44:56.631563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: warnings.warn(msg) Aug 24 09:44:56.631563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: Aug 24 09:44:56.632768 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973cc15-c5ad-4d96-82c8-4960cb999ef3 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:56.644832 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21b689-508e-487c-aee0-7e6dcff35d7b service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:56.660562 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5155047-2b73-464e-8e6e-6cb1a7e071ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:56.660766 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5155047-2b73-464e-8e6e-6cb1a7e071ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:56.661057 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5155047-2b73-464e-8e6e-6cb1a7e071ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:56.661330 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5155047-2b73-464e-8e6e-6cb1a7e071ab admin admin] PATH_INFO: `/v3/projects/7da8b5a85e6a431abc1dae053bcf8f5b` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:56.662544 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5155047-2b73-464e-8e6e-6cb1a7e071ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=7da8b5a85e6a431abc1dae053bcf8f5b)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:56.666123 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5155047-2b73-464e-8e6e-6cb1a7e071ab admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:56.794855 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b5155047-2b73-464e-8e6e-6cb1a7e071ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7da8b5a85e6a431abc1dae053bcf8f5b', 'request_id': 'req-b5155047-2b73-464e-8e6e-6cb1a7e071ab'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:56.810723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b5155047-2b73-464e-8e6e-6cb1a7e071ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7da8b5a85e6a431abc1dae053bcf8f5b', 'request_id': 'req-b5155047-2b73-464e-8e6e-6cb1a7e071ab'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:56.831687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-7973cc15-c5ad-4d96-82c8-4960cb999ef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0044a66b68e546869fe041d33aa78deb', 'request_id': 'req-7973cc15-c5ad-4d96-82c8-4960cb999ef3'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:56.834205 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b5155047-2b73-464e-8e6e-6cb1a7e071ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7da8b5a85e6a431abc1dae053bcf8f5b', 'request_id': 'req-b5155047-2b73-464e-8e6e-6cb1a7e071ab'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:56.849919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-7973cc15-c5ad-4d96-82c8-4960cb999ef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0044a66b68e546869fe041d33aa78deb', 'request_id': 'req-7973cc15-c5ad-4d96-82c8-4960cb999ef3'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:56.870013 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b5155047-2b73-464e-8e6e-6cb1a7e071ab admin admin] The token cache is being invalidate because project 7da8b5a85e6a431abc1dae053bcf8f5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:44:56.870458 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b5155047-2b73-464e-8e6e-6cb1a7e071ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:56.873064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b5155047-2b73-464e-8e6e-6cb1a7e071ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:56.880901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 818/1643] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:44:56 2022] DELETE /identity/v3/projects/7da8b5a85e6a431abc1dae053bcf8f5b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:56.885599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5155047-2b73-464e-8e6e-6cb1a7e071ab admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:56.888541 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b5155047-2b73-464e-8e6e-6cb1a7e071ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:56.898655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-7973cc15-c5ad-4d96-82c8-4960cb999ef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0044a66b68e546869fe041d33aa78deb', 'request_id': 'req-7973cc15-c5ad-4d96-82c8-4960cb999ef3'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:56.930225 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-7973cc15-c5ad-4d96-82c8-4960cb999ef3 admin admin] The token cache is being invalidate because project 0044a66b68e546869fe041d33aa78deb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:44:56.931234 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-7973cc15-c5ad-4d96-82c8-4960cb999ef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:56.933023 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-7973cc15-c5ad-4d96-82c8-4960cb999ef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:56.942387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 826/1644] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:44:56 2022] DELETE /identity/v3/projects/0044a66b68e546869fe041d33aa78deb => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:56.955970 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0efbf-e083-46c7-97e4-eb778a2d95c4 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:56.956666 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0efbf-e083-46c7-97e4-eb778a2d95c4 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:56.959229 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0efbf-e083-46c7-97e4-eb778a2d95c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:57.000185 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:57.020961 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-a6a0efbf-e083-46c7-97e4-eb778a2d95c4 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:57.023415 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a6a0efbf-e083-46c7-97e4-eb778a2d95c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:57.041538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5155047-2b73-464e-8e6e-6cb1a7e071ab admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:57.099722 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:57.183307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296da8ce-7db8-45ee-ac97-1496cd1f2581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:57.184052 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296da8ce-7db8-45ee-ac97-1496cd1f2581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:57.184422 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296da8ce-7db8-45ee-ac97-1496cd1f2581 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:57.184877 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296da8ce-7db8-45ee-ac97-1496cd1f2581 admin admin] PATH_INFO: `/v3/users/7f947c55b0f7440aa599128f0392748f` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:57.186355 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296da8ce-7db8-45ee-ac97-1496cd1f2581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f947c55b0f7440aa599128f0392748f)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:57.190324 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296da8ce-7db8-45ee-ac97-1496cd1f2581 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:57.272782 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 827/1645] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:57.274432 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbdef4-6b05-4555-876e-ef7c542fade7 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:57.274729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbdef4-6b05-4555-876e-ef7c542fade7 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:57.275010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbdef4-6b05-4555-876e-ef7c542fade7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:57.303470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-296da8ce-7db8-45ee-ac97-1496cd1f2581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f947c55b0f7440aa599128f0392748f'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:57.304177 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-296da8ce-7db8-45ee-ac97-1496cd1f2581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f947c55b0f7440aa599128f0392748f'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:57.306753 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-296da8ce-7db8-45ee-ac97-1496cd1f2581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f947c55b0f7440aa599128f0392748f'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:57.312992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-cabbdef4-6b05-4555-876e-ef7c542fade7 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:57.319905 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-cabbdef4-6b05-4555-876e-ef7c542fade7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:57.329587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-296da8ce-7db8-45ee-ac97-1496cd1f2581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f947c55b0f7440aa599128f0392748f'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:57.338826 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 828/1646] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:44:57.342971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbdef4-6b05-4555-876e-ef7c542fade7 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:57.347476 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-296da8ce-7db8-45ee-ac97-1496cd1f2581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f947c55b0f7440aa599128f0392748f'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:57.367596 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbdef4-6b05-4555-876e-ef7c542fade7 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:57.374305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6890ce-b344-4be0-85fa-580329e15a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:57.375196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6890ce-b344-4be0-85fa-580329e15a33 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:57.375678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6890ce-b344-4be0-85fa-580329e15a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:57.376161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6890ce-b344-4be0-85fa-580329e15a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:57.377699 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6890ce-b344-4be0-85fa-580329e15a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:44:57.380676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6890ce-b344-4be0-85fa-580329e15a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:57.382645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6890ce-b344-4be0-85fa-580329e15a33 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:57.384585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 819/1647] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:44:56 2022] DELETE /identity/v3/users/7f947c55b0f7440aa599128f0392748f => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:57.419439 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 829/1648] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:44:57.424099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296da8ce-7db8-45ee-ac97-1496cd1f2581 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:57.592339 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296da8ce-7db8-45ee-ac97-1496cd1f2581 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:57.613279 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7f13d-69e5-4844-bc3e-1e963d70ac8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:57.615561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7f13d-69e5-4844-bc3e-1e963d70ac8c admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:57.616445 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7f13d-69e5-4844-bc3e-1e963d70ac8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:57.616836 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7f13d-69e5-4844-bc3e-1e963d70ac8c admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:57.619482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7f13d-69e5-4844-bc3e-1e963d70ac8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:57.628306 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7f13d-69e5-4844-bc3e-1e963d70ac8c admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:57.683776 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 820/1649] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:44:57 2022] POST /identity/v3/projects => generated 385 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:57.688104 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6890ce-b344-4be0-85fa-580329e15a33 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:57.705962 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6890ce-b344-4be0-85fa-580329e15a33 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:57.902324 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7f13d-69e5-4844-bc3e-1e963d70ac8c admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:57.904918 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-20c7f13d-69e5-4844-bc3e-1e963d70ac8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:57.989817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8055db9-4605-4933-9df0-f448d573f9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:57.990519 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8055db9-4605-4933-9df0-f448d573f9df admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:57.990701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8055db9-4605-4933-9df0-f448d573f9df admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:57.990978 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8055db9-4605-4933-9df0-f448d573f9df admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:57.991640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8055db9-4605-4933-9df0-f448d573f9df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:57.993681 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8055db9-4605-4933-9df0-f448d573f9df admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:58.021585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:58.093631 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 830/1650] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:44:57 2022] POST /identity/v3/users => generated 293 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:58.094863 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8055db9-4605-4933-9df0-f448d573f9df admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:58.121577 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8055db9-4605-4933-9df0-f448d573f9df admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:58.139542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77036892-1ebe-44a9-ba86-4de03c3cfaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:58.140187 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77036892-1ebe-44a9-ba86-4de03c3cfaae admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:58.140469 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77036892-1ebe-44a9-ba86-4de03c3cfaae admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:58.140918 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77036892-1ebe-44a9-ba86-4de03c3cfaae admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:58.141636 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77036892-1ebe-44a9-ba86-4de03c3cfaae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:58.144927 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77036892-1ebe-44a9-ba86-4de03c3cfaae admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:58.176511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 831/1651] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:58.181615 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77036892-1ebe-44a9-ba86-4de03c3cfaae admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:58.199549 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7f13d-69e5-4844-bc3e-1e963d70ac8c admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:58.214430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77036892-1ebe-44a9-ba86-4de03c3cfaae admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:58.220488 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262ae90-db0e-4a79-aa57-2a2b5962bbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:58.223082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262ae90-db0e-4a79-aa57-2a2b5962bbca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:58.223418 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262ae90-db0e-4a79-aa57-2a2b5962bbca admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:58.223703 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262ae90-db0e-4a79-aa57-2a2b5962bbca admin admin] PATH_INFO: `/v3/users/7c66ca183f204c0f9d37b3edac740128` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:58.231564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262ae90-db0e-4a79-aa57-2a2b5962bbca admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c66ca183f204c0f9d37b3edac740128)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:58.233789 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262ae90-db0e-4a79-aa57-2a2b5962bbca admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:58.239746 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868e72e-0965-4b80-ab8e-306322447565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:58.239746 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868e72e-0965-4b80-ab8e-306322447565 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:58.239746 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868e72e-0965-4b80-ab8e-306322447565 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:58.239746 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868e72e-0965-4b80-ab8e-306322447565 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:58.240097 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868e72e-0965-4b80-ab8e-306322447565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:58.250269 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868e72e-0965-4b80-ab8e-306322447565 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:58.313700 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 832/1652] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:58.316838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868e72e-0965-4b80-ab8e-306322447565 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:58.334106 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868e72e-0965-4b80-ab8e-306322447565 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:58.342887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c069a9c-6892-40b5-a5d1-21de59ecc865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:58.344095 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c069a9c-6892-40b5-a5d1-21de59ecc865 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:58.345288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c069a9c-6892-40b5-a5d1-21de59ecc865 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:58.345804 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c069a9c-6892-40b5-a5d1-21de59ecc865 admin admin] PATH_INFO: `/v3/projects/ef49c7a5278a46da97e221af10ce5fd0/users/f56e681894e64f848c264405ec10c57f/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:58.393335 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c069a9c-6892-40b5-a5d1-21de59ecc865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef49c7a5278a46da97e221af10ce5fd0, user_id=f56e681894e64f848c264405ec10c57f, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:58.394597 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-6262ae90-db0e-4a79-aa57-2a2b5962bbca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c66ca183f204c0f9d37b3edac740128'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:58.396113 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-6262ae90-db0e-4a79-aa57-2a2b5962bbca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c66ca183f204c0f9d37b3edac740128'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:58.398145 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-6262ae90-db0e-4a79-aa57-2a2b5962bbca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c66ca183f204c0f9d37b3edac740128'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:58.401980 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c069a9c-6892-40b5-a5d1-21de59ecc865 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:58.438561 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 833/1653] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:58 2022] PUT /identity/v3/projects/ef49c7a5278a46da97e221af10ce5fd0/users/f56e681894e64f848c264405ec10c57f/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:44:58.449571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-6262ae90-db0e-4a79-aa57-2a2b5962bbca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c66ca183f204c0f9d37b3edac740128'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:58.449798 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0129c-5743-41df-b972-94c754f28309 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:58.450158 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0129c-5743-41df-b972-94c754f28309 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:58.450506 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0129c-5743-41df-b972-94c754f28309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:58.465812 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-6262ae90-db0e-4a79-aa57-2a2b5962bbca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c66ca183f204c0f9d37b3edac740128'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:44:58.496077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 821/1654] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:44:57 2022] DELETE /identity/v3/users/7c66ca183f204c0f9d37b3edac740128 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:58.500554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8cdd1-d535-49bd-b393-53022878b66c None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:58.500683 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8cdd1-d535-49bd-b393-53022878b66c None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:58.500966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8cdd1-d535-49bd-b393-53022878b66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:58.548299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-3fd0129c-5743-41df-b972-94c754f28309 None None] MFA Rules not processed for user `f56e681894e64f848c264405ec10c57f`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:58.550569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-3fd0129c-5743-41df-b972-94c754f28309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:58.562562 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-e8e8cdd1-d535-49bd-b393-53022878b66c None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:58.563848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e8e8cdd1-d535-49bd-b393-53022878b66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:58.606494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:58.736084 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 834/1655] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:58.738709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0129c-5743-41df-b972-94c754f28309 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:58.740241 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-3fd0129c-5743-41df-b972-94c754f28309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:58.746871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 822/1656] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:44:58.760154 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0129c-5743-41df-b972-94c754f28309 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:58.770164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bfa61-3afd-4716-9d01-dfe08d9d901c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:58.771564 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bfa61-3afd-4716-9d01-dfe08d9d901c admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:58.772280 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bfa61-3afd-4716-9d01-dfe08d9d901c admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:58.772890 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7bfa61-3afd-4716-9d01-dfe08d9d901c admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:58.773930 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7bfa61-3afd-4716-9d01-dfe08d9d901c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:58.780986 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7bfa61-3afd-4716-9d01-dfe08d9d901c admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:58.832982 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8cdd1-d535-49bd-b393-53022878b66c None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:58.834632 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e8e8cdd1-d535-49bd-b393-53022878b66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:58.874087 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 835/1657] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:44:58 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:44:58.878407 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bfa61-3afd-4716-9d01-dfe08d9d901c admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:58.955522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:58.973926 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8cdd1-d535-49bd-b393-53022878b66c None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:59.044653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7bfa61-3afd-4716-9d01-dfe08d9d901c admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:59.060323 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9c54f-93eb-4f2f-8fe5-08e6ffa80dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:59.061168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9c54f-93eb-4f2f-8fe5-08e6ffa80dee admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:59.061443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9c54f-93eb-4f2f-8fe5-08e6ffa80dee admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:59.063523 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9c54f-93eb-4f2f-8fe5-08e6ffa80dee admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:59.065251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9c54f-93eb-4f2f-8fe5-08e6ffa80dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:59.070082 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9c54f-93eb-4f2f-8fe5-08e6ffa80dee admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:59.093366 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fdc79-584f-4c14-9e14-9e26d70ace56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:59.094487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fdc79-584f-4c14-9e14-9e26d70ace56 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:59.094915 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fdc79-584f-4c14-9e14-9e26d70ace56 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:59.097120 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fdc79-584f-4c14-9e14-9e26d70ace56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:59.127492 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544fdc79-584f-4c14-9e14-9e26d70ace56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:59.128775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 836/1658] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:44:58 2022] POST /identity/v3/users => generated 299 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:44:59.132598 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9c54f-93eb-4f2f-8fe5-08e6ffa80dee admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:59.133321 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544fdc79-584f-4c14-9e14-9e26d70ace56 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:59.157871 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9c54f-93eb-4f2f-8fe5-08e6ffa80dee admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:59.162718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 823/1659] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:44:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:44:59.185162 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03994f-59d6-454a-9758-bbbd7ff11e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:59.185994 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03994f-59d6-454a-9758-bbbd7ff11e15 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:59.186365 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03994f-59d6-454a-9758-bbbd7ff11e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:59.186644 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03994f-59d6-454a-9758-bbbd7ff11e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:59.190051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03994f-59d6-454a-9758-bbbd7ff11e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:59.205623 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03994f-59d6-454a-9758-bbbd7ff11e15 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:59.234381 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fdc79-584f-4c14-9e14-9e26d70ace56 service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:59.235119 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 837/1660] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:59.249857 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fdc79-584f-4c14-9e14-9e26d70ace56 service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:59.279211 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27730692-69ff-46de-8259-ff6e5d3894af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:59.280369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27730692-69ff-46de-8259-ff6e5d3894af admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:59.280642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27730692-69ff-46de-8259-ff6e5d3894af admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:59.280921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27730692-69ff-46de-8259-ff6e5d3894af admin admin] PATH_INFO: `/v3/projects/f5a538ba85204d71b9527f149a32e732/users/d731477577024277baf0074187f97858/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:59.337299 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27730692-69ff-46de-8259-ff6e5d3894af admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a538ba85204d71b9527f149a32e732, user_id=d731477577024277baf0074187f97858, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:59.340312 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27730692-69ff-46de-8259-ff6e5d3894af admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:59.384518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 824/1661] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:59 2022] PUT /identity/v3/projects/f5a538ba85204d71b9527f149a32e732/users/d731477577024277baf0074187f97858/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:44:59.386203 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03994f-59d6-454a-9758-bbbd7ff11e15 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:59.407068 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03994f-59d6-454a-9758-bbbd7ff11e15 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:59.632935 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc82c1b-5530-43de-8973-e442b31c6b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:59.634620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc82c1b-5530-43de-8973-e442b31c6b7b admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:59.634620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc82c1b-5530-43de-8973-e442b31c6b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:59.634620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc82c1b-5530-43de-8973-e442b31c6b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:59.635093 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc82c1b-5530-43de-8973-e442b31c6b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:59.636823 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc82c1b-5530-43de-8973-e442b31c6b7b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:59.664793 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 838/1662] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:44:59.669316 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27730692-69ff-46de-8259-ff6e5d3894af admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:59.688606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27730692-69ff-46de-8259-ff6e5d3894af admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:59.715839 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436897cf-8f6f-4357-a275-d55d7b39ad84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:59.716923 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436897cf-8f6f-4357-a275-d55d7b39ad84 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:59.717438 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436897cf-8f6f-4357-a275-d55d7b39ad84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:59.718084 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436897cf-8f6f-4357-a275-d55d7b39ad84 admin admin] PATH_INFO: `/v3/projects/f5a538ba85204d71b9527f149a32e732/users/d731477577024277baf0074187f97858/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:59.725712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436897cf-8f6f-4357-a275-d55d7b39ad84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a538ba85204d71b9527f149a32e732, user_id=d731477577024277baf0074187f97858, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:59.734329 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436897cf-8f6f-4357-a275-d55d7b39ad84 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:44:59.738797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc82c1b-5530-43de-8973-e442b31c6b7b admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:44:59.743452 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-4bc82c1b-5530-43de-8973-e442b31c6b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:59.776885 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 825/1663] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:44:59 2022] PUT /identity/v3/projects/f5a538ba85204d71b9527f149a32e732/users/d731477577024277baf0074187f97858/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:44:59.786707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48453fea-90ad-47b1-ac3d-8167c221e855 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:59.787359 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48453fea-90ad-47b1-ac3d-8167c221e855 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:59.787852 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48453fea-90ad-47b1-ac3d-8167c221e855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:59.790929 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc82c1b-5530-43de-8973-e442b31c6b7b admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:44:59.822988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:59.879016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-48453fea-90ad-47b1-ac3d-8167c221e855 None None] MFA Rules not processed for user `d731477577024277baf0074187f97858`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:44:59.880422 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-48453fea-90ad-47b1-ac3d-8167c221e855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:44:59.952134 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfef9c-036a-437c-adc0-dd2d0cded0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:44:59.953004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfef9c-036a-437c-adc0-dd2d0cded0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:44:59.954266 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfef9c-036a-437c-adc0-dd2d0cded0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:44:59.955189 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfef9c-036a-437c-adc0-dd2d0cded0d3 admin admin] PATH_INFO: `/v3/projects/1026673373334d76a743d7ea41e36bf1` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:44:59.958611 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfef9c-036a-437c-adc0-dd2d0cded0d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1026673373334d76a743d7ea41e36bf1)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:44:59.963431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfef9c-036a-437c-adc0-dd2d0cded0d3 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:00.039573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 826/1664] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:44:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:00.057071 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48453fea-90ad-47b1-ac3d-8167c221e855 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:00.059390 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-48453fea-90ad-47b1-ac3d-8167c221e855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:00.097558 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-04cfef9c-036a-437c-adc0-dd2d0cded0d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1026673373334d76a743d7ea41e36bf1', 'request_id': 'req-04cfef9c-036a-437c-adc0-dd2d0cded0d3'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:00.119581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-04cfef9c-036a-437c-adc0-dd2d0cded0d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1026673373334d76a743d7ea41e36bf1', 'request_id': 'req-04cfef9c-036a-437c-adc0-dd2d0cded0d3'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:00.139738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-04cfef9c-036a-437c-adc0-dd2d0cded0d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1026673373334d76a743d7ea41e36bf1', 'request_id': 'req-04cfef9c-036a-437c-adc0-dd2d0cded0d3'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:00.171322 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:00.177134 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48453fea-90ad-47b1-ac3d-8167c221e855 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:00.186327 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-04cfef9c-036a-437c-adc0-dd2d0cded0d3 admin admin] The token cache is being invalidate because project 1026673373334d76a743d7ea41e36bf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:00.186659 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-04cfef9c-036a-437c-adc0-dd2d0cded0d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:00.191217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-04cfef9c-036a-437c-adc0-dd2d0cded0d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:00.196577 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 839/1665] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:44:59 2022] DELETE /identity/v3/projects/1026673373334d76a743d7ea41e36bf1 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:00.202258 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db71bed-65ed-4bb8-a3cd-b4bf5a8c5560 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:00.202816 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db71bed-65ed-4bb8-a3cd-b4bf5a8c5560 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:00.203220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db71bed-65ed-4bb8-a3cd-b4bf5a8c5560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:00.262309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-4db71bed-65ed-4bb8-a3cd-b4bf5a8c5560 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:00.264309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-4db71bed-65ed-4bb8-a3cd-b4bf5a8c5560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:00.279774 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65758c75-7d19-4605-ad57-6802101ca752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:00.280477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65758c75-7d19-4605-ad57-6802101ca752 service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:00.280761 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65758c75-7d19-4605-ad57-6802101ca752 service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:00.281171 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65758c75-7d19-4605-ad57-6802101ca752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:00.285231 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-65758c75-7d19-4605-ad57-6802101ca752 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:00.369444 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 840/1666] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:00.377542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b55c63-cf1b-46d6-9e65-a86b62a5190e None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:00.378167 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b55c63-cf1b-46d6-9e65-a86b62a5190e None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:00.378453 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b55c63-cf1b-46d6-9e65-a86b62a5190e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:00.417504 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-16b55c63-cf1b-46d6-9e65-a86b62a5190e None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:00.425680 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-16b55c63-cf1b-46d6-9e65-a86b62a5190e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:00.445875 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 841/1667] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:00.449878 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b55c63-cf1b-46d6-9e65-a86b62a5190e None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:00.462947 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65758c75-7d19-4605-ad57-6802101ca752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:00.464438 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65758c75-7d19-4605-ad57-6802101ca752 service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:00.474826 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b55c63-cf1b-46d6-9e65-a86b62a5190e None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:00.495219 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3ca54-d6d5-4cf4-b493-6f64c0e09de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:00.495947 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3ca54-d6d5-4cf4-b493-6f64c0e09de1 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:00.496256 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3ca54-d6d5-4cf4-b493-6f64c0e09de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:00.496532 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3ca54-d6d5-4cf4-b493-6f64c0e09de1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:00.497244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3ca54-d6d5-4cf4-b493-6f64c0e09de1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:00.497647 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3ca54-d6d5-4cf4-b493-6f64c0e09de1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:00.499235 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3ca54-d6d5-4cf4-b493-6f64c0e09de1 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:00.502015 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 827/1668] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:00.514579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 842/1669] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:00.518743 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65758c75-7d19-4605-ad57-6802101ca752 service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:00.546886 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65758c75-7d19-4605-ad57-6802101ca752 service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:00.558769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3ca54-d6d5-4cf4-b493-6f64c0e09de1 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:00.562682 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-39d3ca54-d6d5-4cf4-b493-6f64c0e09de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:00.581716 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be5b61-65ee-4c18-b94d-c259389b81b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:00.582643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be5b61-65ee-4c18-b94d-c259389b81b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:00.582643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be5b61-65ee-4c18-b94d-c259389b81b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:00.582967 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be5b61-65ee-4c18-b94d-c259389b81b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:00.583562 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be5b61-65ee-4c18-b94d-c259389b81b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:00.585961 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be5b61-65ee-4c18-b94d-c259389b81b5 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:00.591364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3ca54-d6d5-4cf4-b493-6f64c0e09de1 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:00.617235 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945346dc-0350-4749-abcd-6066decdb40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:00.617940 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945346dc-0350-4749-abcd-6066decdb40d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:00.618229 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945346dc-0350-4749-abcd-6066decdb40d admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:00.618508 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945346dc-0350-4749-abcd-6066decdb40d admin admin] PATH_INFO: `/v3/users/f56e681894e64f848c264405ec10c57f` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:00.626750 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945346dc-0350-4749-abcd-6066decdb40d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f56e681894e64f848c264405ec10c57f)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:00.632572 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945346dc-0350-4749-abcd-6066decdb40d admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:00.677324 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 828/1670] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:00 2022] POST /identity/v3/projects => generated 357 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:45:00.681740 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be5b61-65ee-4c18-b94d-c259389b81b5 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:00.702333 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:00.770028 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-945346dc-0350-4749-abcd-6066decdb40d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f56e681894e64f848c264405ec10c57f'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:00.771165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-945346dc-0350-4749-abcd-6066decdb40d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f56e681894e64f848c264405ec10c57f'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:00.809607 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-945346dc-0350-4749-abcd-6066decdb40d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f56e681894e64f848c264405ec10c57f'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:00.840735 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-945346dc-0350-4749-abcd-6066decdb40d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f56e681894e64f848c264405ec10c57f'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:00.860097 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-945346dc-0350-4749-abcd-6066decdb40d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f56e681894e64f848c264405ec10c57f'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:00.880626 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 843/1671] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:00 2022] DELETE /identity/v3/users/f56e681894e64f848c264405ec10c57f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:00.882412 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd181d-a207-45e2-8da7-ece56727f829 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:00.891718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be5b61-65ee-4c18-b94d-c259389b81b5 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:00.893430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd181d-a207-45e2-8da7-ece56727f829 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:00.893816 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd181d-a207-45e2-8da7-ece56727f829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:01.008869 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-5ccd181d-a207-45e2-8da7-ece56727f829 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:01.010967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-5ccd181d-a207-45e2-8da7-ece56727f829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:01.012309 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:01.102340 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ba289-b51a-4bff-9216-4b6af1b1fc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:01.102973 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ba289-b51a-4bff-9216-4b6af1b1fc13 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:01.103257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ba289-b51a-4bff-9216-4b6af1b1fc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:01.103607 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ba289-b51a-4bff-9216-4b6af1b1fc13 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:01.104224 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ba289-b51a-4bff-9216-4b6af1b1fc13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:01.106545 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ba289-b51a-4bff-9216-4b6af1b1fc13 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:01.167475 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 829/1672] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:00 2022] POST /identity/v3/users => generated 279 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:01.169082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ba289-b51a-4bff-9216-4b6af1b1fc13 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:01.179666 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ca1ba289-b51a-4bff-9216-4b6af1b1fc13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:01.219648 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ba289-b51a-4bff-9216-4b6af1b1fc13 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:01.231354 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffb013-0480-40a8-8be3-47869f72b891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:01.231354 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffb013-0480-40a8-8be3-47869f72b891 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:01.232605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffb013-0480-40a8-8be3-47869f72b891 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:01.233418 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ffb013-0480-40a8-8be3-47869f72b891 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:01.234903 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ffb013-0480-40a8-8be3-47869f72b891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:01.239819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ffb013-0480-40a8-8be3-47869f72b891 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:01.280809 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 844/1673] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:01.282642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 830/1674] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:01.288236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd181d-a207-45e2-8da7-ece56727f829 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:01.320658 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd181d-a207-45e2-8da7-ece56727f829 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:01.324170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffb013-0480-40a8-8be3-47869f72b891 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:01.325936 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-89ffb013-0480-40a8-8be3-47869f72b891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:01.334978 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add058c3-e741-403e-b426-8437b9edd841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:01.336038 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add058c3-e741-403e-b426-8437b9edd841 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:01.336552 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add058c3-e741-403e-b426-8437b9edd841 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:01.336649 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add058c3-e741-403e-b426-8437b9edd841 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:01.337251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add058c3-e741-403e-b426-8437b9edd841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:01.342012 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add058c3-e741-403e-b426-8437b9edd841 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:01.403482 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 845/1675] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:01.406617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add058c3-e741-403e-b426-8437b9edd841 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:01.442521 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add058c3-e741-403e-b426-8437b9edd841 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:01.478078 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73e03f-899d-4729-9125-f8b0195fbcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:01.478776 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73e03f-899d-4729-9125-f8b0195fbcf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:01.482745 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73e03f-899d-4729-9125-f8b0195fbcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:01.483466 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73e03f-899d-4729-9125-f8b0195fbcf2 admin admin] PATH_INFO: `/v3/projects/43bfd00cabba4256a3e955da3eb447f9/users/4855e86db49d46bab5ca9f2b44c48c95/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:01.544424 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73e03f-899d-4729-9125-f8b0195fbcf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43bfd00cabba4256a3e955da3eb447f9, user_id=4855e86db49d46bab5ca9f2b44c48c95, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:01.554387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73e03f-899d-4729-9125-f8b0195fbcf2 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:01.562018 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ffb013-0480-40a8-8be3-47869f72b891 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:01.571376 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54760c-7948-4be5-9f41-05d3dc04f3a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:01.572046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54760c-7948-4be5-9f41-05d3dc04f3a6 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:01.572333 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54760c-7948-4be5-9f41-05d3dc04f3a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:01.573211 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54760c-7948-4be5-9f41-05d3dc04f3a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:01.589417 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54760c-7948-4be5-9f41-05d3dc04f3a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:01.590975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54760c-7948-4be5-9f41-05d3dc04f3a6 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:01.592478 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 846/1676] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:01 2022] PUT /identity/v3/projects/43bfd00cabba4256a3e955da3eb447f9/users/4855e86db49d46bab5ca9f2b44c48c95/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:01.612861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1aeaa0-8d7a-4bc5-945d-803aa4db7f5b None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:01.613156 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1aeaa0-8d7a-4bc5-945d-803aa4db7f5b None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:01.613432 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1aeaa0-8d7a-4bc5-945d-803aa4db7f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:01.633044 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 831/1677] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:45:01.662111 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-4f1aeaa0-8d7a-4bc5-945d-803aa4db7f5b None None] MFA Rules not processed for user `4855e86db49d46bab5ca9f2b44c48c95`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:01.666086 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-4f1aeaa0-8d7a-4bc5-945d-803aa4db7f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:01.734934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:01.762238 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 847/1678] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:01.767948 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54760c-7948-4be5-9f41-05d3dc04f3a6 service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:01.791672 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54760c-7948-4be5-9f41-05d3dc04f3a6 service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:01.944373 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba375809-dcd8-4001-bafd-7de61f15f0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:01.945020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba375809-dcd8-4001-bafd-7de61f15f0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:01.945282 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba375809-dcd8-4001-bafd-7de61f15f0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:01.947779 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba375809-dcd8-4001-bafd-7de61f15f0b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:01.948489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba375809-dcd8-4001-bafd-7de61f15f0b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:01.950478 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba375809-dcd8-4001-bafd-7de61f15f0b0 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:02.018377 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 832/1679] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:01 2022] POST /identity/v3/projects => generated 357 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:02.023735 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1aeaa0-8d7a-4bc5-945d-803aa4db7f5b None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:02.039901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1aeaa0-8d7a-4bc5-945d-803aa4db7f5b None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:02.151428 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c07d1-78ff-4083-865a-4c0d63727d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:02.152543 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c07d1-78ff-4083-865a-4c0d63727d18 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:02.163091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c07d1-78ff-4083-865a-4c0d63727d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:02.164414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c07d1-78ff-4083-865a-4c0d63727d18 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:02.165252 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c07d1-78ff-4083-865a-4c0d63727d18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:02.168532 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c07d1-78ff-4083-865a-4c0d63727d18 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:02.233995 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 848/1680] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:02 2022] POST /identity/v3/users => generated 285 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:02.234795 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba375809-dcd8-4001-bafd-7de61f15f0b0 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:02.253272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba375809-dcd8-4001-bafd-7de61f15f0b0 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:02.278260 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da647d9b-0992-4a6c-a550-c0bd73bdf275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:02.279228 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da647d9b-0992-4a6c-a550-c0bd73bdf275 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:02.279691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da647d9b-0992-4a6c-a550-c0bd73bdf275 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:02.280158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da647d9b-0992-4a6c-a550-c0bd73bdf275 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:02.281132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da647d9b-0992-4a6c-a550-c0bd73bdf275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:02.283833 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da647d9b-0992-4a6c-a550-c0bd73bdf275 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:02.328280 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 833/1681] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:45:02.333085 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c07d1-78ff-4083-865a-4c0d63727d18 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:02.358398 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c07d1-78ff-4083-865a-4c0d63727d18 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:02.380467 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe503b-0c38-41dd-ac91-ef2486f4e0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:02.382305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe503b-0c38-41dd-ac91-ef2486f4e0cf admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:02.382606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe503b-0c38-41dd-ac91-ef2486f4e0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:02.384353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe503b-0c38-41dd-ac91-ef2486f4e0cf admin admin] PATH_INFO: `/v3/projects/f7c1df8e80f7413582cdef5a8cb4fb1a/users/570a49abd19241f2b378edc40e62c1d1/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:02.434103 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe503b-0c38-41dd-ac91-ef2486f4e0cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7c1df8e80f7413582cdef5a8cb4fb1a, user_id=570a49abd19241f2b378edc40e62c1d1, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:02.437346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe503b-0c38-41dd-ac91-ef2486f4e0cf admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:02.469623 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 849/1682] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:02 2022] PUT /identity/v3/projects/f7c1df8e80f7413582cdef5a8cb4fb1a/users/570a49abd19241f2b378edc40e62c1d1/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:02.473021 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da647d9b-0992-4a6c-a550-c0bd73bdf275 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:02.495600 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da647d9b-0992-4a6c-a550-c0bd73bdf275 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:02.567297 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:02.614184 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170de17-3040-47b5-8101-6af6ff1562f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:02.614811 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170de17-3040-47b5-8101-6af6ff1562f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:02.615093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170de17-3040-47b5-8101-6af6ff1562f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:02.615369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170de17-3040-47b5-8101-6af6ff1562f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:02.616026 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170de17-3040-47b5-8101-6af6ff1562f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:02.624991 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170de17-3040-47b5-8101-6af6ff1562f7 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:02.658657 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 834/1683] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:02.663885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe503b-0c38-41dd-ac91-ef2486f4e0cf admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:02.687399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe503b-0c38-41dd-ac91-ef2486f4e0cf admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:02.694693 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90636b-b1ee-4d27-8b4e-6fd874fb6743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:02.695663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90636b-b1ee-4d27-8b4e-6fd874fb6743 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:02.696115 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90636b-b1ee-4d27-8b4e-6fd874fb6743 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:02.696560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90636b-b1ee-4d27-8b4e-6fd874fb6743 admin admin] PATH_INFO: `/v3/projects/f7c1df8e80f7413582cdef5a8cb4fb1a/users/570a49abd19241f2b378edc40e62c1d1/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:02.699001 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90636b-b1ee-4d27-8b4e-6fd874fb6743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7c1df8e80f7413582cdef5a8cb4fb1a, user_id=570a49abd19241f2b378edc40e62c1d1, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:02.703091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90636b-b1ee-4d27-8b4e-6fd874fb6743 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:02.717078 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 850/1684] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:02 2022] PUT /identity/v3/projects/f7c1df8e80f7413582cdef5a8cb4fb1a/users/570a49abd19241f2b378edc40e62c1d1/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:02.728355 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9232588-e640-46cf-8637-cbaf05192b2a None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:02.728808 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9232588-e640-46cf-8637-cbaf05192b2a None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:02.729214 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9232588-e640-46cf-8637-cbaf05192b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:02.814776 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-b9232588-e640-46cf-8637-cbaf05192b2a None None] MFA Rules not processed for user `570a49abd19241f2b378edc40e62c1d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:02.818830 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b9232588-e640-46cf-8637-cbaf05192b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:03.087361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 835/1685] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:02 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:45:03.094195 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90636b-b1ee-4d27-8b4e-6fd874fb6743 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:03.097042 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-de90636b-b1ee-4d27-8b4e-6fd874fb6743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:03.255448 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90636b-b1ee-4d27-8b4e-6fd874fb6743 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:03.262615 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b2184-a362-4daf-9291-d97137b5083f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:03.263483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b2184-a362-4daf-9291-d97137b5083f service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:03.263815 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b2184-a362-4daf-9291-d97137b5083f service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:03.264164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b2184-a362-4daf-9291-d97137b5083f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:03.272675 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9232588-e640-46cf-8637-cbaf05192b2a None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:03.274703 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b9232588-e640-46cf-8637-cbaf05192b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:03.313160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b2184-a362-4daf-9291-d97137b5083f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:03.318342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b2184-a362-4daf-9291-d97137b5083f service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:03.357778 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 851/1686] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:03 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:03.468884 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9232588-e640-46cf-8637-cbaf05192b2a None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:03.484659 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5660f36-8acd-4e47-98bd-d73db18b66a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:03.488018 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5660f36-8acd-4e47-98bd-d73db18b66a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:03.489374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5660f36-8acd-4e47-98bd-d73db18b66a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:03.489683 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5660f36-8acd-4e47-98bd-d73db18b66a5 admin admin] PATH_INFO: `/v3/projects/88238029e80e4f66ab5ebaf6744f628b` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:03.495065 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5660f36-8acd-4e47-98bd-d73db18b66a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88238029e80e4f66ab5ebaf6744f628b)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:03.504424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5660f36-8acd-4e47-98bd-d73db18b66a5 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:03.520127 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b2184-a362-4daf-9291-d97137b5083f service cinder] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:03.521894 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-426b2184-a362-4daf-9291-d97137b5083f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:03.565771 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b2184-a362-4daf-9291-d97137b5083f service cinder] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:03.587108 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80707b7c-cc78-4dbc-b268-675f16685e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:03.587780 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80707b7c-cc78-4dbc-b268-675f16685e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:03.588059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80707b7c-cc78-4dbc-b268-675f16685e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:03.588335 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80707b7c-cc78-4dbc-b268-675f16685e2f admin admin] PATH_INFO: `/v3/projects/ef49c7a5278a46da97e221af10ce5fd0` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:03.597764 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80707b7c-cc78-4dbc-b268-675f16685e2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef49c7a5278a46da97e221af10ce5fd0)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:03.604435 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80707b7c-cc78-4dbc-b268-675f16685e2f admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:03.711403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:03.723469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a5660f36-8acd-4e47-98bd-d73db18b66a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88238029e80e4f66ab5ebaf6744f628b', 'request_id': 'req-a5660f36-8acd-4e47-98bd-d73db18b66a5'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:03.730254 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-80707b7c-cc78-4dbc-b268-675f16685e2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef49c7a5278a46da97e221af10ce5fd0', 'request_id': 'req-80707b7c-cc78-4dbc-b268-675f16685e2f'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:03.750634 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a5660f36-8acd-4e47-98bd-d73db18b66a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88238029e80e4f66ab5ebaf6744f628b', 'request_id': 'req-a5660f36-8acd-4e47-98bd-d73db18b66a5'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:03.754480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:03.762138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-80707b7c-cc78-4dbc-b268-675f16685e2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef49c7a5278a46da97e221af10ce5fd0', 'request_id': 'req-80707b7c-cc78-4dbc-b268-675f16685e2f'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:03.768195 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a5660f36-8acd-4e47-98bd-d73db18b66a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88238029e80e4f66ab5ebaf6744f628b', 'request_id': 'req-a5660f36-8acd-4e47-98bd-d73db18b66a5'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:03.772305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-80707b7c-cc78-4dbc-b268-675f16685e2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef49c7a5278a46da97e221af10ce5fd0', 'request_id': 'req-80707b7c-cc78-4dbc-b268-675f16685e2f'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:03.818952 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-80707b7c-cc78-4dbc-b268-675f16685e2f admin admin] The token cache is being invalidate because project ef49c7a5278a46da97e221af10ce5fd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:03.819342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-80707b7c-cc78-4dbc-b268-675f16685e2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:03.825543 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-80707b7c-cc78-4dbc-b268-675f16685e2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:03.833223 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 852/1687] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:03 2022] DELETE /identity/v3/projects/ef49c7a5278a46da97e221af10ce5fd0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:03.833223 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80707b7c-cc78-4dbc-b268-675f16685e2f admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:03.835083 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a5660f36-8acd-4e47-98bd-d73db18b66a5 admin admin] The token cache is being invalidate because project 88238029e80e4f66ab5ebaf6744f628b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:03.835381 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a5660f36-8acd-4e47-98bd-d73db18b66a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:03.838699 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-80707b7c-cc78-4dbc-b268-675f16685e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:03.843366 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a5660f36-8acd-4e47-98bd-d73db18b66a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:03.845514 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 836/1688] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:03 2022] DELETE /identity/v3/projects/88238029e80e4f66ab5ebaf6744f628b => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:45:03.852538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ba38a-99cb-4e3e-9cf0-eaf8e46179bb None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:03.852741 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ba38a-99cb-4e3e-9cf0-eaf8e46179bb None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:03.853020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ba38a-99cb-4e3e-9cf0-eaf8e46179bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:03.966084 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-4a3ba38a-99cb-4e3e-9cf0-eaf8e46179bb None None] MFA Rules not processed for user `f197b03d644e4176bf6a0800aae31b4d`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:03.967328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-4a3ba38a-99cb-4e3e-9cf0-eaf8e46179bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:04.075129 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80707b7c-cc78-4dbc-b268-675f16685e2f admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:04.088155 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e0ce7-70be-44a8-9af4-d95e75ba13f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:04.088791 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e0ce7-70be-44a8-9af4-d95e75ba13f8 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:04.089073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e0ce7-70be-44a8-9af4-d95e75ba13f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:04.089344 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e0ce7-70be-44a8-9af4-d95e75ba13f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:04.092858 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-b99e0ce7-70be-44a8-9af4-d95e75ba13f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:04.230451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 837/1689] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:04.231961 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ba38a-99cb-4e3e-9cf0-eaf8e46179bb None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:04.243482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-4a3ba38a-99cb-4e3e-9cf0-eaf8e46179bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:04.317954 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e0ce7-70be-44a8-9af4-d95e75ba13f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:04.320210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e0ce7-70be-44a8-9af4-d95e75ba13f8 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:04.349710 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 853/1690] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:04.352683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701301d9-1ab0-43c0-8278-42d7fc3b9a6a None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:04.354301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701301d9-1ab0-43c0-8278-42d7fc3b9a6a None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:04.355787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701301d9-1ab0-43c0-8278-42d7fc3b9a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:04.422230 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-701301d9-1ab0-43c0-8278-42d7fc3b9a6a None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:04.424150 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ba38a-99cb-4e3e-9cf0-eaf8e46179bb None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:04.428584 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-701301d9-1ab0-43c0-8278-42d7fc3b9a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:04.441499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fff755-95a9-4264-9aec-9908f5fa7d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:04.442372 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fff755-95a9-4264-9aec-9908f5fa7d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:04.442759 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fff755-95a9-4264-9aec-9908f5fa7d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:04.443102 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fff755-95a9-4264-9aec-9908f5fa7d28 admin admin] PATH_INFO: `/v3/users/d731477577024277baf0074187f97858` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:04.445900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fff755-95a9-4264-9aec-9908f5fa7d28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d731477577024277baf0074187f97858)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:04.450835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fff755-95a9-4264-9aec-9908f5fa7d28 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:04.471395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 854/1691] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:04.477395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e5ee6-4e0e-490c-b57f-104a8d240b2d None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:04.479058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e5ee6-4e0e-490c-b57f-104a8d240b2d None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:04.479357 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e5ee6-4e0e-490c-b57f-104a8d240b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:04.542662 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-953e5ee6-4e0e-490c-b57f-104a8d240b2d None None] MFA Rules not processed for user `f197b03d644e4176bf6a0800aae31b4d`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:04.544105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-953e5ee6-4e0e-490c-b57f-104a8d240b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:04.585477 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 855/1692] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:04.589643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054062a1-088b-4794-aa24-7d2e5c06245b None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:04.590010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054062a1-088b-4794-aa24-7d2e5c06245b None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:04.590239 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054062a1-088b-4794-aa24-7d2e5c06245b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:04.593566 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a7fff755-95a9-4264-9aec-9908f5fa7d28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd731477577024277baf0074187f97858'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:04.595637 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a7fff755-95a9-4264-9aec-9908f5fa7d28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd731477577024277baf0074187f97858'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:04.597733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a7fff755-95a9-4264-9aec-9908f5fa7d28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd731477577024277baf0074187f97858'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:04.633653 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a7fff755-95a9-4264-9aec-9908f5fa7d28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd731477577024277baf0074187f97858'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:04.638077 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-054062a1-088b-4794-aa24-7d2e5c06245b None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:04.643531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-054062a1-088b-4794-aa24-7d2e5c06245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:04.651609 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a7fff755-95a9-4264-9aec-9908f5fa7d28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd731477577024277baf0074187f97858'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:04.663062 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 856/1693] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:04.663950 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054062a1-088b-4794-aa24-7d2e5c06245b None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:04.666344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:04.668511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-054062a1-088b-4794-aa24-7d2e5c06245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:04.683294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 838/1694] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:04 2022] DELETE /identity/v3/users/d731477577024277baf0074187f97858 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:04.687633 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fff755-95a9-4264-9aec-9908f5fa7d28 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:04.781083 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fff755-95a9-4264-9aec-9908f5fa7d28 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:04.805073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3752737-3f18-4378-aa52-3bcba147d751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:04.806557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3752737-3f18-4378-aa52-3bcba147d751 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:04.807474 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3752737-3f18-4378-aa52-3bcba147d751 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:04.808429 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3752737-3f18-4378-aa52-3bcba147d751 admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:04.811121 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3752737-3f18-4378-aa52-3bcba147d751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:04.811690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3752737-3f18-4378-aa52-3bcba147d751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:04.817146 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3752737-3f18-4378-aa52-3bcba147d751 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:04.851849 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 839/1695] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:04.858194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3752737-3f18-4378-aa52-3bcba147d751 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:04.889718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3752737-3f18-4378-aa52-3bcba147d751 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:04.910568 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b0be6-84b6-4537-865f-5c33a2815413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:04.912261 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b0be6-84b6-4537-865f-5c33a2815413 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:04.913974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b0be6-84b6-4537-865f-5c33a2815413 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:04.916095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b0be6-84b6-4537-865f-5c33a2815413 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:04.917097 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b0be6-84b6-4537-865f-5c33a2815413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:04.930262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b0be6-84b6-4537-865f-5c33a2815413 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:04.946207 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:04.973401 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054062a1-088b-4794-aa24-7d2e5c06245b None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:05.037132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 840/1696] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:04 2022] POST /identity/v3/projects => generated 365 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:45:05.041296 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b0be6-84b6-4537-865f-5c33a2815413 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:05.116483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd319a0d-afbd-4af1-8784-1f5a92de9c10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:05.117069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd319a0d-afbd-4af1-8784-1f5a92de9c10 service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:05.117345 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd319a0d-afbd-4af1-8784-1f5a92de9c10 service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:05.119419 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd319a0d-afbd-4af1-8784-1f5a92de9c10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:05.124743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-cd319a0d-afbd-4af1-8784-1f5a92de9c10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:05.256547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b0be6-84b6-4537-865f-5c33a2815413 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:05.273864 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e08e8-0f14-4119-a1e2-35c0d45e9f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:05.277293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e08e8-0f14-4119-a1e2-35c0d45e9f37 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:05.277872 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e08e8-0f14-4119-a1e2-35c0d45e9f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:05.278429 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e08e8-0f14-4119-a1e2-35c0d45e9f37 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:05.279153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e08e8-0f14-4119-a1e2-35c0d45e9f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:05.284798 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e08e8-0f14-4119-a1e2-35c0d45e9f37 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:05.334953 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd319a0d-afbd-4af1-8784-1f5a92de9c10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:05.336913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd319a0d-afbd-4af1-8784-1f5a92de9c10 service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:05.351883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 841/1697] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:05 2022] POST /identity/v3/users => generated 283 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:05.352657 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e08e8-0f14-4119-a1e2-35c0d45e9f37 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:05.375632 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 857/1698] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:04 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:05.386393 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd319a0d-afbd-4af1-8784-1f5a92de9c10 service nova] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:05.387822 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-cd319a0d-afbd-4af1-8784-1f5a92de9c10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:05.391031 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e08e8-0f14-4119-a1e2-35c0d45e9f37 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:05.409074 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a7ff4-69b5-433b-8c60-8e89febe2f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:05.409763 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a7ff4-69b5-433b-8c60-8e89febe2f7f admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:05.410055 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a7ff4-69b5-433b-8c60-8e89febe2f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:05.410480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a7ff4-69b5-433b-8c60-8e89febe2f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:05.411166 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a7ff4-69b5-433b-8c60-8e89febe2f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:05.412963 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a7ff4-69b5-433b-8c60-8e89febe2f7f admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:05.427782 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd319a0d-afbd-4af1-8784-1f5a92de9c10 service nova] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:05.463944 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1e4b3-2b47-43cb-a6fa-2142781060e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:05.464605 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1e4b3-2b47-43cb-a6fa-2142781060e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:05.464882 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1e4b3-2b47-43cb-a6fa-2142781060e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:05.465170 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1e4b3-2b47-43cb-a6fa-2142781060e4 admin admin] PATH_INFO: `/v3/users/c8cfca97da3248988fbefb68e2d18692` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:05.465911 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 842/1699] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:05.470515 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a7ff4-69b5-433b-8c60-8e89febe2f7f admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:05.481839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1e4b3-2b47-43cb-a6fa-2142781060e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8cfca97da3248988fbefb68e2d18692)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:05.484223 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1e4b3-2b47-43cb-a6fa-2142781060e4 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:05.492976 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a7ff4-69b5-433b-8c60-8e89febe2f7f admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:05.516324 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92ed12-acd5-4697-90c6-40c3ea90c565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:05.517117 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92ed12-acd5-4697-90c6-40c3ea90c565 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:05.524263 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92ed12-acd5-4697-90c6-40c3ea90c565 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:05.524606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92ed12-acd5-4697-90c6-40c3ea90c565 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:05.525318 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92ed12-acd5-4697-90c6-40c3ea90c565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:05.531138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92ed12-acd5-4697-90c6-40c3ea90c565 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:05.560525 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 843/1700] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:45:05.564409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92ed12-acd5-4697-90c6-40c3ea90c565 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:05.584471 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92ed12-acd5-4697-90c6-40c3ea90c565 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:05.598065 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033c2b5-a31f-47cd-898c-03414e0a2ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:05.598827 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033c2b5-a31f-47cd-898c-03414e0a2ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:05.599160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033c2b5-a31f-47cd-898c-03414e0a2ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:05.599476 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033c2b5-a31f-47cd-898c-03414e0a2ed2 admin admin] PATH_INFO: `/v3/projects/b77de4e82d8d4b4986e033ec041db80b/users/98664a87d08145b190e998d4e16d4fe5/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:05.620563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033c2b5-a31f-47cd-898c-03414e0a2ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b77de4e82d8d4b4986e033ec041db80b, user_id=98664a87d08145b190e998d4e16d4fe5, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:05.624690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033c2b5-a31f-47cd-898c-03414e0a2ed2 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:05.642711 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 844/1701] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:05 2022] PUT /identity/v3/projects/b77de4e82d8d4b4986e033ec041db80b/users/98664a87d08145b190e998d4e16d4fe5/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:45:05.653326 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f69245-2c68-4d2c-b9e4-8a3db8bc5166 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:05.653657 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f69245-2c68-4d2c-b9e4-8a3db8bc5166 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:05.653930 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f69245-2c68-4d2c-b9e4-8a3db8bc5166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:05.659745 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-15d1e4b3-2b47-43cb-a6fa-2142781060e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8cfca97da3248988fbefb68e2d18692'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:05.661191 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-15d1e4b3-2b47-43cb-a6fa-2142781060e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8cfca97da3248988fbefb68e2d18692'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:05.676720 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:05.698606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-15d1e4b3-2b47-43cb-a6fa-2142781060e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8cfca97da3248988fbefb68e2d18692'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:05.698800 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-33f69245-2c68-4d2c-b9e4-8a3db8bc5166 None None] MFA Rules not processed for user `98664a87d08145b190e998d4e16d4fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:05.700040 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-33f69245-2c68-4d2c-b9e4-8a3db8bc5166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:05.723043 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-15d1e4b3-2b47-43cb-a6fa-2142781060e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8cfca97da3248988fbefb68e2d18692'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:05.733286 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-15d1e4b3-2b47-43cb-a6fa-2142781060e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8cfca97da3248988fbefb68e2d18692'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:05.755589 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 858/1702] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:05 2022] DELETE /identity/v3/users/c8cfca97da3248988fbefb68e2d18692 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:05.759038 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61f69d-a917-4cd2-bb30-635af08bfcb0 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:05.759322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61f69d-a917-4cd2-bb30-635af08bfcb0 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:05.759593 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61f69d-a917-4cd2-bb30-635af08bfcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:05.808815 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 845/1703] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:45:05.815252 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f69245-2c68-4d2c-b9e4-8a3db8bc5166 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:05.817924 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-33f69245-2c68-4d2c-b9e4-8a3db8bc5166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:05.819567 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-ee61f69d-a917-4cd2-bb30-635af08bfcb0 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:05.820761 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-ee61f69d-a917-4cd2-bb30-635af08bfcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:05.835171 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:05.974709 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f69245-2c68-4d2c-b9e4-8a3db8bc5166 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:05.984013 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 859/1704] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:05.984953 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419b242-f5a0-48b5-a77e-b4dd15be9048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:05.986158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419b242-f5a0-48b5-a77e-b4dd15be9048 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:05.987751 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419b242-f5a0-48b5-a77e-b4dd15be9048 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:05.988025 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419b242-f5a0-48b5-a77e-b4dd15be9048 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:05.991126 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419b242-f5a0-48b5-a77e-b4dd15be9048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:05.997883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419b242-f5a0-48b5-a77e-b4dd15be9048 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:06.014650 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61f69d-a917-4cd2-bb30-635af08bfcb0 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:06.016258 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-ee61f69d-a917-4cd2-bb30-635af08bfcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:06.076827 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 846/1705] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:05 2022] POST /identity/v3/projects => generated 363 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:45:06.082042 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419b242-f5a0-48b5-a77e-b4dd15be9048 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:06.192132 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61f69d-a917-4cd2-bb30-635af08bfcb0 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:06.314737 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419b242-f5a0-48b5-a77e-b4dd15be9048 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:06.327292 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eacbdf-0506-4068-8543-83aa899c8ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:06.330669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eacbdf-0506-4068-8543-83aa899c8ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:06.331045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eacbdf-0506-4068-8543-83aa899c8ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:06.332244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eacbdf-0506-4068-8543-83aa899c8ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:06.332957 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eacbdf-0506-4068-8543-83aa899c8ee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:06.342574 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eacbdf-0506-4068-8543-83aa899c8ee3 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:06.365902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a478d1-cda6-482b-bf88-27c566008767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:06.367380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a478d1-cda6-482b-bf88-27c566008767 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:06.368038 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a478d1-cda6-482b-bf88-27c566008767 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:06.368615 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a478d1-cda6-482b-bf88-27c566008767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:06.394078 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a478d1-cda6-482b-bf88-27c566008767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:06.395916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a478d1-cda6-482b-bf88-27c566008767 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:06.420815 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 860/1706] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:45:06.438919 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 847/1707] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:06 2022] POST /identity/v3/users => generated 288 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:06.442099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a478d1-cda6-482b-bf88-27c566008767 service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:06.460106 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a478d1-cda6-482b-bf88-27c566008767 service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:06.474204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db9bb1-5586-4612-a495-8c336ab8d091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:06.474993 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db9bb1-5586-4612-a495-8c336ab8d091 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:06.475444 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db9bb1-5586-4612-a495-8c336ab8d091 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:06.475830 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db9bb1-5586-4612-a495-8c336ab8d091 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:06.476639 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db9bb1-5586-4612-a495-8c336ab8d091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:06.478622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db9bb1-5586-4612-a495-8c336ab8d091 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:06.504461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 861/1708] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:06.508761 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eacbdf-0506-4068-8543-83aa899c8ee3 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:06.528862 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eacbdf-0506-4068-8543-83aa899c8ee3 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:06.548982 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae3958-6419-4335-914f-8a87ea6666df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:06.559194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae3958-6419-4335-914f-8a87ea6666df admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:06.559568 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae3958-6419-4335-914f-8a87ea6666df admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:06.559998 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae3958-6419-4335-914f-8a87ea6666df admin admin] PATH_INFO: `/v3/projects/fd4f886d8a564961aef43f1939b8b545/users/b7231a3493ab4eaca25554ee358169ac/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:06.608272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:06.619082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae3958-6419-4335-914f-8a87ea6666df admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd4f886d8a564961aef43f1939b8b545, user_id=b7231a3493ab4eaca25554ee358169ac, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:06.623164 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae3958-6419-4335-914f-8a87ea6666df admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:06.656490 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 848/1709] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:06 2022] PUT /identity/v3/projects/fd4f886d8a564961aef43f1939b8b545/users/b7231a3493ab4eaca25554ee358169ac/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:06.661765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db9bb1-5586-4612-a495-8c336ab8d091 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:06.677242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db9bb1-5586-4612-a495-8c336ab8d091 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:06.878375 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd466b-fdae-4016-a831-fde635fe9310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:06.881292 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd466b-fdae-4016-a831-fde635fe9310 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:06.881581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd466b-fdae-4016-a831-fde635fe9310 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:06.886652 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd466b-fdae-4016-a831-fde635fe9310 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:06.887065 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd466b-fdae-4016-a831-fde635fe9310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:06.894768 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd466b-fdae-4016-a831-fde635fe9310 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:06.897051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:06.948943 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 862/1710] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:06.955560 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae3958-6419-4335-914f-8a87ea6666df admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:06.983208 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae3958-6419-4335-914f-8a87ea6666df admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:06.994275 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75110f83-7f3b-4409-8318-231c09a92e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:06.995208 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75110f83-7f3b-4409-8318-231c09a92e67 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:06.995500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75110f83-7f3b-4409-8318-231c09a92e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:06.995784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75110f83-7f3b-4409-8318-231c09a92e67 admin admin] PATH_INFO: `/v3/projects/fd4f886d8a564961aef43f1939b8b545/users/b7231a3493ab4eaca25554ee358169ac/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:06.997907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75110f83-7f3b-4409-8318-231c09a92e67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd4f886d8a564961aef43f1939b8b545, user_id=b7231a3493ab4eaca25554ee358169ac, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:07.001980 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75110f83-7f3b-4409-8318-231c09a92e67 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:07.053490 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 849/1711] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:06 2022] PUT /identity/v3/projects/fd4f886d8a564961aef43f1939b8b545/users/b7231a3493ab4eaca25554ee358169ac/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:07.062129 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab67a3-f7aa-4eae-86f8-1ecd685ba4bc None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:07.062129 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab67a3-f7aa-4eae-86f8-1ecd685ba4bc None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:07.062710 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab67a3-f7aa-4eae-86f8-1ecd685ba4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:07.154308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-4fab67a3-f7aa-4eae-86f8-1ecd685ba4bc None None] MFA Rules not processed for user `b7231a3493ab4eaca25554ee358169ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:07.155889 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-4fab67a3-f7aa-4eae-86f8-1ecd685ba4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:07.391846 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 863/1712] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:07.405592 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75110f83-7f3b-4409-8318-231c09a92e67 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:07.408899 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-75110f83-7f3b-4409-8318-231c09a92e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:07.635800 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75110f83-7f3b-4409-8318-231c09a92e67 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:07.645568 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397a86b-d0df-49a4-84b4-f41e51767d97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:07.647569 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397a86b-d0df-49a4-84b4-f41e51767d97 service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:07.649250 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397a86b-d0df-49a4-84b4-f41e51767d97 service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:07.649650 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397a86b-d0df-49a4-84b4-f41e51767d97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:07.674765 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397a86b-d0df-49a4-84b4-f41e51767d97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:07.676307 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397a86b-d0df-49a4-84b4-f41e51767d97 service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:07.707012 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 850/1713] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:07.879369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82c22f-cf56-490d-a3e6-74f93ce95d09 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:07.879701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82c22f-cf56-490d-a3e6-74f93ce95d09 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:07.880015 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82c22f-cf56-490d-a3e6-74f93ce95d09 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:07.881821 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 864/1714] 10.222.0.58 () {54 vars in 912 bytes} [Wed Aug 24 09:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:45:07.902872 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a8182-3d57-47c9-9810-a57a8f9f212a None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:07.905371 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a8182-3d57-47c9-9810-a57a8f9f212a None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:07.905868 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a8182-3d57-47c9-9810-a57a8f9f212a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:08.058675 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-725a8182-3d57-47c9-9810-a57a8f9f212a None None] MFA Rules not processed for user `7847dbf8f31146c5ab2136fbdb487783`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:08.061020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-725a8182-3d57-47c9-9810-a57a8f9f212a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:08.274235 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 851/1715] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 09:45:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:08.354333 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82c22f-cf56-490d-a3e6-74f93ce95d09 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:08.356712 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2f82c22f-cf56-490d-a3e6-74f93ce95d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:08.401620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82c22f-cf56-490d-a3e6-74f93ce95d09 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:08.402775 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2512911-1797-4bd1-b801-8d0f2dcfe3e2 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:08.403263 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2512911-1797-4bd1-b801-8d0f2dcfe3e2 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:08.403963 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2512911-1797-4bd1-b801-8d0f2dcfe3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:08.415187 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce960be8-0858-4919-855d-77706b67272f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:08.415796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce960be8-0858-4919-855d-77706b67272f service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:08.419755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce960be8-0858-4919-855d-77706b67272f service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:08.420133 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce960be8-0858-4919-855d-77706b67272f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:08.456540 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce960be8-0858-4919-855d-77706b67272f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:08.488001 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce960be8-0858-4919-855d-77706b67272f service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:08.489962 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-d2512911-1797-4bd1-b801-8d0f2dcfe3e2 None None] MFA Rules not processed for user `6a42998888a34c099624c08e64013a13`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:08.493426 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-d2512911-1797-4bd1-b801-8d0f2dcfe3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:08.537053 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 865/1716] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:08.538311 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce960be8-0858-4919-855d-77706b67272f service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:08.539902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-ce960be8-0858-4919-855d-77706b67272f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:08.731784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 852/1717] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:45:08.740624 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce960be8-0858-4919-855d-77706b67272f service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:08.747128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa73fb-fe5d-4992-9988-5aabcbc647f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:08.748004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa73fb-fe5d-4992-9988-5aabcbc647f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:08.748233 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa73fb-fe5d-4992-9988-5aabcbc647f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:08.748441 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa73fb-fe5d-4992-9988-5aabcbc647f0 admin admin] PATH_INFO: `/v3/projects/f5a538ba85204d71b9527f149a32e732` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:08.750379 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa73fb-fe5d-4992-9988-5aabcbc647f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5a538ba85204d71b9527f149a32e732)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:08.754646 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa73fb-fe5d-4992-9988-5aabcbc647f0 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:08.755107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2512911-1797-4bd1-b801-8d0f2dcfe3e2 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:08.758579 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-d2512911-1797-4bd1-b801-8d0f2dcfe3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:08.795426 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:08.856256 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-31fa73fb-fe5d-4992-9988-5aabcbc647f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5a538ba85204d71b9527f149a32e732', 'request_id': 'req-31fa73fb-fe5d-4992-9988-5aabcbc647f0'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:08.879374 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-31fa73fb-fe5d-4992-9988-5aabcbc647f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5a538ba85204d71b9527f149a32e732', 'request_id': 'req-31fa73fb-fe5d-4992-9988-5aabcbc647f0'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:08.892447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-31fa73fb-fe5d-4992-9988-5aabcbc647f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5a538ba85204d71b9527f149a32e732', 'request_id': 'req-31fa73fb-fe5d-4992-9988-5aabcbc647f0'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:08.912625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:08.929855 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-31fa73fb-fe5d-4992-9988-5aabcbc647f0 admin admin] The token cache is being invalidate because project f5a538ba85204d71b9527f149a32e732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:08.930203 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-31fa73fb-fe5d-4992-9988-5aabcbc647f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:08.930880 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-31fa73fb-fe5d-4992-9988-5aabcbc647f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:08.932998 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 866/1718] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:08 2022] DELETE /identity/v3/projects/f5a538ba85204d71b9527f149a32e732 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:08.935107 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa73fb-fe5d-4992-9988-5aabcbc647f0 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:08.940317 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-31fa73fb-fe5d-4992-9988-5aabcbc647f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:09.031511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2512911-1797-4bd1-b801-8d0f2dcfe3e2 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:09.134532 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa73fb-fe5d-4992-9988-5aabcbc647f0 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:09.144532 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441780bc-9257-47fe-992e-bfaa2026fd82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:09.150167 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52858b-09b8-4c5a-bc93-ecdfff82eeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:09.150750 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441780bc-9257-47fe-992e-bfaa2026fd82 service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:09.151216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52858b-09b8-4c5a-bc93-ecdfff82eeeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:09.151597 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52858b-09b8-4c5a-bc93-ecdfff82eeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:09.151811 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441780bc-9257-47fe-992e-bfaa2026fd82 service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:09.152058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52858b-09b8-4c5a-bc93-ecdfff82eeeb admin admin] PATH_INFO: `/v3/projects/98c8349e887c4c81bc5985f436eb457d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:09.152473 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441780bc-9257-47fe-992e-bfaa2026fd82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:09.153985 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52858b-09b8-4c5a-bc93-ecdfff82eeeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=98c8349e887c4c81bc5985f436eb457d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:09.156008 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52858b-09b8-4c5a-bc93-ecdfff82eeeb admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:09.158519 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-441780bc-9257-47fe-992e-bfaa2026fd82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:09.277219 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-dd52858b-09b8-4c5a-bc93-ecdfff82eeeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98c8349e887c4c81bc5985f436eb457d', 'request_id': 'req-dd52858b-09b8-4c5a-bc93-ecdfff82eeeb'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:09.295767 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-dd52858b-09b8-4c5a-bc93-ecdfff82eeeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98c8349e887c4c81bc5985f436eb457d', 'request_id': 'req-dd52858b-09b8-4c5a-bc93-ecdfff82eeeb'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:09.312562 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-dd52858b-09b8-4c5a-bc93-ecdfff82eeeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98c8349e887c4c81bc5985f436eb457d', 'request_id': 'req-dd52858b-09b8-4c5a-bc93-ecdfff82eeeb'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:09.331294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441780bc-9257-47fe-992e-bfaa2026fd82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:09.333083 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441780bc-9257-47fe-992e-bfaa2026fd82 service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:09.343922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-dd52858b-09b8-4c5a-bc93-ecdfff82eeeb admin admin] The token cache is being invalidate because project 98c8349e887c4c81bc5985f436eb457d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:09.344217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-dd52858b-09b8-4c5a-bc93-ecdfff82eeeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:09.348592 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-dd52858b-09b8-4c5a-bc93-ecdfff82eeeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:09.351527 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 867/1719] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:08 2022] DELETE /identity/v3/projects/98c8349e887c4c81bc5985f436eb457d => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:09.353154 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52858b-09b8-4c5a-bc93-ecdfff82eeeb admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:09.354614 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-dd52858b-09b8-4c5a-bc93-ecdfff82eeeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:09.357897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 853/1720] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:08 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:09.359391 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f5981-6cf4-4e5e-8bd4-cb77719e179d None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:09.359777 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f5981-6cf4-4e5e-8bd4-cb77719e179d None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:09.361077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f5981-6cf4-4e5e-8bd4-cb77719e179d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:09.428750 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-da5f5981-6cf4-4e5e-8bd4-cb77719e179d None None] MFA Rules not processed for user `1b1b38b0aa504cd1ac7e851be5b6e266`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:09.432187 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-da5f5981-6cf4-4e5e-8bd4-cb77719e179d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:09.532595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:09.567577 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52858b-09b8-4c5a-bc93-ecdfff82eeeb admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:09.626534 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4220106-0b3b-4741-98cd-cc605fd1ec10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:09.627648 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4220106-0b3b-4741-98cd-cc605fd1ec10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:09.633362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4220106-0b3b-4741-98cd-cc605fd1ec10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:09.634360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4220106-0b3b-4741-98cd-cc605fd1ec10 admin admin] PATH_INFO: `/v3/users/98664a87d08145b190e998d4e16d4fe5` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:09.639526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4220106-0b3b-4741-98cd-cc605fd1ec10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98664a87d08145b190e998d4e16d4fe5)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:09.646453 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4220106-0b3b-4741-98cd-cc605fd1ec10 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:09.670523 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 854/1721] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:09.688207 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8386b-b2c4-426b-b6be-1054f75d65ad None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:09.688207 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8386b-b2c4-426b-b6be-1054f75d65ad None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:09.688207 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8386b-b2c4-426b-b6be-1054f75d65ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:09.713207 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:09.734017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-f4220106-0b3b-4741-98cd-cc605fd1ec10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98664a87d08145b190e998d4e16d4fe5'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:09.734889 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-f4220106-0b3b-4741-98cd-cc605fd1ec10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98664a87d08145b190e998d4e16d4fe5'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:09.756552 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-f4220106-0b3b-4741-98cd-cc605fd1ec10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98664a87d08145b190e998d4e16d4fe5'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:09.768077 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-f4220106-0b3b-4741-98cd-cc605fd1ec10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98664a87d08145b190e998d4e16d4fe5'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:09.779058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-f4220106-0b3b-4741-98cd-cc605fd1ec10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98664a87d08145b190e998d4e16d4fe5'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:09.794168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 868/1722] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:09 2022] DELETE /identity/v3/users/98664a87d08145b190e998d4e16d4fe5 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:09.794243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-f2e8386b-b2c4-426b-b6be-1054f75d65ad None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:09.794311 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245eba2-1f40-4281-8c14-ac1d89de7368 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:09.794697 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245eba2-1f40-4281-8c14-ac1d89de7368 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:09.794954 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245eba2-1f40-4281-8c14-ac1d89de7368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:09.795048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-f2e8386b-b2c4-426b-b6be-1054f75d65ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:09.827528 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-d245eba2-1f40-4281-8c14-ac1d89de7368 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:09.830741 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-d245eba2-1f40-4281-8c14-ac1d89de7368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:09.916212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 869/1723] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:09.917255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7890d53-14f4-4b9c-bce8-aebc42e61bbb None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:09.917718 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7890d53-14f4-4b9c-bce8-aebc42e61bbb None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:09.918136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7890d53-14f4-4b9c-bce8-aebc42e61bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:09.992470 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-f7890d53-14f4-4b9c-bce8-aebc42e61bbb None None] MFA Rules not processed for user `8985c6b6a96a4f8ba785876fb3508302`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:09.994070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f7890d53-14f4-4b9c-bce8-aebc42e61bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:10.009900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 855/1724] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:10.014491 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248d76d-0d29-4bdc-b31c-be08b46fab38 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:10.014972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248d76d-0d29-4bdc-b31c-be08b46fab38 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:10.016134 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248d76d-0d29-4bdc-b31c-be08b46fab38 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:10.021218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 856/1725] 10.222.0.58 () {54 vars in 961 bytes} [Wed Aug 24 09:45:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:45:10.022405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248d76d-0d29-4bdc-b31c-be08b46fab38 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:10.027367 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-9248d76d-0d29-4bdc-b31c-be08b46fab38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:10.086202 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 870/1726] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:10.099681 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3457db6-6d0c-4b3b-9419-fbb35c3b7814 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:10.100084 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3457db6-6d0c-4b3b-9419-fbb35c3b7814 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:10.100511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3457db6-6d0c-4b3b-9419-fbb35c3b7814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:10.128036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-e3457db6-6d0c-4b3b-9419-fbb35c3b7814 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:10.129760 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-e3457db6-6d0c-4b3b-9419-fbb35c3b7814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:10.142425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 871/1727] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:10.147578 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18647f-968c-45eb-a491-9f2d8618a990 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:10.148028 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18647f-968c-45eb-a491-9f2d8618a990 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:10.148417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18647f-968c-45eb-a491-9f2d8618a990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:10.175863 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-3c18647f-968c-45eb-a491-9f2d8618a990 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:10.178102 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-3c18647f-968c-45eb-a491-9f2d8618a990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:10.189188 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 872/1728] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:10.191037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a05f3-86d1-434e-99cc-97f734007ad7 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:10.191458 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a05f3-86d1-434e-99cc-97f734007ad7 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:10.192918 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a05f3-86d1-434e-99cc-97f734007ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:10.220076 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-469a05f3-86d1-434e-99cc-97f734007ad7 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:10.224930 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-469a05f3-86d1-434e-99cc-97f734007ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:10.239509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 873/1729] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:10.239509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dff2b1-8682-479b-be6e-dc9dd5d591e9 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:10.239509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dff2b1-8682-479b-be6e-dc9dd5d591e9 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:10.239509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dff2b1-8682-479b-be6e-dc9dd5d591e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:10.274513 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248d76d-0d29-4bdc-b31c-be08b46fab38 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:10.278578 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-49dff2b1-8682-479b-be6e-dc9dd5d591e9 None None] MFA Rules not processed for user `6983e364f5564ed7854dff06a80f55d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:10.279786 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-49dff2b1-8682-479b-be6e-dc9dd5d591e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:10.292302 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833f827-4241-4ded-b298-8a6c9b88fe67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:10.292726 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833f827-4241-4ded-b298-8a6c9b88fe67 service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:10.293013 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833f827-4241-4ded-b298-8a6c9b88fe67 service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:10.293299 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833f827-4241-4ded-b298-8a6c9b88fe67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:10.298595 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:10.298767 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-3833f827-4241-4ded-b298-8a6c9b88fe67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:10.475674 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 874/1730] 10.222.0.58 () {58 vars in 1058 bytes} [Wed Aug 24 09:45:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:10.476301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833f827-4241-4ded-b298-8a6c9b88fe67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:10.477202 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfe3af-9448-44ef-bf99-abfc45290883 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:10.477648 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfe3af-9448-44ef-bf99-abfc45290883 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:10.493122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833f827-4241-4ded-b298-8a6c9b88fe67 service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:10.495460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfe3af-9448-44ef-bf99-abfc45290883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:10.508500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 857/1731] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:10.510589 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09beab98-0996-463f-82c1-bf08accfd328 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:10.510972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09beab98-0996-463f-82c1-bf08accfd328 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:10.512114 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09beab98-0996-463f-82c1-bf08accfd328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:10.548456 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-09beab98-0996-463f-82c1-bf08accfd328 None None] MFA Rules not processed for user `8985c6b6a96a4f8ba785876fb3508302`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:10.550387 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-09beab98-0996-463f-82c1-bf08accfd328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:10.568205 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-47bfe3af-9448-44ef-bf99-abfc45290883 None None] MFA Rules not processed for user `f197b03d644e4176bf6a0800aae31b4d`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:10.569700 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 858/1732] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:10.571189 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09beab98-0996-463f-82c1-bf08accfd328 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:10.572715 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-09beab98-0996-463f-82c1-bf08accfd328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:10.572838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-47bfe3af-9448-44ef-bf99-abfc45290883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:10.578426 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:10.736549 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09beab98-0996-463f-82c1-bf08accfd328 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:10.746924 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f09bc8-7e12-422a-82c4-d565cf39f8c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:10.749493 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f09bc8-7e12-422a-82c4-d565cf39f8c9 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:10.749797 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f09bc8-7e12-422a-82c4-d565cf39f8c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:10.750626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f09bc8-7e12-422a-82c4-d565cf39f8c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:10.801129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f09bc8-7e12-422a-82c4-d565cf39f8c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:10.805203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f09bc8-7e12-422a-82c4-d565cf39f8c9 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:10.815489 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 875/1733] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:10.816613 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfe3af-9448-44ef-bf99-abfc45290883 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:10.836559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 859/1734] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:10.839211 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f09bc8-7e12-422a-82c4-d565cf39f8c9 service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:10.873528 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f09bc8-7e12-422a-82c4-d565cf39f8c9 service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:10.874220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfe3af-9448-44ef-bf99-abfc45290883 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:10.883004 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a849f01-4d2c-4cf9-8cc1-8fc5aab7a641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:10.883635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a849f01-4d2c-4cf9-8cc1-8fc5aab7a641 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:10.885051 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a849f01-4d2c-4cf9-8cc1-8fc5aab7a641 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:10.885338 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a849f01-4d2c-4cf9-8cc1-8fc5aab7a641 admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:10.886645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a849f01-4d2c-4cf9-8cc1-8fc5aab7a641 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:10.888099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a849f01-4d2c-4cf9-8cc1-8fc5aab7a641 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:10.889952 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a849f01-4d2c-4cf9-8cc1-8fc5aab7a641 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:10.891097 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088e058-e3f4-4379-9b70-bf5c6881404a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:10.892415 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088e058-e3f4-4379-9b70-bf5c6881404a admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:10.892707 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088e058-e3f4-4379-9b70-bf5c6881404a admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:10.892985 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088e058-e3f4-4379-9b70-bf5c6881404a admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:10.893691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088e058-e3f4-4379-9b70-bf5c6881404a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:10.904626 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088e058-e3f4-4379-9b70-bf5c6881404a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:10.914121 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088e058-e3f4-4379-9b70-bf5c6881404a admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:10.923477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 860/1735] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:10.923477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a849f01-4d2c-4cf9-8cc1-8fc5aab7a641 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:10.959758 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a849f01-4d2c-4cf9-8cc1-8fc5aab7a641 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:10.963256 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 876/1736] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:10.964287 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088e058-e3f4-4379-9b70-bf5c6881404a admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:10.967879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-b088e058-e3f4-4379-9b70-bf5c6881404a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:10.970097 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9282e46-bb6c-44de-86ab-f649f380bfd1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983e364f5564ed7854dff06a80f55d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:10.970977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9282e46-bb6c-44de-86ab-f649f380bfd1 service placement] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:10.971268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9282e46-bb6c-44de-86ab-f649f380bfd1 service placement] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:10.973972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9282e46-bb6c-44de-86ab-f649f380bfd1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:10.977071 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-d9282e46-bb6c-44de-86ab-f649f380bfd1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:11.018934 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9282e46-bb6c-44de-86ab-f649f380bfd1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:11.022824 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9282e46-bb6c-44de-86ab-f649f380bfd1 service placement] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:11.050510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088e058-e3f4-4379-9b70-bf5c6881404a admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:11.059375 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 861/1737] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:11.074247 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9282e46-bb6c-44de-86ab-f649f380bfd1 service placement] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:11.080119 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41676a5a-e120-4383-885b-7a69e8d2478e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:11.080751 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41676a5a-e120-4383-885b-7a69e8d2478e service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:11.081033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41676a5a-e120-4383-885b-7a69e8d2478e service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:11.081314 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41676a5a-e120-4383-885b-7a69e8d2478e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:11.111758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41676a5a-e120-4383-885b-7a69e8d2478e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:11.116767 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41676a5a-e120-4383-885b-7a69e8d2478e service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:11.132961 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9282e46-bb6c-44de-86ab-f649f380bfd1 service placement] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:11.142571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 877/1738] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:11.143856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41676a5a-e120-4383-885b-7a69e8d2478e service nova] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:11.146796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1a72a-8d19-4957-bb4a-5e3320d218b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:11.150196 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1a72a-8d19-4957-bb4a-5e3320d218b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:11.150912 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1a72a-8d19-4957-bb4a-5e3320d218b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:11.151069 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1a72a-8d19-4957-bb4a-5e3320d218b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:11.151865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1a72a-8d19-4957-bb4a-5e3320d218b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:11.153964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1a72a-8d19-4957-bb4a-5e3320d218b2 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:11.184651 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41676a5a-e120-4383-885b-7a69e8d2478e service nova] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:11.203534 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f393b5-585b-442c-9f5f-7ba635e071da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:11.205228 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f393b5-585b-442c-9f5f-7ba635e071da admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:11.205540 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f393b5-585b-442c-9f5f-7ba635e071da admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:11.205823 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f393b5-585b-442c-9f5f-7ba635e071da admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:11.206466 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f393b5-585b-442c-9f5f-7ba635e071da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:11.208399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f393b5-585b-442c-9f5f-7ba635e071da admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:11.266177 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 862/1739] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:11 2022] POST /identity/v3/projects => generated 377 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:11.275858 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1a72a-8d19-4957-bb4a-5e3320d218b2 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:11.322194 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 878/1740] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:11 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:11.323469 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f393b5-585b-442c-9f5f-7ba635e071da admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:11.586575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1a72a-8d19-4957-bb4a-5e3320d218b2 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:11.606935 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f393b5-585b-442c-9f5f-7ba635e071da admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:11.608433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ea444-f2f6-43a8-9150-6b51cd77771c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:11.609066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ea444-f2f6-43a8-9150-6b51cd77771c admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:11.609352 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ea444-f2f6-43a8-9150-6b51cd77771c admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:11.609707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ea444-f2f6-43a8-9150-6b51cd77771c admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:11.611035 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ea444-f2f6-43a8-9150-6b51cd77771c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:11.618778 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ea444-f2f6-43a8-9150-6b51cd77771c admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:11.621542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09848c4b-953d-4e28-a5de-5004c29eab66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:11.622483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09848c4b-953d-4e28-a5de-5004c29eab66 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:11.622912 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09848c4b-953d-4e28-a5de-5004c29eab66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:11.623257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09848c4b-953d-4e28-a5de-5004c29eab66 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:11.624087 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09848c4b-953d-4e28-a5de-5004c29eab66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:11.626732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09848c4b-953d-4e28-a5de-5004c29eab66 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:11.650466 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:11.658723 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 879/1741] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:11 2022] POST /identity/v3/users => generated 290 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:45:11.663189 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09848c4b-953d-4e28-a5de-5004c29eab66 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:11.670977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 863/1742] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:11 2022] POST /identity/v3/users => generated 289 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:11.675512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ea444-f2f6-43a8-9150-6b51cd77771c admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:11.680676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09848c4b-953d-4e28-a5de-5004c29eab66 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:11.689409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a4c44-7329-4d0c-b4b7-e6a12735158a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:11.690341 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a4c44-7329-4d0c-b4b7-e6a12735158a admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:11.690818 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a4c44-7329-4d0c-b4b7-e6a12735158a admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:11.691444 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a4c44-7329-4d0c-b4b7-e6a12735158a admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:11.692364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a4c44-7329-4d0c-b4b7-e6a12735158a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:11.695089 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a4c44-7329-4d0c-b4b7-e6a12735158a admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:11.705837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ea444-f2f6-43a8-9150-6b51cd77771c admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:11.716260 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 880/1743] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:11.725281 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3af70-ccdb-47e2-b98b-5405e8303d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:11.725981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3af70-ccdb-47e2-b98b-5405e8303d33 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:11.726267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3af70-ccdb-47e2-b98b-5405e8303d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:11.726544 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3af70-ccdb-47e2-b98b-5405e8303d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:11.727216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3af70-ccdb-47e2-b98b-5405e8303d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:11.732517 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a4c44-7329-4d0c-b4b7-e6a12735158a admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:11.740506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e3af70-ccdb-47e2-b98b-5405e8303d33 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:11.763769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a4c44-7329-4d0c-b4b7-e6a12735158a admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:11.771739 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 864/1744] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:45:11.775085 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3af70-ccdb-47e2-b98b-5405e8303d33 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:11.776812 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96040c6-f9d8-461f-a591-333e42b691c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:11.777602 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96040c6-f9d8-461f-a591-333e42b691c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:11.778037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96040c6-f9d8-461f-a591-333e42b691c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:11.778596 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96040c6-f9d8-461f-a591-333e42b691c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:11.779409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96040c6-f9d8-461f-a591-333e42b691c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:11.781338 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96040c6-f9d8-461f-a591-333e42b691c9 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:11.804669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 881/1745] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:11.804859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3af70-ccdb-47e2-b98b-5405e8303d33 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:11.806312 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96040c6-f9d8-461f-a591-333e42b691c9 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:11.816133 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ae921-1013-4c26-b032-fffa0c5e6043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:11.816767 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ae921-1013-4c26-b032-fffa0c5e6043 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:11.817051 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ae921-1013-4c26-b032-fffa0c5e6043 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:11.817325 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ae921-1013-4c26-b032-fffa0c5e6043 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:11.818042 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ae921-1013-4c26-b032-fffa0c5e6043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:11.819958 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ae921-1013-4c26-b032-fffa0c5e6043 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:11.821761 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96040c6-f9d8-461f-a591-333e42b691c9 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:11.842387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039ba31-4896-4382-8d81-8cd5ae3e2546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:11.843595 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039ba31-4896-4382-8d81-8cd5ae3e2546 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:11.846147 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039ba31-4896-4382-8d81-8cd5ae3e2546 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:11.846837 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039ba31-4896-4382-8d81-8cd5ae3e2546 admin admin] PATH_INFO: `/v3/projects/e5c9fdae45c14fd6bf7327d25b4e2ba1/users/ef6ca30fdbe24b2eb809f578d9a1e323/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:11.850454 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 865/1746] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:45:11.854521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ae921-1013-4c26-b032-fffa0c5e6043 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:11.876346 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ae921-1013-4c26-b032-fffa0c5e6043 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:11.890689 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c60c60-0f6a-4c3c-bd86-2fa1aef40644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:11.891954 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c60c60-0f6a-4c3c-bd86-2fa1aef40644 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:11.892200 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c60c60-0f6a-4c3c-bd86-2fa1aef40644 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:11.892482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c60c60-0f6a-4c3c-bd86-2fa1aef40644 admin admin] PATH_INFO: `/v3/projects/234b14a77f9d4b50ac4b1239eaa6ddc3/users/423cd4872756458c9e74b661aa1b7b27/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:11.896343 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039ba31-4896-4382-8d81-8cd5ae3e2546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c9fdae45c14fd6bf7327d25b4e2ba1, user_id=ef6ca30fdbe24b2eb809f578d9a1e323, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:11.903680 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039ba31-4896-4382-8d81-8cd5ae3e2546 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:11.945511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 882/1747] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:11 2022] PUT /identity/v3/projects/e5c9fdae45c14fd6bf7327d25b4e2ba1/users/ef6ca30fdbe24b2eb809f578d9a1e323/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:45:11.945721 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c60c60-0f6a-4c3c-bd86-2fa1aef40644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=234b14a77f9d4b50ac4b1239eaa6ddc3, user_id=423cd4872756458c9e74b661aa1b7b27, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:11.951261 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c60c60-0f6a-4c3c-bd86-2fa1aef40644 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:11.955705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82874120-021b-4eb0-9219-a81d7819b974 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:11.956390 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82874120-021b-4eb0-9219-a81d7819b974 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:11.956834 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82874120-021b-4eb0-9219-a81d7819b974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:11.987150 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:12.012695 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 866/1748] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:11 2022] PUT /identity/v3/projects/234b14a77f9d4b50ac4b1239eaa6ddc3/users/423cd4872756458c9e74b661aa1b7b27/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:12.015077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7af4e-3422-4eac-9b37-bd8d17c02d0c None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:12.015371 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7af4e-3422-4eac-9b37-bd8d17c02d0c None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:12.015655 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7af4e-3422-4eac-9b37-bd8d17c02d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:12.042587 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-82874120-021b-4eb0-9219-a81d7819b974 None None] MFA Rules not processed for user `ef6ca30fdbe24b2eb809f578d9a1e323`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:12.048696 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-82874120-021b-4eb0-9219-a81d7819b974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:12.075435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-cca7af4e-3422-4eac-9b37-bd8d17c02d0c None None] MFA Rules not processed for user `423cd4872756458c9e74b661aa1b7b27`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:12.077123 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-cca7af4e-3422-4eac-9b37-bd8d17c02d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:12.165794 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 867/1749] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:45:12.169868 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7af4e-3422-4eac-9b37-bd8d17c02d0c None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:12.277212 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7af4e-3422-4eac-9b37-bd8d17c02d0c None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:12.278886 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 883/1750] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:45:12.284544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82874120-021b-4eb0-9219-a81d7819b974 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:12.286836 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdde86f-f061-4d69-b1aa-0a38e2a9f0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:12.287621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdde86f-f061-4d69-b1aa-0a38e2a9f0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:12.287976 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdde86f-f061-4d69-b1aa-0a38e2a9f0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:12.288358 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdde86f-f061-4d69-b1aa-0a38e2a9f0c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:12.290800 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdde86f-f061-4d69-b1aa-0a38e2a9f0c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:12.294369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdde86f-f061-4d69-b1aa-0a38e2a9f0c7 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:12.320855 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82874120-021b-4eb0-9219-a81d7819b974 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:12.336878 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 868/1751] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:12 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:12.338063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756bb2c-74d3-4bc3-ae55-e6ad0fe39c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:12.338892 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756bb2c-74d3-4bc3-ae55-e6ad0fe39c0c admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:12.340330 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdde86f-f061-4d69-b1aa-0a38e2a9f0c7 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:12.343775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756bb2c-74d3-4bc3-ae55-e6ad0fe39c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:12.344327 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756bb2c-74d3-4bc3-ae55-e6ad0fe39c0c admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:12.347603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756bb2c-74d3-4bc3-ae55-e6ad0fe39c0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:12.352830 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756bb2c-74d3-4bc3-ae55-e6ad0fe39c0c admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:12.447870 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 884/1752] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:12 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:12.450528 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf09a74-e372-4ddd-8655-fb7831ddbb02 None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:12.452486 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf09a74-e372-4ddd-8655-fb7831ddbb02 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:12.452779 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf09a74-e372-4ddd-8655-fb7831ddbb02 None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:12.455306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 885/1753] 10.222.0.58 () {54 vars in 912 bytes} [Wed Aug 24 09:45:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:45:12.462701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf09a74-e372-4ddd-8655-fb7831ddbb02 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:12.545971 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdde86f-f061-4d69-b1aa-0a38e2a9f0c7 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:12.593691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:12.715527 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf09a74-e372-4ddd-8655-fb7831ddbb02 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:12.718564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769d81e-9ecc-4b17-88ad-37d03c145b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:12.720631 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769d81e-9ecc-4b17-88ad-37d03c145b9b admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:12.721123 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769d81e-9ecc-4b17-88ad-37d03c145b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:12.723452 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769d81e-9ecc-4b17-88ad-37d03c145b9b admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:12.724261 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769d81e-9ecc-4b17-88ad-37d03c145b9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:12.729165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ac17e-f95b-4fff-a5a8-83010424f385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:12.729676 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769d81e-9ecc-4b17-88ad-37d03c145b9b admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:12.731203 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ac17e-f95b-4fff-a5a8-83010424f385 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:12.732969 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ac17e-f95b-4fff-a5a8-83010424f385 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:12.733266 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ac17e-f95b-4fff-a5a8-83010424f385 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:12.735393 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ac17e-f95b-4fff-a5a8-83010424f385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:12.741664 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ac17e-f95b-4fff-a5a8-83010424f385 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:12.791316 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 869/1754] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:12 2022] POST /identity/v3/users => generated 295 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:12.795707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5fb74-4109-4857-afc7-01e9fcd2826a None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:12.796098 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5fb74-4109-4857-afc7-01e9fcd2826a None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:12.796478 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5fb74-4109-4857-afc7-01e9fcd2826a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:12.815261 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 886/1755] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:12 2022] POST /identity/v3/users => generated 297 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:12.818177 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ac17e-f95b-4fff-a5a8-83010424f385 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:12.857131 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ac17e-f95b-4fff-a5a8-83010424f385 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:12.888441 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e593bc1-b1e5-4dcd-8d99-fbed1aa0e103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:12.893126 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e593bc1-b1e5-4dcd-8d99-fbed1aa0e103 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:12.893440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e593bc1-b1e5-4dcd-8d99-fbed1aa0e103 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:12.893727 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e593bc1-b1e5-4dcd-8d99-fbed1aa0e103 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:12.895726 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-3ff5fb74-4109-4857-afc7-01e9fcd2826a None None] MFA Rules not processed for user `7847dbf8f31146c5ab2136fbdb487783`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:12.899384 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-3ff5fb74-4109-4857-afc7-01e9fcd2826a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:12.900191 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e593bc1-b1e5-4dcd-8d99-fbed1aa0e103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:12.906790 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e593bc1-b1e5-4dcd-8d99-fbed1aa0e103 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:12.935411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:12.953190 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 887/1756] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:12.954223 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e593bc1-b1e5-4dcd-8d99-fbed1aa0e103 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:13.001618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e593bc1-b1e5-4dcd-8d99-fbed1aa0e103 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:13.024411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcfb08-37c7-4417-9aab-1c921c1518a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:13.025056 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcfb08-37c7-4417-9aab-1c921c1518a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:13.026402 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcfb08-37c7-4417-9aab-1c921c1518a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:13.026691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcfb08-37c7-4417-9aab-1c921c1518a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:13.031163 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcfb08-37c7-4417-9aab-1c921c1518a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:13.040601 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcfb08-37c7-4417-9aab-1c921c1518a2 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:13.052300 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 870/1757] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 09:45:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:13.053519 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5fb74-4109-4857-afc7-01e9fcd2826a None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:13.081634 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 888/1758] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:13.082812 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcfb08-37c7-4417-9aab-1c921c1518a2 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:13.085804 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5fb74-4109-4857-afc7-01e9fcd2826a None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:13.094270 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621dfa1-2a5b-434b-aa59-95592dfd0c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:13.095714 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621dfa1-2a5b-434b-aa59-95592dfd0c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:13.096199 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621dfa1-2a5b-434b-aa59-95592dfd0c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:13.096947 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621dfa1-2a5b-434b-aa59-95592dfd0c5e admin admin] PATH_INFO: `/v3/projects/5b616fe1621c46288eb85a97ad71f129/users/584ef4d43f89419f986e61bdf931aeb0/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:13.103610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcfb08-37c7-4417-9aab-1c921c1518a2 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:13.121834 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc55600-7662-486c-a370-f0a6eccff78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:13.123575 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc55600-7662-486c-a370-f0a6eccff78d admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:13.124032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc55600-7662-486c-a370-f0a6eccff78d admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:13.124313 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc55600-7662-486c-a370-f0a6eccff78d admin admin] PATH_INFO: `/v3/projects/60ed75b7b135454cb936c200ec8e6a9f/users/77ca9e3aea5640b293a6c7d2e86d3dea/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:13.138029 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621dfa1-2a5b-434b-aa59-95592dfd0c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b616fe1621c46288eb85a97ad71f129, user_id=584ef4d43f89419f986e61bdf931aeb0, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:13.142925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621dfa1-2a5b-434b-aa59-95592dfd0c5e admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:13.165687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 871/1759] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:13 2022] PUT /identity/v3/projects/5b616fe1621c46288eb85a97ad71f129/users/584ef4d43f89419f986e61bdf931aeb0/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:13.169631 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621dfa1-2a5b-434b-aa59-95592dfd0c5e admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:13.188592 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc55600-7662-486c-a370-f0a6eccff78d admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ed75b7b135454cb936c200ec8e6a9f, user_id=77ca9e3aea5640b293a6c7d2e86d3dea, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:13.199080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc55600-7662-486c-a370-f0a6eccff78d admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:13.249886 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 889/1760] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:13 2022] PUT /identity/v3/projects/60ed75b7b135454cb936c200ec8e6a9f/users/77ca9e3aea5640b293a6c7d2e86d3dea/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:13.255471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc55600-7662-486c-a370-f0a6eccff78d admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:13.335776 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621dfa1-2a5b-434b-aa59-95592dfd0c5e admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:13.458632 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:13.499033 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bb671-f581-46cf-838d-d7d5c3f0bbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:13.499693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bb671-f581-46cf-838d-d7d5c3f0bbfe admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:13.500045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bb671-f581-46cf-838d-d7d5c3f0bbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:13.500397 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bb671-f581-46cf-838d-d7d5c3f0bbfe admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:13.501256 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2bb671-f581-46cf-838d-d7d5c3f0bbfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:13.503041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2bb671-f581-46cf-838d-d7d5c3f0bbfe admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:13.521661 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc55600-7662-486c-a370-f0a6eccff78d admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:13.552661 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 872/1761] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:45:13.553593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bb671-f581-46cf-838d-d7d5c3f0bbfe admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:13.603620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007e7d4-f17d-40a6-aa17-0419fb85f303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:13.604317 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007e7d4-f17d-40a6-aa17-0419fb85f303 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:13.608092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007e7d4-f17d-40a6-aa17-0419fb85f303 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:13.608423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007e7d4-f17d-40a6-aa17-0419fb85f303 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:13.609115 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007e7d4-f17d-40a6-aa17-0419fb85f303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:13.617862 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4007e7d4-f17d-40a6-aa17-0419fb85f303 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:13.675944 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 890/1762] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:13.676807 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007e7d4-f17d-40a6-aa17-0419fb85f303 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:13.681175 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-4007e7d4-f17d-40a6-aa17-0419fb85f303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:13.737714 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007e7d4-f17d-40a6-aa17-0419fb85f303 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:13.743022 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad68be8-7a04-4eca-82af-edc7f40cf3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:13.743673 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad68be8-7a04-4eca-82af-edc7f40cf3d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:13.743956 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad68be8-7a04-4eca-82af-edc7f40cf3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:13.744381 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad68be8-7a04-4eca-82af-edc7f40cf3d8 admin admin] PATH_INFO: `/v3/projects/b77de4e82d8d4b4986e033ec041db80b` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:13.745883 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad68be8-7a04-4eca-82af-edc7f40cf3d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b77de4e82d8d4b4986e033ec041db80b)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:13.747819 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad68be8-7a04-4eca-82af-edc7f40cf3d8 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:13.774673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bb671-f581-46cf-838d-d7d5c3f0bbfe admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:13.794297 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cc05d-40c4-401e-a269-8b79e603d3f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:13.794942 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cc05d-40c4-401e-a269-8b79e603d3f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:13.795232 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cc05d-40c4-401e-a269-8b79e603d3f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:13.795511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cc05d-40c4-401e-a269-8b79e603d3f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:13.811758 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cc05d-40c4-401e-a269-8b79e603d3f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:13.820632 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cc05d-40c4-401e-a269-8b79e603d3f8 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:13.847700 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 873/1763] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:13.855682 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cc05d-40c4-401e-a269-8b79e603d3f8 service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:13.866204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-4ad68be8-7a04-4eca-82af-edc7f40cf3d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b77de4e82d8d4b4986e033ec041db80b', 'request_id': 'req-4ad68be8-7a04-4eca-82af-edc7f40cf3d8'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:13.887228 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cc05d-40c4-401e-a269-8b79e603d3f8 service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:13.888540 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-4ad68be8-7a04-4eca-82af-edc7f40cf3d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b77de4e82d8d4b4986e033ec041db80b', 'request_id': 'req-4ad68be8-7a04-4eca-82af-edc7f40cf3d8'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:13.900728 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-4ad68be8-7a04-4eca-82af-edc7f40cf3d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b77de4e82d8d4b4986e033ec041db80b', 'request_id': 'req-4ad68be8-7a04-4eca-82af-edc7f40cf3d8'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:13.932702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-4ad68be8-7a04-4eca-82af-edc7f40cf3d8 admin admin] The token cache is being invalidate because project b77de4e82d8d4b4986e033ec041db80b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:13.933004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-4ad68be8-7a04-4eca-82af-edc7f40cf3d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:13.936447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-4ad68be8-7a04-4eca-82af-edc7f40cf3d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:13.944043 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 891/1764] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:13 2022] DELETE /identity/v3/projects/b77de4e82d8d4b4986e033ec041db80b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:13.947175 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad68be8-7a04-4eca-82af-edc7f40cf3d8 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:13.948764 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-4ad68be8-7a04-4eca-82af-edc7f40cf3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:14.059929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25022d16-ca58-4f5a-83ff-7c649c596dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:14.060959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25022d16-ca58-4f5a-83ff-7c649c596dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:14.064704 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25022d16-ca58-4f5a-83ff-7c649c596dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:14.067591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25022d16-ca58-4f5a-83ff-7c649c596dcd admin admin] PATH_INFO: `/v3/projects/5b616fe1621c46288eb85a97ad71f129/users/584ef4d43f89419f986e61bdf931aeb0/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:14.090278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25022d16-ca58-4f5a-83ff-7c649c596dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b616fe1621c46288eb85a97ad71f129, user_id=584ef4d43f89419f986e61bdf931aeb0, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:14.099911 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25022d16-ca58-4f5a-83ff-7c649c596dcd admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:14.154472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 874/1765] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:13 2022] PUT /identity/v3/projects/5b616fe1621c46288eb85a97ad71f129/users/584ef4d43f89419f986e61bdf931aeb0/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:14.156034 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:14.156208 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25022d16-ca58-4f5a-83ff-7c649c596dcd admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:14.165112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-25022d16-ca58-4f5a-83ff-7c649c596dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:14.252300 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad68be8-7a04-4eca-82af-edc7f40cf3d8 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:14.376078 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25022d16-ca58-4f5a-83ff-7c649c596dcd admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:14.392113 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87abba1-a115-4785-b4de-51f52f2587d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:14.392950 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87abba1-a115-4785-b4de-51f52f2587d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:14.393240 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87abba1-a115-4785-b4de-51f52f2587d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:14.393555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87abba1-a115-4785-b4de-51f52f2587d1 admin admin] PATH_INFO: `/v3/users/b7231a3493ab4eaca25554ee358169ac` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:14.398348 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87abba1-a115-4785-b4de-51f52f2587d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7231a3493ab4eaca25554ee358169ac)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:14.402951 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87abba1-a115-4785-b4de-51f52f2587d1 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:14.464712 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c64b4a-1d0d-4326-afe6-8bae7131ff51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:14.466222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c64b4a-1d0d-4326-afe6-8bae7131ff51 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:14.466764 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c64b4a-1d0d-4326-afe6-8bae7131ff51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:14.468503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c64b4a-1d0d-4326-afe6-8bae7131ff51 admin admin] PATH_INFO: `/v3/projects/60ed75b7b135454cb936c200ec8e6a9f/users/77ca9e3aea5640b293a6c7d2e86d3dea/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:14.474043 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c64b4a-1d0d-4326-afe6-8bae7131ff51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ed75b7b135454cb936c200ec8e6a9f, user_id=77ca9e3aea5640b293a6c7d2e86d3dea, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:14.492171 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c64b4a-1d0d-4326-afe6-8bae7131ff51 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:14.494422 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:14.529346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 892/1766] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:13 2022] PUT /identity/v3/projects/60ed75b7b135454cb936c200ec8e6a9f/users/77ca9e3aea5640b293a6c7d2e86d3dea/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:14.531393 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dda33d-b10e-4b7c-bbcf-0eabe1430e73 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:14.532403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dda33d-b10e-4b7c-bbcf-0eabe1430e73 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:14.532858 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dda33d-b10e-4b7c-bbcf-0eabe1430e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:14.590054 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a87abba1-a115-4785-b4de-51f52f2587d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7231a3493ab4eaca25554ee358169ac'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:14.592104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a87abba1-a115-4785-b4de-51f52f2587d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7231a3493ab4eaca25554ee358169ac'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:14.593418 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a87abba1-a115-4785-b4de-51f52f2587d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7231a3493ab4eaca25554ee358169ac'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:14.639725 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-24dda33d-b10e-4b7c-bbcf-0eabe1430e73 None None] MFA Rules not processed for user `584ef4d43f89419f986e61bdf931aeb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:14.644451 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-24dda33d-b10e-4b7c-bbcf-0eabe1430e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:14.648528 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a87abba1-a115-4785-b4de-51f52f2587d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7231a3493ab4eaca25554ee358169ac'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:14.690903 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a87abba1-a115-4785-b4de-51f52f2587d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7231a3493ab4eaca25554ee358169ac'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:14.751740 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 875/1767] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:14 2022] DELETE /identity/v3/users/b7231a3493ab4eaca25554ee358169ac => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:14.753349 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be7995-abe9-4c82-be2f-312e771c69ad None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:14.753667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be7995-abe9-4c82-be2f-312e771c69ad None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:14.753945 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be7995-abe9-4c82-be2f-312e771c69ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:14.870061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-a8be7995-abe9-4c82-be2f-312e771c69ad None None] MFA Rules not processed for user `77ca9e3aea5640b293a6c7d2e86d3dea`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:14.871318 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-a8be7995-abe9-4c82-be2f-312e771c69ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:14.885678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 893/1768] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:14.889936 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dda33d-b10e-4b7c-bbcf-0eabe1430e73 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:14.891684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-24dda33d-b10e-4b7c-bbcf-0eabe1430e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:15.003902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dda33d-b10e-4b7c-bbcf-0eabe1430e73 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:15.061201 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:15.098453 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 876/1769] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:15.113417 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be7995-abe9-4c82-be2f-312e771c69ad None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:15.114912 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-a8be7995-abe9-4c82-be2f-312e771c69ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:15.160904 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472efe8-a8df-4af7-a402-4d2831e05d49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:15.161893 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472efe8-a8df-4af7-a402-4d2831e05d49 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:15.162400 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472efe8-a8df-4af7-a402-4d2831e05d49 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:15.162731 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472efe8-a8df-4af7-a402-4d2831e05d49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:15.165459 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-5472efe8-a8df-4af7-a402-4d2831e05d49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:15.356161 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be7995-abe9-4c82-be2f-312e771c69ad None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:15.364083 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa0b45-e5a5-48ea-8a56-46cd9c79924a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:15.364539 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa0b45-e5a5-48ea-8a56-46cd9c79924a service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:15.364851 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa0b45-e5a5-48ea-8a56-46cd9c79924a service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:15.365127 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa0b45-e5a5-48ea-8a56-46cd9c79924a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:15.380079 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472efe8-a8df-4af7-a402-4d2831e05d49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:15.382613 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472efe8-a8df-4af7-a402-4d2831e05d49 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:15.397745 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa0b45-e5a5-48ea-8a56-46cd9c79924a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:15.402578 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa0b45-e5a5-48ea-8a56-46cd9c79924a service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:15.404852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 894/1770] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:15.407788 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d8b2e-3fc0-4f34-994c-f2e0ab053f0a None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:15.409914 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d8b2e-3fc0-4f34-994c-f2e0ab053f0a None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:15.411565 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d8b2e-3fc0-4f34-994c-f2e0ab053f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:15.461403 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 877/1771] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:45:15.463171 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-503d8b2e-3fc0-4f34-994c-f2e0ab053f0a None None] MFA Rules not processed for user `1b1b38b0aa504cd1ac7e851be5b6e266`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:15.465436 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-503d8b2e-3fc0-4f34-994c-f2e0ab053f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:15.473837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97649b5c-decf-46ae-a280-7a7636881c2d None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:15.474184 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97649b5c-decf-46ae-a280-7a7636881c2d None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:15.474461 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97649b5c-decf-46ae-a280-7a7636881c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:15.549827 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:15.590610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-97649b5c-decf-46ae-a280-7a7636881c2d None None] MFA Rules not processed for user `3ae62427d5914e67b5b4d0237ecccd06`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:15.591953 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-97649b5c-decf-46ae-a280-7a7636881c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:15.598276 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 895/1772] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:15.633911 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d8b2e-3fc0-4f34-994c-f2e0ab053f0a None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:15.649595 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d8b2e-3fc0-4f34-994c-f2e0ab053f0a None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:15.667124 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc66ee-4fef-4740-a982-562abe240ea5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:15.682692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc66ee-4fef-4740-a982-562abe240ea5 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:15.682990 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc66ee-4fef-4740-a982-562abe240ea5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:15.683249 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc66ee-4fef-4740-a982-562abe240ea5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:15.701147 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-e6dc66ee-4fef-4740-a982-562abe240ea5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:15.783267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 878/1773] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 09:45:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:15.957579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc66ee-4fef-4740-a982-562abe240ea5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:15.959039 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc66ee-4fef-4740-a982-562abe240ea5 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:15.988603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 896/1774] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:16.178635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97649b5c-decf-46ae-a280-7a7636881c2d None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:16.181498 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-97649b5c-decf-46ae-a280-7a7636881c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:16.619503 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97649b5c-decf-46ae-a280-7a7636881c2d None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:16.634376 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24469537-bf08-4993-ad59-e09bd8329f92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2db35b94c84ec7bba96117d23baf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:16.635493 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24469537-bf08-4993-ad59-e09bd8329f92 service swift] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:16.636112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24469537-bf08-4993-ad59-e09bd8329f92 service swift] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:16.636733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24469537-bf08-4993-ad59-e09bd8329f92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:16.669597 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24469537-bf08-4993-ad59-e09bd8329f92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:16.676710 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24469537-bf08-4993-ad59-e09bd8329f92 service swift] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:16.698045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 879/1775] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 09:45:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:45:17.341781 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc66ee-4fef-4740-a982-562abe240ea5 service cinder] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:17.352021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc66ee-4fef-4740-a982-562abe240ea5 service cinder] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:17.365196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad53e64-4a94-455a-9d73-b49744d4db23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:17.365860 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad53e64-4a94-455a-9d73-b49744d4db23 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:17.366136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad53e64-4a94-455a-9d73-b49744d4db23 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:17.366671 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad53e64-4a94-455a-9d73-b49744d4db23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:17.394428 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:17.484702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24469537-bf08-4993-ad59-e09bd8329f92 service swift] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:17.487349 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-24469537-bf08-4993-ad59-e09bd8329f92 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:17.570836 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad53e64-4a94-455a-9d73-b49744d4db23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:17.573863 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad53e64-4a94-455a-9d73-b49744d4db23 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:17.617889 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 897/1776] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:17.654898 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba428bd3-4af3-434b-96e8-9373ab02c31c None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:17.657994 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba428bd3-4af3-434b-96e8-9373ab02c31c None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:17.659208 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba428bd3-4af3-434b-96e8-9373ab02c31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:17.738669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-ba428bd3-4af3-434b-96e8-9373ab02c31c None None] MFA Rules not processed for user `6a42998888a34c099624c08e64013a13`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:17.743578 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-ba428bd3-4af3-434b-96e8-9373ab02c31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:17.786271 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24469537-bf08-4993-ad59-e09bd8329f92 service swift] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:17.796996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb080b9-2aa6-4506-a358-0c6ddd09021f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:17.797821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb080b9-2aa6-4506-a358-0c6ddd09021f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:17.798114 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb080b9-2aa6-4506-a358-0c6ddd09021f admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:17.798464 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb080b9-2aa6-4506-a358-0c6ddd09021f admin admin] PATH_INFO: `/v3/projects/fd4f886d8a564961aef43f1939b8b545` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:17.800838 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb080b9-2aa6-4506-a358-0c6ddd09021f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd4f886d8a564961aef43f1939b8b545)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:17.806803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb080b9-2aa6-4506-a358-0c6ddd09021f admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:17.820233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:17.933396 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-fcb080b9-2aa6-4506-a358-0c6ddd09021f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd4f886d8a564961aef43f1939b8b545', 'request_id': 'req-fcb080b9-2aa6-4506-a358-0c6ddd09021f'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:17.972000 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-fcb080b9-2aa6-4506-a358-0c6ddd09021f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd4f886d8a564961aef43f1939b8b545', 'request_id': 'req-fcb080b9-2aa6-4506-a358-0c6ddd09021f'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:17.988006 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-fcb080b9-2aa6-4506-a358-0c6ddd09021f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd4f886d8a564961aef43f1939b8b545', 'request_id': 'req-fcb080b9-2aa6-4506-a358-0c6ddd09021f'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:17.988976 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 898/1777] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:18.025053 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-fcb080b9-2aa6-4506-a358-0c6ddd09021f admin admin] The token cache is being invalidate because project fd4f886d8a564961aef43f1939b8b545 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:18.026629 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-fcb080b9-2aa6-4506-a358-0c6ddd09021f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:18.027566 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-fcb080b9-2aa6-4506-a358-0c6ddd09021f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:18.032935 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 880/1778] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:17 2022] DELETE /identity/v3/projects/fd4f886d8a564961aef43f1939b8b545 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:45:18.038588 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01f6cf-2f17-4f69-95e8-6c9cd081b91e None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:18.039312 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01f6cf-2f17-4f69-95e8-6c9cd081b91e None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:18.039755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01f6cf-2f17-4f69-95e8-6c9cd081b91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:18.085025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-fe01f6cf-2f17-4f69-95e8-6c9cd081b91e None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:18.086476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-fe01f6cf-2f17-4f69-95e8-6c9cd081b91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:18.488424 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 899/1779] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:18.493959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11300728-34f3-42f5-b1c0-4971b8268513 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:18.494506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11300728-34f3-42f5-b1c0-4971b8268513 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:18.494753 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11300728-34f3-42f5-b1c0-4971b8268513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:18.648410 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-11300728-34f3-42f5-b1c0-4971b8268513 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:18.661248 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-11300728-34f3-42f5-b1c0-4971b8268513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:18.721080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01f6cf-2f17-4f69-95e8-6c9cd081b91e None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:18.728421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 881/1780] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:18.753660 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01f6cf-2f17-4f69-95e8-6c9cd081b91e None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:18.779159 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bc948-0b83-4218-9bfd-1fcd5b7db38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:18.783069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bc948-0b83-4218-9bfd-1fcd5b7db38c admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:18.785668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bc948-0b83-4218-9bfd-1fcd5b7db38c admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:18.787279 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bc948-0b83-4218-9bfd-1fcd5b7db38c admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:18.790165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bc948-0b83-4218-9bfd-1fcd5b7db38c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:18.790978 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bc948-0b83-4218-9bfd-1fcd5b7db38c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:18.801533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bc948-0b83-4218-9bfd-1fcd5b7db38c admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:18.865026 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11300728-34f3-42f5-b1c0-4971b8268513 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:18.868764 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 900/1781] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:18.883223 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11300728-34f3-42f5-b1c0-4971b8268513 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:18.925806 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2892a-5038-4b2c-877d-bf7d3debbdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:18.926692 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2892a-5038-4b2c-877d-bf7d3debbdbc admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:18.927130 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2892a-5038-4b2c-877d-bf7d3debbdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:18.927570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2892a-5038-4b2c-877d-bf7d3debbdbc admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:18.928374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2892a-5038-4b2c-877d-bf7d3debbdbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:18.930585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2892a-5038-4b2c-877d-bf7d3debbdbc admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:19.042627 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 882/1782] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:18 2022] POST /identity/v3/projects => generated 365 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:45:19.046515 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bc948-0b83-4218-9bfd-1fcd5b7db38c admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:19.058684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bc948-0b83-4218-9bfd-1fcd5b7db38c admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:19.318637 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:19.365798 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089200b-bf19-4923-9634-8ae5036ffc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:19.366424 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089200b-bf19-4923-9634-8ae5036ffc78 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:19.366702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089200b-bf19-4923-9634-8ae5036ffc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:19.366978 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089200b-bf19-4923-9634-8ae5036ffc78 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:19.373641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089200b-bf19-4923-9634-8ae5036ffc78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:19.381776 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089200b-bf19-4923-9634-8ae5036ffc78 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:19.498362 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2892a-5038-4b2c-877d-bf7d3debbdbc admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:19.505794 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 901/1783] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:19 2022] POST /identity/v3/users => generated 283 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:19.518847 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2892a-5038-4b2c-877d-bf7d3debbdbc admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:19.545543 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f23e49-ea0a-4216-9c49-fdd0ef57f473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:19.546188 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f23e49-ea0a-4216-9c49-fdd0ef57f473 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:19.546472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f23e49-ea0a-4216-9c49-fdd0ef57f473 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:19.546756 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f23e49-ea0a-4216-9c49-fdd0ef57f473 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:19.547485 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f23e49-ea0a-4216-9c49-fdd0ef57f473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:19.572841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f23e49-ea0a-4216-9c49-fdd0ef57f473 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:19.619024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 883/1784] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:19.622148 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089200b-bf19-4923-9634-8ae5036ffc78 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:19.635995 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089200b-bf19-4923-9634-8ae5036ffc78 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:19.649886 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8ca9b-5714-4c41-a91c-049cb183bfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:19.650756 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8ca9b-5714-4c41-a91c-049cb183bfb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:19.650756 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8ca9b-5714-4c41-a91c-049cb183bfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:19.651022 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8ca9b-5714-4c41-a91c-049cb183bfb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:19.652028 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8ca9b-5714-4c41-a91c-049cb183bfb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:19.675276 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8ca9b-5714-4c41-a91c-049cb183bfb3 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:19.739283 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 902/1785] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:19.742636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f23e49-ea0a-4216-9c49-fdd0ef57f473 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:19.758597 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f23e49-ea0a-4216-9c49-fdd0ef57f473 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:19.801779 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f694c-d81e-440c-90c2-37afc95002d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:19.802445 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f694c-d81e-440c-90c2-37afc95002d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:19.808220 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f694c-d81e-440c-90c2-37afc95002d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:19.808485 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f694c-d81e-440c-90c2-37afc95002d8 admin admin] PATH_INFO: `/v3/projects/69f33cbe67004d89abb62c3355c7c5e2/users/dc93d108a22c4cbcace54bba45a2f062/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:19.889796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f694c-d81e-440c-90c2-37afc95002d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f33cbe67004d89abb62c3355c7c5e2, user_id=dc93d108a22c4cbcace54bba45a2f062, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:19.899415 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f694c-d81e-440c-90c2-37afc95002d8 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:19.969126 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 884/1786] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:19 2022] PUT /identity/v3/projects/69f33cbe67004d89abb62c3355c7c5e2/users/dc93d108a22c4cbcace54bba45a2f062/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:45:19.982211 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078d24d-7ac7-43fc-b46f-4cf938b155a2 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:19.983001 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078d24d-7ac7-43fc-b46f-4cf938b155a2 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:19.983464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078d24d-7ac7-43fc-b46f-4cf938b155a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:20.062544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-8078d24d-7ac7-43fc-b46f-4cf938b155a2 None None] MFA Rules not processed for user `dc93d108a22c4cbcace54bba45a2f062`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:20.066957 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-8078d24d-7ac7-43fc-b46f-4cf938b155a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:20.305253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f694c-d81e-440c-90c2-37afc95002d8 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:20.317732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 903/1787] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:20.523945 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f694c-d81e-440c-90c2-37afc95002d8 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:20.570313 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9652580-d57d-4776-8a3a-7a276da914fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:20.571324 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9652580-d57d-4776-8a3a-7a276da914fb admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:20.571812 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9652580-d57d-4776-8a3a-7a276da914fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:20.572288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9652580-d57d-4776-8a3a-7a276da914fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:20.573134 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9652580-d57d-4776-8a3a-7a276da914fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:20.575323 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9652580-d57d-4776-8a3a-7a276da914fb admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:20.673162 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 885/1788] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:20 2022] POST /identity/v3/projects => generated 367 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:20.677208 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078d24d-7ac7-43fc-b46f-4cf938b155a2 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:20.707816 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078d24d-7ac7-43fc-b46f-4cf938b155a2 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:20.803967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f7e60-48a4-45bc-bba9-9076d4f42fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:20.805114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f7e60-48a4-45bc-bba9-9076d4f42fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:20.805668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f7e60-48a4-45bc-bba9-9076d4f42fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:20.806305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f7e60-48a4-45bc-bba9-9076d4f42fa3 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:20.807334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f7e60-48a4-45bc-bba9-9076d4f42fa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:20.810316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f7e60-48a4-45bc-bba9-9076d4f42fa3 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:20.858183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 904/1789] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:20 2022] POST /identity/v3/users => generated 290 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:20.861851 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9652580-d57d-4776-8a3a-7a276da914fb admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:20.881708 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9652580-d57d-4776-8a3a-7a276da914fb admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:20.893661 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58dd1d-46b1-4caf-b7fc-94ba1c08e430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:20.895086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58dd1d-46b1-4caf-b7fc-94ba1c08e430 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:20.896692 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58dd1d-46b1-4caf-b7fc-94ba1c08e430 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:20.898088 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58dd1d-46b1-4caf-b7fc-94ba1c08e430 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:20.899166 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58dd1d-46b1-4caf-b7fc-94ba1c08e430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:20.903103 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58dd1d-46b1-4caf-b7fc-94ba1c08e430 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:20.948680 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f7e60-48a4-45bc-bba9-9076d4f42fa3 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:20.960354 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 886/1790] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:45:20.965016 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f7e60-48a4-45bc-bba9-9076d4f42fa3 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:20.988025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907d0e3-97f8-4cf1-986e-a094959a3f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:20.988783 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907d0e3-97f8-4cf1-986e-a094959a3f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:20.989741 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907d0e3-97f8-4cf1-986e-a094959a3f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:20.989953 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907d0e3-97f8-4cf1-986e-a094959a3f4b admin admin] PATH_INFO: `/v3/projects/c82b682b46f74ee397d74aa68f4637aa/users/1eaf1396134242d4bb7b7cf921333506/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:21.053032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907d0e3-97f8-4cf1-986e-a094959a3f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82b682b46f74ee397d74aa68f4637aa, user_id=1eaf1396134242d4bb7b7cf921333506, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:21.060372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907d0e3-97f8-4cf1-986e-a094959a3f4b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:21.101967 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58dd1d-46b1-4caf-b7fc-94ba1c08e430 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:21.102406 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 905/1791] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:20 2022] PUT /identity/v3/projects/c82b682b46f74ee397d74aa68f4637aa/users/1eaf1396134242d4bb7b7cf921333506/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:45:21.116170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58dd1d-46b1-4caf-b7fc-94ba1c08e430 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:21.127777 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:21.309216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2446821-da06-47d3-bc38-6164eab96485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:21.311231 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2446821-da06-47d3-bc38-6164eab96485 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:21.314122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2446821-da06-47d3-bc38-6164eab96485 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:21.314122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2446821-da06-47d3-bc38-6164eab96485 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:21.314713 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2446821-da06-47d3-bc38-6164eab96485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:21.324198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2446821-da06-47d3-bc38-6164eab96485 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:21.355388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907d0e3-97f8-4cf1-986e-a094959a3f4b admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:21.373908 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 887/1792] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:21.376081 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907d0e3-97f8-4cf1-986e-a094959a3f4b admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:21.391126 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e58e0-0784-40ca-a31d-0ce3b1ce30af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:21.391882 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e58e0-0784-40ca-a31d-0ce3b1ce30af admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:21.392325 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e58e0-0784-40ca-a31d-0ce3b1ce30af admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:21.392645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e58e0-0784-40ca-a31d-0ce3b1ce30af admin admin] PATH_INFO: `/v3/projects/c82b682b46f74ee397d74aa68f4637aa/users/1eaf1396134242d4bb7b7cf921333506/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:21.397902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e58e0-0784-40ca-a31d-0ce3b1ce30af admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82b682b46f74ee397d74aa68f4637aa, user_id=1eaf1396134242d4bb7b7cf921333506, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:21.407680 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e58e0-0784-40ca-a31d-0ce3b1ce30af admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:21.447258 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 906/1793] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:21 2022] PUT /identity/v3/projects/c82b682b46f74ee397d74aa68f4637aa/users/1eaf1396134242d4bb7b7cf921333506/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:21.459884 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6df0c-0e1d-4d0e-bb58-224df7af0b84 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:21.460430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6df0c-0e1d-4d0e-bb58-224df7af0b84 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:21.460705 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6df0c-0e1d-4d0e-bb58-224df7af0b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:21.600750 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-e9b6df0c-0e1d-4d0e-bb58-224df7af0b84 None None] MFA Rules not processed for user `1eaf1396134242d4bb7b7cf921333506`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:21.602019 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e9b6df0c-0e1d-4d0e-bb58-224df7af0b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:22.070030 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 888/1794] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 612 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:22.077750 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e58e0-0784-40ca-a31d-0ce3b1ce30af admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:22.080546 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-906e58e0-0784-40ca-a31d-0ce3b1ce30af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:22.099988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75682a34-84f2-4ec7-8b36-6c8499c44e69 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:22.100451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75682a34-84f2-4ec7-8b36-6c8499c44e69 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:22.106482 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75682a34-84f2-4ec7-8b36-6c8499c44e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:22.139355 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:22.207431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-75682a34-84f2-4ec7-8b36-6c8499c44e69 None None] MFA Rules not processed for user `7847dbf8f31146c5ab2136fbdb487783`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:22.209039 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-75682a34-84f2-4ec7-8b36-6c8499c44e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:22.289326 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e58e0-0784-40ca-a31d-0ce3b1ce30af admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:22.295320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bf32c-d294-49d3-b309-d8f86770aa9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:22.296449 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bf32c-d294-49d3-b309-d8f86770aa9f service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:22.297001 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bf32c-d294-49d3-b309-d8f86770aa9f service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:22.298237 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bf32c-d294-49d3-b309-d8f86770aa9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:22.355042 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4bf32c-d294-49d3-b309-d8f86770aa9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:22.368351 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4bf32c-d294-49d3-b309-d8f86770aa9f service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:22.414179 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 907/1795] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:22.551181 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 889/1796] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Aug 24 09:45:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:22.638603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bf32c-d294-49d3-b309-d8f86770aa9f service cinder] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:22.641837 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-ba4bf32c-d294-49d3-b309-d8f86770aa9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:22.686577 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bf32c-d294-49d3-b309-d8f86770aa9f service cinder] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:22.699650 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeaba99-14af-4a90-ae67-7262589c6284 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:22.700636 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeaba99-14af-4a90-ae67-7262589c6284 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:22.701030 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeaba99-14af-4a90-ae67-7262589c6284 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:22.701415 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeaba99-14af-4a90-ae67-7262589c6284 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:22.837080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75682a34-84f2-4ec7-8b36-6c8499c44e69 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:22.838940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-75682a34-84f2-4ec7-8b36-6c8499c44e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:22.863382 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75682a34-84f2-4ec7-8b36-6c8499c44e69 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:22.923783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12f278-0518-47cc-a8c8-76f5d3463ee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:22.923783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12f278-0518-47cc-a8c8-76f5d3463ee0 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:22.923783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12f278-0518-47cc-a8c8-76f5d3463ee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:22.923783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12f278-0518-47cc-a8c8-76f5d3463ee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:22.930667 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeaba99-14af-4a90-ae67-7262589c6284 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:22.932283 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeaba99-14af-4a90-ae67-7262589c6284 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:22.963124 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 908/1797] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:22.966007 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12f278-0518-47cc-a8c8-76f5d3463ee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:22.967464 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12f278-0518-47cc-a8c8-76f5d3463ee0 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:23.030455 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 890/1798] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:23.713658 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeaba99-14af-4a90-ae67-7262589c6284 service cinder] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:23.715417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-3aeaba99-14af-4a90-ae67-7262589c6284 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:24.021614 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeaba99-14af-4a90-ae67-7262589c6284 service cinder] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:24.045710 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303c4ff-bde0-466f-ad2b-30c1b7c30e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:24.050800 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303c4ff-bde0-466f-ad2b-30c1b7c30e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:24.053043 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303c4ff-bde0-466f-ad2b-30c1b7c30e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:24.054153 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303c4ff-bde0-466f-ad2b-30c1b7c30e82 admin admin] PATH_INFO: `/v3/users/423cd4872756458c9e74b661aa1b7b27` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:24.060892 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303c4ff-bde0-466f-ad2b-30c1b7c30e82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=423cd4872756458c9e74b661aa1b7b27)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:24.072520 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303c4ff-bde0-466f-ad2b-30c1b7c30e82 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:24.231460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3303c4ff-bde0-466f-ad2b-30c1b7c30e82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '423cd4872756458c9e74b661aa1b7b27'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:24.233395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3303c4ff-bde0-466f-ad2b-30c1b7c30e82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '423cd4872756458c9e74b661aa1b7b27'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:24.247574 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:24.271218 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3303c4ff-bde0-466f-ad2b-30c1b7c30e82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '423cd4872756458c9e74b661aa1b7b27'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:24.288150 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3303c4ff-bde0-466f-ad2b-30c1b7c30e82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '423cd4872756458c9e74b661aa1b7b27'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:24.304842 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3303c4ff-bde0-466f-ad2b-30c1b7c30e82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '423cd4872756458c9e74b661aa1b7b27'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:24.319405 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 909/1799] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:23 2022] DELETE /identity/v3/users/423cd4872756458c9e74b661aa1b7b27 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:24.326412 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d12c2c-aa23-418a-8cde-8d3eed98ae33 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:24.326919 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d12c2c-aa23-418a-8cde-8d3eed98ae33 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:24.327516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d12c2c-aa23-418a-8cde-8d3eed98ae33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:24.451365 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-49d12c2c-aa23-418a-8cde-8d3eed98ae33 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:24.456728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-49d12c2c-aa23-418a-8cde-8d3eed98ae33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:24.518524 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:24.694145 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 891/1800] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:24.845754 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303c4ff-bde0-466f-ad2b-30c1b7c30e82 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:24.847888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-3303c4ff-bde0-466f-ad2b-30c1b7c30e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:25.044806 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303c4ff-bde0-466f-ad2b-30c1b7c30e82 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:25.052570 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73c836-dfcb-428e-bf45-06951b3e0adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:25.053844 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73c836-dfcb-428e-bf45-06951b3e0adc service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:25.054878 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73c836-dfcb-428e-bf45-06951b3e0adc service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:25.055390 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73c836-dfcb-428e-bf45-06951b3e0adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:25.108238 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73c836-dfcb-428e-bf45-06951b3e0adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:25.124823 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73c836-dfcb-428e-bf45-06951b3e0adc service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:25.177069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 910/1801] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:45:27.671402 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c6184-4b3b-4030-a8fd-1b7db9d9e088 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:27.674012 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c6184-4b3b-4030-a8fd-1b7db9d9e088 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:27.674536 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c6184-4b3b-4030-a8fd-1b7db9d9e088 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:27.676363 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 892/1802] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 09:45:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:45:27.817200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73c836-dfcb-428e-bf45-06951b3e0adc service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:27.819136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-0d73c836-dfcb-428e-bf45-06951b3e0adc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:27.860909 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73c836-dfcb-428e-bf45-06951b3e0adc service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:27.869550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe93f1e-4a1d-4854-b26c-5e5be3c30cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:27.870465 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe93f1e-4a1d-4854-b26c-5e5be3c30cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:27.870941 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe93f1e-4a1d-4854-b26c-5e5be3c30cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:27.871397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe93f1e-4a1d-4854-b26c-5e5be3c30cc4 admin admin] PATH_INFO: `/v3/users/4855e86db49d46bab5ca9f2b44c48c95` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:27.882829 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe93f1e-4a1d-4854-b26c-5e5be3c30cc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4855e86db49d46bab5ca9f2b44c48c95)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:27.885326 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe93f1e-4a1d-4854-b26c-5e5be3c30cc4 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:28.022833 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-7fe93f1e-4a1d-4854-b26c-5e5be3c30cc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4855e86db49d46bab5ca9f2b44c48c95'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:28.024649 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-7fe93f1e-4a1d-4854-b26c-5e5be3c30cc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4855e86db49d46bab5ca9f2b44c48c95'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:28.064926 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-7fe93f1e-4a1d-4854-b26c-5e5be3c30cc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4855e86db49d46bab5ca9f2b44c48c95'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:28.081884 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-7fe93f1e-4a1d-4854-b26c-5e5be3c30cc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4855e86db49d46bab5ca9f2b44c48c95'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:28.100010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-7fe93f1e-4a1d-4854-b26c-5e5be3c30cc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4855e86db49d46bab5ca9f2b44c48c95'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:28.122713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 911/1803] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:27 2022] DELETE /identity/v3/users/4855e86db49d46bab5ca9f2b44c48c95 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:28.128208 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227482e-3356-46ac-8df8-f7a0f7cf25ca None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:28.128973 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227482e-3356-46ac-8df8-f7a0f7cf25ca None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:28.130313 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227482e-3356-46ac-8df8-f7a0f7cf25ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:28.202188 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-c227482e-3356-46ac-8df8-f7a0f7cf25ca None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:28.203810 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-c227482e-3356-46ac-8df8-f7a0f7cf25ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:28.423262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbef4e-e93f-4fd0-90e2-88168c040ac8 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:28.423555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbef4e-e93f-4fd0-90e2-88168c040ac8 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:28.424108 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbef4e-e93f-4fd0-90e2-88168c040ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:28.453875 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 893/1804] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:28.467120 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-4ccbef4e-e93f-4fd0-90e2-88168c040ac8 None None] MFA Rules not processed for user `18be8c54c9644c5e9812eea09e60c11c`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:28.472769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-4ccbef4e-e93f-4fd0-90e2-88168c040ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:28.509978 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227482e-3356-46ac-8df8-f7a0f7cf25ca None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:28.517725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-c227482e-3356-46ac-8df8-f7a0f7cf25ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:28.559656 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227482e-3356-46ac-8df8-f7a0f7cf25ca None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:28.574804 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49cb358-0db3-4a16-9f36-97d97db28869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:28.575753 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cb358-0db3-4a16-9f36-97d97db28869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:28.578349 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cb358-0db3-4a16-9f36-97d97db28869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:28.578981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cb358-0db3-4a16-9f36-97d97db28869 admin admin] PATH_INFO: `/v3/users/ef6ca30fdbe24b2eb809f578d9a1e323` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:28.582870 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49cb358-0db3-4a16-9f36-97d97db28869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef6ca30fdbe24b2eb809f578d9a1e323)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:28.589883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49cb358-0db3-4a16-9f36-97d97db28869 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:28.590830 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:28.651350 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 912/1805] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 09:45:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:28.654356 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbef4e-e93f-4fd0-90e2-88168c040ac8 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:28.659056 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-4ccbef4e-e93f-4fd0-90e2-88168c040ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:28.757044 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-d49cb358-0db3-4a16-9f36-97d97db28869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef6ca30fdbe24b2eb809f578d9a1e323'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:28.759587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-d49cb358-0db3-4a16-9f36-97d97db28869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef6ca30fdbe24b2eb809f578d9a1e323'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:28.760414 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-d49cb358-0db3-4a16-9f36-97d97db28869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef6ca30fdbe24b2eb809f578d9a1e323'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:28.798071 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-d49cb358-0db3-4a16-9f36-97d97db28869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef6ca30fdbe24b2eb809f578d9a1e323'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:28.816986 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-d49cb358-0db3-4a16-9f36-97d97db28869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef6ca30fdbe24b2eb809f578d9a1e323'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:28.826859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbef4e-e93f-4fd0-90e2-88168c040ac8 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:28.840720 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332011b-eaa7-49a3-8e34-913a013ea0d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:28.842947 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332011b-eaa7-49a3-8e34-913a013ea0d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:28.844987 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332011b-eaa7-49a3-8e34-913a013ea0d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:28.847552 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332011b-eaa7-49a3-8e34-913a013ea0d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:28.851314 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-7332011b-eaa7-49a3-8e34-913a013ea0d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:28.862335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 894/1806] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:28 2022] DELETE /identity/v3/users/ef6ca30fdbe24b2eb809f578d9a1e323 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:45:28.867057 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4ecbb-f972-4416-ba50-cb9afcc6c9de None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:28.867696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4ecbb-f972-4416-ba50-cb9afcc6c9de None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:28.868154 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4ecbb-f972-4416-ba50-cb9afcc6c9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:28.902683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332011b-eaa7-49a3-8e34-913a013ea0d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:28.907251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332011b-eaa7-49a3-8e34-913a013ea0d3 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:28.924511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-00c4ecbb-f972-4416-ba50-cb9afcc6c9de None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:28.927697 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-00c4ecbb-f972-4416-ba50-cb9afcc6c9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:28.930200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 913/1807] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:28.975099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:29.049144 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 895/1808] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:29.091944 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332011b-eaa7-49a3-8e34-913a013ea0d3 service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:29.094459 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-7332011b-eaa7-49a3-8e34-913a013ea0d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:29.131980 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332011b-eaa7-49a3-8e34-913a013ea0d3 service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:29.141066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4ecbb-f972-4416-ba50-cb9afcc6c9de None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:29.142992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-00c4ecbb-f972-4416-ba50-cb9afcc6c9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:29.157157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d59535-437b-4ecd-880c-8d590d459c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:29.158538 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d59535-437b-4ecd-880c-8d590d459c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:29.161545 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d59535-437b-4ecd-880c-8d590d459c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:29.163235 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d59535-437b-4ecd-880c-8d590d459c68 admin admin] PATH_INFO: `/v3/users/dc93d108a22c4cbcace54bba45a2f062` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:29.166033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d59535-437b-4ecd-880c-8d590d459c68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc93d108a22c4cbcace54bba45a2f062)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:29.179546 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d59535-437b-4ecd-880c-8d590d459c68 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:29.277672 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4ecbb-f972-4416-ba50-cb9afcc6c9de None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:29.283211 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581efa6-dc8b-48b3-a1f7-18925c1aefd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:29.283900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581efa6-dc8b-48b3-a1f7-18925c1aefd3 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:29.284189 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581efa6-dc8b-48b3-a1f7-18925c1aefd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:29.284467 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581efa6-dc8b-48b3-a1f7-18925c1aefd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:29.298356 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581efa6-dc8b-48b3-a1f7-18925c1aefd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:29.300787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581efa6-dc8b-48b3-a1f7-18925c1aefd3 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:29.311778 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-43d59535-437b-4ecd-880c-8d590d459c68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc93d108a22c4cbcace54bba45a2f062'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:29.313308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-43d59535-437b-4ecd-880c-8d590d459c68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc93d108a22c4cbcace54bba45a2f062'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:29.314346 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 896/1809] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:45:29.339083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-43d59535-437b-4ecd-880c-8d590d459c68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc93d108a22c4cbcace54bba45a2f062'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:29.351952 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-43d59535-437b-4ecd-880c-8d590d459c68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc93d108a22c4cbcace54bba45a2f062'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:29.370946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-43d59535-437b-4ecd-880c-8d590d459c68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc93d108a22c4cbcace54bba45a2f062'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:29.397700 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 914/1810] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:29 2022] DELETE /identity/v3/users/dc93d108a22c4cbcace54bba45a2f062 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:29.399669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d6fdb-193c-4495-a2eb-ea639713ece3 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:29.400185 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d6fdb-193c-4495-a2eb-ea639713ece3 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:29.400576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d6fdb-193c-4495-a2eb-ea639713ece3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:29.429942 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-e33d6fdb-193c-4495-a2eb-ea639713ece3 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:29.431633 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e33d6fdb-193c-4495-a2eb-ea639713ece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:29.523161 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 897/1811] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:29.561919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d59535-437b-4ecd-880c-8d590d459c68 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:29.563493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-43d59535-437b-4ecd-880c-8d590d459c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:29.615441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d6fdb-193c-4495-a2eb-ea639713ece3 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:29.618135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e33d6fdb-193c-4495-a2eb-ea639713ece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:29.690870 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d59535-437b-4ecd-880c-8d590d459c68 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:29.699263 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b18fef-27e2-46fe-a539-7bf0b79f9c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:29.699587 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b18fef-27e2-46fe-a539-7bf0b79f9c9f service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:29.699844 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b18fef-27e2-46fe-a539-7bf0b79f9c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:29.700392 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b18fef-27e2-46fe-a539-7bf0b79f9c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:29.720075 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:29.723516 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b18fef-27e2-46fe-a539-7bf0b79f9c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:29.726903 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b18fef-27e2-46fe-a539-7bf0b79f9c9f service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:29.745201 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 915/1812] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:29.751915 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d6fdb-193c-4495-a2eb-ea639713ece3 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:29.759792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a306bcd-f9ad-4ee0-b3fe-44755fdcfdcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:29.760533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a306bcd-f9ad-4ee0-b3fe-44755fdcfdcb service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:29.760792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a306bcd-f9ad-4ee0-b3fe-44755fdcfdcb service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:29.760956 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a306bcd-f9ad-4ee0-b3fe-44755fdcfdcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:29.762944 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-5a306bcd-f9ad-4ee0-b3fe-44755fdcfdcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:29.795272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a306bcd-f9ad-4ee0-b3fe-44755fdcfdcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:29.797303 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a306bcd-f9ad-4ee0-b3fe-44755fdcfdcb service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:29.820539 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 898/1813] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:29.894516 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b18fef-27e2-46fe-a539-7bf0b79f9c9f service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:29.896032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-c4b18fef-27e2-46fe-a539-7bf0b79f9c9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:29.928219 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b18fef-27e2-46fe-a539-7bf0b79f9c9f service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:29.942324 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1e408-4593-41b4-8284-bd8c73155510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:29.942988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1e408-4593-41b4-8284-bd8c73155510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:29.943429 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1e408-4593-41b4-8284-bd8c73155510 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:29.943533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1e408-4593-41b4-8284-bd8c73155510 admin admin] PATH_INFO: `/v3/projects/234b14a77f9d4b50ac4b1239eaa6ddc3` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:29.944783 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1e408-4593-41b4-8284-bd8c73155510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=234b14a77f9d4b50ac4b1239eaa6ddc3)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:29.946715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1e408-4593-41b4-8284-bd8c73155510 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:30.018880 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-63b1e408-4593-41b4-8284-bd8c73155510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '234b14a77f9d4b50ac4b1239eaa6ddc3', 'request_id': 'req-63b1e408-4593-41b4-8284-bd8c73155510'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:30.034763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-63b1e408-4593-41b4-8284-bd8c73155510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '234b14a77f9d4b50ac4b1239eaa6ddc3', 'request_id': 'req-63b1e408-4593-41b4-8284-bd8c73155510'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:30.058631 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-63b1e408-4593-41b4-8284-bd8c73155510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '234b14a77f9d4b50ac4b1239eaa6ddc3', 'request_id': 'req-63b1e408-4593-41b4-8284-bd8c73155510'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:30.114374 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-63b1e408-4593-41b4-8284-bd8c73155510 admin admin] The token cache is being invalidate because project 234b14a77f9d4b50ac4b1239eaa6ddc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:30.114777 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-63b1e408-4593-41b4-8284-bd8c73155510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:30.121921 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-63b1e408-4593-41b4-8284-bd8c73155510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:30.136195 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a306bcd-f9ad-4ee0-b3fe-44755fdcfdcb service nova] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:30.136442 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 916/1814] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:29 2022] DELETE /identity/v3/projects/234b14a77f9d4b50ac4b1239eaa6ddc3 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:30.152453 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a306bcd-f9ad-4ee0-b3fe-44755fdcfdcb service nova] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:30.165502 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:30.352405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c36108-1bd1-4aec-a099-12a95c2c19db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:30.353055 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c36108-1bd1-4aec-a099-12a95c2c19db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:30.353337 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c36108-1bd1-4aec-a099-12a95c2c19db admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:30.353650 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c36108-1bd1-4aec-a099-12a95c2c19db admin admin] PATH_INFO: `/v3/users/584ef4d43f89419f986e61bdf931aeb0` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:30.355176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c36108-1bd1-4aec-a099-12a95c2c19db admin admin] RBAC: Authorizing `identity:delete_user(user_id=584ef4d43f89419f986e61bdf931aeb0)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:30.357903 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c36108-1bd1-4aec-a099-12a95c2c19db admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:30.483799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-04c36108-1bd1-4aec-a099-12a95c2c19db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '584ef4d43f89419f986e61bdf931aeb0'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:30.484447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6127a6-737e-4016-9765-1a163ba0df6b None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:30.484908 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-04c36108-1bd1-4aec-a099-12a95c2c19db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '584ef4d43f89419f986e61bdf931aeb0'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:30.485899 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6127a6-737e-4016-9765-1a163ba0df6b None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:30.486343 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6127a6-737e-4016-9765-1a163ba0df6b None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:30.486534 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-04c36108-1bd1-4aec-a099-12a95c2c19db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '584ef4d43f89419f986e61bdf931aeb0'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:30.488532 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 917/1815] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 09:45:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:45:30.512101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-04c36108-1bd1-4aec-a099-12a95c2c19db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '584ef4d43f89419f986e61bdf931aeb0'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:30.526605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-04c36108-1bd1-4aec-a099-12a95c2c19db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '584ef4d43f89419f986e61bdf931aeb0'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:30.534444 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa033b-85c3-4814-8a39-29b3368666f3 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:30.535594 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa033b-85c3-4814-8a39-29b3368666f3 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:30.536155 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa033b-85c3-4814-8a39-29b3368666f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:30.551017 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 899/1816] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:30 2022] DELETE /identity/v3/users/584ef4d43f89419f986e61bdf931aeb0 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:45:30.587955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-65fa033b-85c3-4814-8a39-29b3368666f3 None None] MFA Rules not processed for user `18be8c54c9644c5e9812eea09e60c11c`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:30.589893 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-65fa033b-85c3-4814-8a39-29b3368666f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:30.805684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 918/1817] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 09:45:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:31.315049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c36108-1bd1-4aec-a099-12a95c2c19db admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:31.316543 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-04c36108-1bd1-4aec-a099-12a95c2c19db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:31.343449 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c36108-1bd1-4aec-a099-12a95c2c19db admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:31.351468 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6a860-2da9-43ab-91fb-a3e34696f3ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:31.352339 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6a860-2da9-43ab-91fb-a3e34696f3ad service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:31.352783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6a860-2da9-43ab-91fb-a3e34696f3ad service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:31.353204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6a860-2da9-43ab-91fb-a3e34696f3ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:31.359024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa033b-85c3-4814-8a39-29b3368666f3 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:31.361898 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-65fa033b-85c3-4814-8a39-29b3368666f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:31.398740 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6a860-2da9-43ab-91fb-a3e34696f3ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:31.400847 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6a860-2da9-43ab-91fb-a3e34696f3ad service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:31.447098 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 900/1818] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:31.518219 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6a860-2da9-43ab-91fb-a3e34696f3ad service nova] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:31.519888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-53b6a860-2da9-43ab-91fb-a3e34696f3ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:31.544273 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa033b-85c3-4814-8a39-29b3368666f3 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:31.549206 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6a860-2da9-43ab-91fb-a3e34696f3ad service nova] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:31.552300 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43bf38-6620-4fd1-98fe-fc15a53e2a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:31.553307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43bf38-6620-4fd1-98fe-fc15a53e2a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:31.554141 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43bf38-6620-4fd1-98fe-fc15a53e2a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:31.554564 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43bf38-6620-4fd1-98fe-fc15a53e2a55 admin admin] PATH_INFO: `/v3/projects/e5c9fdae45c14fd6bf7327d25b4e2ba1` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:31.556469 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43bf38-6620-4fd1-98fe-fc15a53e2a55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5c9fdae45c14fd6bf7327d25b4e2ba1)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:31.560218 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43bf38-6620-4fd1-98fe-fc15a53e2a55 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:31.561190 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82978c-8c12-4821-a498-dc8658335ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:31.562047 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82978c-8c12-4821-a498-dc8658335ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:31.562573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82978c-8c12-4821-a498-dc8658335ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:31.563046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82978c-8c12-4821-a498-dc8658335ba3 admin admin] PATH_INFO: `/v3/projects/43bfd00cabba4256a3e955da3eb447f9` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:31.564418 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82978c-8c12-4821-a498-dc8658335ba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43bfd00cabba4256a3e955da3eb447f9)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:31.570052 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82978c-8c12-4821-a498-dc8658335ba3 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:31.593417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:31.663507 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-ac82978c-8c12-4821-a498-dc8658335ba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43bfd00cabba4256a3e955da3eb447f9', 'request_id': 'req-ac82978c-8c12-4821-a498-dc8658335ba3'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:31.665927 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-aa43bf38-6620-4fd1-98fe-fc15a53e2a55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5c9fdae45c14fd6bf7327d25b4e2ba1', 'request_id': 'req-aa43bf38-6620-4fd1-98fe-fc15a53e2a55'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:31.676236 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-ac82978c-8c12-4821-a498-dc8658335ba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43bfd00cabba4256a3e955da3eb447f9', 'request_id': 'req-ac82978c-8c12-4821-a498-dc8658335ba3'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:31.681830 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-aa43bf38-6620-4fd1-98fe-fc15a53e2a55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5c9fdae45c14fd6bf7327d25b4e2ba1', 'request_id': 'req-aa43bf38-6620-4fd1-98fe-fc15a53e2a55'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:31.686470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-ac82978c-8c12-4821-a498-dc8658335ba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43bfd00cabba4256a3e955da3eb447f9', 'request_id': 'req-ac82978c-8c12-4821-a498-dc8658335ba3'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:31.690189 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-aa43bf38-6620-4fd1-98fe-fc15a53e2a55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5c9fdae45c14fd6bf7327d25b4e2ba1', 'request_id': 'req-aa43bf38-6620-4fd1-98fe-fc15a53e2a55'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:31.693358 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:31.710352 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-ac82978c-8c12-4821-a498-dc8658335ba3 admin admin] The token cache is being invalidate because project 43bfd00cabba4256a3e955da3eb447f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:31.710956 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-ac82978c-8c12-4821-a498-dc8658335ba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:31.711947 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-ac82978c-8c12-4821-a498-dc8658335ba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:31.714340 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 901/1819] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:31 2022] DELETE /identity/v3/projects/43bfd00cabba4256a3e955da3eb447f9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:31.715713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-aa43bf38-6620-4fd1-98fe-fc15a53e2a55 admin admin] The token cache is being invalidate because project e5c9fdae45c14fd6bf7327d25b4e2ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:31.716023 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-aa43bf38-6620-4fd1-98fe-fc15a53e2a55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:31.716716 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-aa43bf38-6620-4fd1-98fe-fc15a53e2a55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:31.718198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82978c-8c12-4821-a498-dc8658335ba3 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:31.719864 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ac82978c-8c12-4821-a498-dc8658335ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:31.727609 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 919/1820] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:31 2022] DELETE /identity/v3/projects/e5c9fdae45c14fd6bf7327d25b4e2ba1 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:45:31.728742 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43bf38-6620-4fd1-98fe-fc15a53e2a55 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:31.733841 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-aa43bf38-6620-4fd1-98fe-fc15a53e2a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:31.821622 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82978c-8c12-4821-a498-dc8658335ba3 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:31.901913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43bf38-6620-4fd1-98fe-fc15a53e2a55 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:31.914948 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16679b-73b9-4062-acc4-532f6ab07a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:31.916014 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16679b-73b9-4062-acc4-532f6ab07a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:31.916014 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16679b-73b9-4062-acc4-532f6ab07a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:31.916241 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16679b-73b9-4062-acc4-532f6ab07a54 admin admin] PATH_INFO: `/v3/users/77ca9e3aea5640b293a6c7d2e86d3dea` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:31.919838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16679b-73b9-4062-acc4-532f6ab07a54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77ca9e3aea5640b293a6c7d2e86d3dea)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:31.923003 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16679b-73b9-4062-acc4-532f6ab07a54 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:31.948998 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030bcad-d2c7-4714-8463-7b1dfb5374be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:31.962014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030bcad-d2c7-4714-8463-7b1dfb5374be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:31.963271 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030bcad-d2c7-4714-8463-7b1dfb5374be admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:31.963271 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030bcad-d2c7-4714-8463-7b1dfb5374be admin admin] PATH_INFO: `/v3/users/570a49abd19241f2b378edc40e62c1d1` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:31.967061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030bcad-d2c7-4714-8463-7b1dfb5374be admin admin] RBAC: Authorizing `identity:delete_user(user_id=570a49abd19241f2b378edc40e62c1d1)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:31.970875 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030bcad-d2c7-4714-8463-7b1dfb5374be admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:32.024801 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0c16679b-73b9-4062-acc4-532f6ab07a54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77ca9e3aea5640b293a6c7d2e86d3dea'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.024801 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0c16679b-73b9-4062-acc4-532f6ab07a54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77ca9e3aea5640b293a6c7d2e86d3dea'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.044391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0c16679b-73b9-4062-acc4-532f6ab07a54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77ca9e3aea5640b293a6c7d2e86d3dea'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.053552 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2030bcad-d2c7-4714-8463-7b1dfb5374be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '570a49abd19241f2b378edc40e62c1d1'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.054386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2030bcad-d2c7-4714-8463-7b1dfb5374be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '570a49abd19241f2b378edc40e62c1d1'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.055067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2030bcad-d2c7-4714-8463-7b1dfb5374be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '570a49abd19241f2b378edc40e62c1d1'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.056588 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0c16679b-73b9-4062-acc4-532f6ab07a54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77ca9e3aea5640b293a6c7d2e86d3dea'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.069777 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0c16679b-73b9-4062-acc4-532f6ab07a54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77ca9e3aea5640b293a6c7d2e86d3dea'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.074398 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2030bcad-d2c7-4714-8463-7b1dfb5374be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '570a49abd19241f2b378edc40e62c1d1'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.078868 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 920/1821] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:31 2022] DELETE /identity/v3/users/77ca9e3aea5640b293a6c7d2e86d3dea => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:32.080492 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16679b-73b9-4062-acc4-532f6ab07a54 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:32.083691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-0c16679b-73b9-4062-acc4-532f6ab07a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:32.089504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2030bcad-d2c7-4714-8463-7b1dfb5374be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '570a49abd19241f2b378edc40e62c1d1'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.111121 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 902/1822] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:31 2022] DELETE /identity/v3/users/570a49abd19241f2b378edc40e62c1d1 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:32.112225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030bcad-d2c7-4714-8463-7b1dfb5374be admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:32.114059 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-2030bcad-d2c7-4714-8463-7b1dfb5374be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:32.117763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:32.161378 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:32.210874 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16679b-73b9-4062-acc4-532f6ab07a54 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:32.230768 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030bcad-d2c7-4714-8463-7b1dfb5374be admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:32.237764 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c4714-e319-42e4-a807-ee4ef0fe44d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:32.238412 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c4714-e319-42e4-a807-ee4ef0fe44d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:32.238684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c4714-e319-42e4-a807-ee4ef0fe44d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:32.242393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c4714-e319-42e4-a807-ee4ef0fe44d4 admin admin] PATH_INFO: `/v3/projects/5b616fe1621c46288eb85a97ad71f129` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:32.243498 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c4714-e319-42e4-a807-ee4ef0fe44d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b616fe1621c46288eb85a97ad71f129)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:32.250345 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c4714-e319-42e4-a807-ee4ef0fe44d4 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:32.280230 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2a5a1-6fdd-4f82-9456-d13547a7be13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:32.280870 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2a5a1-6fdd-4f82-9456-d13547a7be13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:32.281958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2a5a1-6fdd-4f82-9456-d13547a7be13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:32.282486 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2a5a1-6fdd-4f82-9456-d13547a7be13 admin admin] PATH_INFO: `/v3/projects/69f33cbe67004d89abb62c3355c7c5e2` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:32.283701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2a5a1-6fdd-4f82-9456-d13547a7be13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69f33cbe67004d89abb62c3355c7c5e2)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:32.285797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2a5a1-6fdd-4f82-9456-d13547a7be13 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:32.319158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-363c4714-e319-42e4-a807-ee4ef0fe44d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b616fe1621c46288eb85a97ad71f129', 'request_id': 'req-363c4714-e319-42e4-a807-ee4ef0fe44d4'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.333639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-363c4714-e319-42e4-a807-ee4ef0fe44d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b616fe1621c46288eb85a97ad71f129', 'request_id': 'req-363c4714-e319-42e4-a807-ee4ef0fe44d4'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.344624 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-363c4714-e319-42e4-a807-ee4ef0fe44d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b616fe1621c46288eb85a97ad71f129', 'request_id': 'req-363c4714-e319-42e4-a807-ee4ef0fe44d4'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.358639 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-41f2a5a1-6fdd-4f82-9456-d13547a7be13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69f33cbe67004d89abb62c3355c7c5e2', 'request_id': 'req-41f2a5a1-6fdd-4f82-9456-d13547a7be13'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.369761 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-363c4714-e319-42e4-a807-ee4ef0fe44d4 admin admin] The token cache is being invalidate because project 5b616fe1621c46288eb85a97ad71f129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:32.370767 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-363c4714-e319-42e4-a807-ee4ef0fe44d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.370958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-41f2a5a1-6fdd-4f82-9456-d13547a7be13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69f33cbe67004d89abb62c3355c7c5e2', 'request_id': 'req-41f2a5a1-6fdd-4f82-9456-d13547a7be13'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.372824 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-363c4714-e319-42e4-a807-ee4ef0fe44d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.375891 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 903/1823] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:32 2022] DELETE /identity/v3/projects/5b616fe1621c46288eb85a97ad71f129 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:32.380664 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae0f4c-bfd5-44c4-80e6-a2c9f2d309d3 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:32.381374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae0f4c-bfd5-44c4-80e6-a2c9f2d309d3 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:32.381925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae0f4c-bfd5-44c4-80e6-a2c9f2d309d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:32.393714 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-41f2a5a1-6fdd-4f82-9456-d13547a7be13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69f33cbe67004d89abb62c3355c7c5e2', 'request_id': 'req-41f2a5a1-6fdd-4f82-9456-d13547a7be13'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.407264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-41f2a5a1-6fdd-4f82-9456-d13547a7be13 admin admin] The token cache is being invalidate because project 69f33cbe67004d89abb62c3355c7c5e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:32.407561 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-41f2a5a1-6fdd-4f82-9456-d13547a7be13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.408745 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-41f2a5a1-6fdd-4f82-9456-d13547a7be13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.410244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 921/1824] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:32 2022] DELETE /identity/v3/projects/69f33cbe67004d89abb62c3355c7c5e2 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:32.414876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-25ae0f4c-bfd5-44c4-80e6-a2c9f2d309d3 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:32.418244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-25ae0f4c-bfd5-44c4-80e6-a2c9f2d309d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:32.425105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2a5a1-6fdd-4f82-9456-d13547a7be13 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:32.432523 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-41f2a5a1-6fdd-4f82-9456-d13547a7be13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:32.528057 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 904/1825] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:32.536859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3122ef-0455-40fb-b421-d132ba14f59c None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:32.537149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3122ef-0455-40fb-b421-d132ba14f59c None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:32.537421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3122ef-0455-40fb-b421-d132ba14f59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:32.557043 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:32.559933 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-7d3122ef-0455-40fb-b421-d132ba14f59c None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:32.561448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7d3122ef-0455-40fb-b421-d132ba14f59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:32.562950 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2a5a1-6fdd-4f82-9456-d13547a7be13 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:32.570953 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118109f6-81b9-43b1-a415-d88f6ae7bb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:32.571749 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118109f6-81b9-43b1-a415-d88f6ae7bb44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:32.572377 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118109f6-81b9-43b1-a415-d88f6ae7bb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:32.572893 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118109f6-81b9-43b1-a415-d88f6ae7bb44 admin admin] PATH_INFO: `/v3/users/1eaf1396134242d4bb7b7cf921333506` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:32.574647 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118109f6-81b9-43b1-a415-d88f6ae7bb44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eaf1396134242d4bb7b7cf921333506)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:32.576928 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118109f6-81b9-43b1-a415-d88f6ae7bb44 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:32.579023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 905/1826] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:32.581029 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3122ef-0455-40fb-b421-d132ba14f59c None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:32.600230 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3122ef-0455-40fb-b421-d132ba14f59c None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:32.614469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95259552-796d-4a00-be65-7b22258491ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:32.615219 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95259552-796d-4a00-be65-7b22258491ce admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:32.615560 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95259552-796d-4a00-be65-7b22258491ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:32.615841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95259552-796d-4a00-be65-7b22258491ce admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:32.616691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95259552-796d-4a00-be65-7b22258491ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:32.616965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95259552-796d-4a00-be65-7b22258491ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:32.619254 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95259552-796d-4a00-be65-7b22258491ce admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:32.632744 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 906/1827] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:32.636832 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95259552-796d-4a00-be65-7b22258491ce admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:32.639207 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-118109f6-81b9-43b1-a415-d88f6ae7bb44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eaf1396134242d4bb7b7cf921333506'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.639898 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-118109f6-81b9-43b1-a415-d88f6ae7bb44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eaf1396134242d4bb7b7cf921333506'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.652935 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95259552-796d-4a00-be65-7b22258491ce admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:32.659846 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-118109f6-81b9-43b1-a415-d88f6ae7bb44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eaf1396134242d4bb7b7cf921333506'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.669735 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-118109f6-81b9-43b1-a415-d88f6ae7bb44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eaf1396134242d4bb7b7cf921333506'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.670096 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44620be3-02cd-41cc-a94c-5a8318d81f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:32.670731 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44620be3-02cd-41cc-a94c-5a8318d81f18 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:32.671041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44620be3-02cd-41cc-a94c-5a8318d81f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:32.671326 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44620be3-02cd-41cc-a94c-5a8318d81f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:32.672016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44620be3-02cd-41cc-a94c-5a8318d81f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:32.684885 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44620be3-02cd-41cc-a94c-5a8318d81f18 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:32.686767 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-118109f6-81b9-43b1-a415-d88f6ae7bb44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eaf1396134242d4bb7b7cf921333506'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.701976 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 922/1828] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:32 2022] DELETE /identity/v3/users/1eaf1396134242d4bb7b7cf921333506 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:32.703775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118109f6-81b9-43b1-a415-d88f6ae7bb44 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:32.705882 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-118109f6-81b9-43b1-a415-d88f6ae7bb44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:32.755629 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 907/1829] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:32 2022] POST /identity/v3/projects => generated 409 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:45:32.758405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44620be3-02cd-41cc-a94c-5a8318d81f18 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:32.761665 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-44620be3-02cd-41cc-a94c-5a8318d81f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:32.780376 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:32.803515 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118109f6-81b9-43b1-a415-d88f6ae7bb44 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:32.867414 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44620be3-02cd-41cc-a94c-5a8318d81f18 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:32.872377 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b69ddc-a37b-4de1-957f-060cbddba28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:32.873182 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b69ddc-a37b-4de1-957f-060cbddba28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:32.873661 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b69ddc-a37b-4de1-957f-060cbddba28d admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:32.873799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b69ddc-a37b-4de1-957f-060cbddba28d admin admin] PATH_INFO: `/v3/projects/f7c1df8e80f7413582cdef5a8cb4fb1a` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:32.881435 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad2a57-39a9-461c-842f-a6ca4471be65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:32.882330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad2a57-39a9-461c-842f-a6ca4471be65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:32.882615 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad2a57-39a9-461c-842f-a6ca4471be65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:32.882963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad2a57-39a9-461c-842f-a6ca4471be65 admin admin] PATH_INFO: `/v3/projects/60ed75b7b135454cb936c200ec8e6a9f` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:32.884591 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad2a57-39a9-461c-842f-a6ca4471be65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ed75b7b135454cb936c200ec8e6a9f)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:32.886659 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad2a57-39a9-461c-842f-a6ca4471be65 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:32.887035 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b69ddc-a37b-4de1-957f-060cbddba28d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7c1df8e80f7413582cdef5a8cb4fb1a)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:32.889746 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b69ddc-a37b-4de1-957f-060cbddba28d admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:32.924041 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:32.950561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-18b69ddc-a37b-4de1-957f-060cbddba28d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7c1df8e80f7413582cdef5a8cb4fb1a', 'request_id': 'req-18b69ddc-a37b-4de1-957f-060cbddba28d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.950746 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1aad2a57-39a9-461c-842f-a6ca4471be65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ed75b7b135454cb936c200ec8e6a9f', 'request_id': 'req-1aad2a57-39a9-461c-842f-a6ca4471be65'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.959565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-18b69ddc-a37b-4de1-957f-060cbddba28d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7c1df8e80f7413582cdef5a8cb4fb1a', 'request_id': 'req-18b69ddc-a37b-4de1-957f-060cbddba28d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.963374 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1aad2a57-39a9-461c-842f-a6ca4471be65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ed75b7b135454cb936c200ec8e6a9f', 'request_id': 'req-1aad2a57-39a9-461c-842f-a6ca4471be65'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.967775 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-18b69ddc-a37b-4de1-957f-060cbddba28d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7c1df8e80f7413582cdef5a8cb4fb1a', 'request_id': 'req-18b69ddc-a37b-4de1-957f-060cbddba28d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.970880 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1aad2a57-39a9-461c-842f-a6ca4471be65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ed75b7b135454cb936c200ec8e6a9f', 'request_id': 'req-1aad2a57-39a9-461c-842f-a6ca4471be65'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.982957 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-18b69ddc-a37b-4de1-957f-060cbddba28d admin admin] The token cache is being invalidate because project f7c1df8e80f7413582cdef5a8cb4fb1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:32.983254 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-18b69ddc-a37b-4de1-957f-060cbddba28d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.983638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1aad2a57-39a9-461c-842f-a6ca4471be65 admin admin] The token cache is being invalidate because project 60ed75b7b135454cb936c200ec8e6a9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:32.983917 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-18b69ddc-a37b-4de1-957f-060cbddba28d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.984068 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1aad2a57-39a9-461c-842f-a6ca4471be65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.984629 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1aad2a57-39a9-461c-842f-a6ca4471be65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:32.986202 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 923/1830] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:32 2022] DELETE /identity/v3/projects/60ed75b7b135454cb936c200ec8e6a9f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:32.989826 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad2a57-39a9-461c-842f-a6ca4471be65 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:32.990012 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 908/1831] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:32 2022] DELETE /identity/v3/projects/f7c1df8e80f7413582cdef5a8cb4fb1a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:32.991328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd48f70-2e58-44e4-b4fe-929cd807b09d None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:32.991630 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd48f70-2e58-44e4-b4fe-929cd807b09d None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:32.991739 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-1aad2a57-39a9-461c-842f-a6ca4471be65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:32.991936 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd48f70-2e58-44e4-b4fe-929cd807b09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:33.018093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-dcd48f70-2e58-44e4-b4fe-929cd807b09d None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:33.019357 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-dcd48f70-2e58-44e4-b4fe-929cd807b09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:33.115201 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad2a57-39a9-461c-842f-a6ca4471be65 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:33.122082 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda6574-0f1d-4ae8-b2bc-2c262b189b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:33.122921 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda6574-0f1d-4ae8-b2bc-2c262b189b9a admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:33.123369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda6574-0f1d-4ae8-b2bc-2c262b189b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:33.123782 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda6574-0f1d-4ae8-b2bc-2c262b189b9a admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:33.124610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda6574-0f1d-4ae8-b2bc-2c262b189b9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:33.133165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda6574-0f1d-4ae8-b2bc-2c262b189b9a admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:33.133936 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 909/1832] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:33.136042 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b05b9-753e-470e-bf04-daac6019d6a1 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:33.136557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b05b9-753e-470e-bf04-daac6019d6a1 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:33.137007 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b05b9-753e-470e-bf04-daac6019d6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:33.164117 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 924/1833] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:32 2022] POST /identity/v3/users => generated 305 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:33.164387 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-7f4b05b9-753e-470e-bf04-daac6019d6a1 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:33.166162 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7f4b05b9-753e-470e-bf04-daac6019d6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:33.168244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda6574-0f1d-4ae8-b2bc-2c262b189b9a admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:33.170099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-9cda6574-0f1d-4ae8-b2bc-2c262b189b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:33.177939 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 910/1834] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:33.179354 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8c148-af02-4101-859b-68c94181e1f3 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:33.179900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8c148-af02-4101-859b-68c94181e1f3 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:33.180082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8c148-af02-4101-859b-68c94181e1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:33.192249 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda6574-0f1d-4ae8-b2bc-2c262b189b9a admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:33.199810 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bc162-db0f-43e8-8bae-bf02353f1470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:33.200649 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bc162-db0f-43e8-8bae-bf02353f1470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:33.201583 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bc162-db0f-43e8-8bae-bf02353f1470 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:33.202024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bc162-db0f-43e8-8bae-bf02353f1470 admin admin] PATH_INFO: `/v3/projects/c82b682b46f74ee397d74aa68f4637aa` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:33.205040 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bc162-db0f-43e8-8bae-bf02353f1470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c82b682b46f74ee397d74aa68f4637aa)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:33.207900 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bc162-db0f-43e8-8bae-bf02353f1470 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:33.211044 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-d3b8c148-af02-4101-859b-68c94181e1f3 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:33.212373 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-d3b8c148-af02-4101-859b-68c94181e1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:33.231197 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 911/1835] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:33.232252 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8c148-af02-4101-859b-68c94181e1f3 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:33.245215 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8c148-af02-4101-859b-68c94181e1f3 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:33.251545 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f561d5-b893-4eaa-99f4-a156a1e4a147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:33.252401 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f561d5-b893-4eaa-99f4-a156a1e4a147 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:33.252845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f561d5-b893-4eaa-99f4-a156a1e4a147 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:33.252991 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f561d5-b893-4eaa-99f4-a156a1e4a147 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:33.253621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f561d5-b893-4eaa-99f4-a156a1e4a147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:33.255241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f561d5-b893-4eaa-99f4-a156a1e4a147 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:33.273439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 912/1836] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:33.273439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5952f4-7846-490f-9b43-a0f1f174d7ca None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:33.273439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5952f4-7846-490f-9b43-a0f1f174d7ca None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:33.273439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5952f4-7846-490f-9b43-a0f1f174d7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:33.282474 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-960bc162-db0f-43e8-8bae-bf02353f1470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c82b682b46f74ee397d74aa68f4637aa', 'request_id': 'req-960bc162-db0f-43e8-8bae-bf02353f1470'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:33.291561 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-960bc162-db0f-43e8-8bae-bf02353f1470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c82b682b46f74ee397d74aa68f4637aa', 'request_id': 'req-960bc162-db0f-43e8-8bae-bf02353f1470'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:33.294974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-2e5952f4-7846-490f-9b43-a0f1f174d7ca None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:33.296288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-2e5952f4-7846-490f-9b43-a0f1f174d7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:33.300774 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-960bc162-db0f-43e8-8bae-bf02353f1470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c82b682b46f74ee397d74aa68f4637aa', 'request_id': 'req-960bc162-db0f-43e8-8bae-bf02353f1470'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:33.311507 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:33.313957 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-960bc162-db0f-43e8-8bae-bf02353f1470 admin admin] The token cache is being invalidate because project c82b682b46f74ee397d74aa68f4637aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:33.314283 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-960bc162-db0f-43e8-8bae-bf02353f1470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:33.314963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-960bc162-db0f-43e8-8bae-bf02353f1470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:33.316845 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 925/1837] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:33 2022] DELETE /identity/v3/projects/c82b682b46f74ee397d74aa68f4637aa => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:33.317678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bc162-db0f-43e8-8bae-bf02353f1470 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:33.319225 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-960bc162-db0f-43e8-8bae-bf02353f1470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:33.356571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:DELETE=13,keystone:SELECT=82,keystone:INSERT=5 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:33.369833 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 913/1838] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:33.370717 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5952f4-7846-490f-9b43-a0f1f174d7ca None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:33.372050 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-2e5952f4-7846-490f-9b43-a0f1f174d7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:33.384874 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5952f4-7846-490f-9b43-a0f1f174d7ca None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:33.389782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5237ea-9781-4e5e-b892-b30d5fe037a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:33.390556 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5237ea-9781-4e5e-b892-b30d5fe037a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:33.390840 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5237ea-9781-4e5e-b892-b30d5fe037a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:33.391118 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5237ea-9781-4e5e-b892-b30d5fe037a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:33.391770 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5237ea-9781-4e5e-b892-b30d5fe037a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:33.393748 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5237ea-9781-4e5e-b892-b30d5fe037a3 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:33.406927 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 914/1839] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:33.408550 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ec1ff-8340-4716-84b6-4278849051a0 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:33.408842 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ec1ff-8340-4716-84b6-4278849051a0 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:33.409170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ec1ff-8340-4716-84b6-4278849051a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:33.416253 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bc162-db0f-43e8-8bae-bf02353f1470 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:33.421066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07a879-aa79-47c0-bc9a-16a3c949d0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:33.422432 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07a879-aa79-47c0-bc9a-16a3c949d0ed admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:33.422848 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07a879-aa79-47c0-bc9a-16a3c949d0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:33.423175 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07a879-aa79-47c0-bc9a-16a3c949d0ed admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:33.423897 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07a879-aa79-47c0-bc9a-16a3c949d0ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:33.424291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07a879-aa79-47c0-bc9a-16a3c949d0ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:33.425999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07a879-aa79-47c0-bc9a-16a3c949d0ed admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:33.430063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-406ec1ff-8340-4716-84b6-4278849051a0 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:33.431274 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-406ec1ff-8340-4716-84b6-4278849051a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:33.438661 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 926/1840] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:33.439550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07a879-aa79-47c0-bc9a-16a3c949d0ed admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:33.442472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 915/1841] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:33.442472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ec1ff-8340-4716-84b6-4278849051a0 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:33.451602 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ec1ff-8340-4716-84b6-4278849051a0 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:33.451739 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07a879-aa79-47c0-bc9a-16a3c949d0ed admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:33.456522 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175864c-8357-48f8-b357-1413ef25470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:33.456923 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3fabe-c401-4ab4-9b67-4fd0baba2079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:33.457121 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175864c-8357-48f8-b357-1413ef25470c admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:33.457402 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175864c-8357-48f8-b357-1413ef25470c admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:33.457601 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3fabe-c401-4ab4-9b67-4fd0baba2079 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:33.457737 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175864c-8357-48f8-b357-1413ef25470c admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:33.457883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3fabe-c401-4ab4-9b67-4fd0baba2079 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:33.458164 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3fabe-c401-4ab4-9b67-4fd0baba2079 admin admin] PATH_INFO: `/v3/projects/bf714770cb01440aaa5c6b5017a7b635/users/bbcb171f5fcf47e3984fff5d6cf77fc3/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:33.458370 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175864c-8357-48f8-b357-1413ef25470c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:33.458672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175864c-8357-48f8-b357-1413ef25470c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:33.460259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175864c-8357-48f8-b357-1413ef25470c admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:33.476913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 927/1842] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:33.477079 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3fabe-c401-4ab4-9b67-4fd0baba2079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf714770cb01440aaa5c6b5017a7b635, user_id=bbcb171f5fcf47e3984fff5d6cf77fc3, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:33.477178 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175864c-8357-48f8-b357-1413ef25470c admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:33.477258 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3fabe-c401-4ab4-9b67-4fd0baba2079 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:33.484772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175864c-8357-48f8-b357-1413ef25470c admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:33.494627 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 916/1843] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:33 2022] PUT /identity/v3/projects/bf714770cb01440aaa5c6b5017a7b635/users/bbcb171f5fcf47e3984fff5d6cf77fc3/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:33.495893 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f466461-7628-4543-835b-2546f06d4486 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:33.496169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f466461-7628-4543-835b-2546f06d4486 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:33.496442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f466461-7628-4543-835b-2546f06d4486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:33.517928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-9f466461-7628-4543-835b-2546f06d4486 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:33.519207 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-9f466461-7628-4543-835b-2546f06d4486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:33.569524 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca087d4b-03b5-4c07-a3e8-84c1f6c1a788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:33.570145 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca087d4b-03b5-4c07-a3e8-84c1f6c1a788 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:33.570755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca087d4b-03b5-4c07-a3e8-84c1f6c1a788 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:33.571039 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca087d4b-03b5-4c07-a3e8-84c1f6c1a788 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:33.571671 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca087d4b-03b5-4c07-a3e8-84c1f6c1a788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:33.573894 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca087d4b-03b5-4c07-a3e8-84c1f6c1a788 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:33.589244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 917/1844] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:33.590319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f466461-7628-4543-835b-2546f06d4486 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:33.601034 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f466461-7628-4543-835b-2546f06d4486 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:33.611396 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 928/1845] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:33 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:33.611578 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2cd0f-e6bf-4ed0-a6ae-a2193c736429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:33.611578 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2cd0f-e6bf-4ed0-a6ae-a2193c736429 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:33.611578 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2cd0f-e6bf-4ed0-a6ae-a2193c736429 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:33.611847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07bb3e-525c-4d5d-bf13-d7a108fa7228 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:33.611847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07bb3e-525c-4d5d-bf13-d7a108fa7228 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:33.612015 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07bb3e-525c-4d5d-bf13-d7a108fa7228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:33.613603 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2cd0f-e6bf-4ed0-a6ae-a2193c736429 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:33.614971 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2cd0f-e6bf-4ed0-a6ae-a2193c736429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:33.617457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2cd0f-e6bf-4ed0-a6ae-a2193c736429 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:33.643913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-df07bb3e-525c-4d5d-bf13-d7a108fa7228 None None] MFA Rules not processed for user `bbcb171f5fcf47e3984fff5d6cf77fc3`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:33.645307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-df07bb3e-525c-4d5d-bf13-d7a108fa7228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:33.681231 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 918/1846] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:33 2022] POST /identity/v3/projects => generated 365 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:33.681231 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2cd0f-e6bf-4ed0-a6ae-a2193c736429 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:33.751301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 929/1847] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:33 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:33.752163 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07bb3e-525c-4d5d-bf13-d7a108fa7228 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:33.767283 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:33.778930 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2cd0f-e6bf-4ed0-a6ae-a2193c736429 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:33.786295 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04305084-2223-4f5d-8d29-1bf312380684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:33.787251 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04305084-2223-4f5d-8d29-1bf312380684 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:33.787608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04305084-2223-4f5d-8d29-1bf312380684 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:33.787956 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04305084-2223-4f5d-8d29-1bf312380684 admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:33.788982 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04305084-2223-4f5d-8d29-1bf312380684 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:33.789301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04305084-2223-4f5d-8d29-1bf312380684 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:33.790033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:33.792433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04305084-2223-4f5d-8d29-1bf312380684 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:33.814848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 919/1848] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:33.815994 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04305084-2223-4f5d-8d29-1bf312380684 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:33.834551 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04305084-2223-4f5d-8d29-1bf312380684 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:33.839833 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dcc3b-870a-4293-b8b6-5eec25335413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:33.840459 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dcc3b-870a-4293-b8b6-5eec25335413 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:33.840742 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dcc3b-870a-4293-b8b6-5eec25335413 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:33.841366 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dcc3b-870a-4293-b8b6-5eec25335413 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:33.842044 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dcc3b-870a-4293-b8b6-5eec25335413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:33.844533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dcc3b-870a-4293-b8b6-5eec25335413 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:33.852133 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07bb3e-525c-4d5d-bf13-d7a108fa7228 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:33.860134 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba093a17-0250-48ab-8e33-665bbe681ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:33.861751 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba093a17-0250-48ab-8e33-665bbe681ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:33.862512 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba093a17-0250-48ab-8e33-665bbe681ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:33.862512 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba093a17-0250-48ab-8e33-665bbe681ab6 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:33.863667 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba093a17-0250-48ab-8e33-665bbe681ab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:33.866157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba093a17-0250-48ab-8e33-665bbe681ab6 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:33.873818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 920/1849] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:33 2022] POST /identity/v3/users => generated 283 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:33.879028 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dcc3b-870a-4293-b8b6-5eec25335413 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:33.895185 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dcc3b-870a-4293-b8b6-5eec25335413 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:33.899425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 930/1850] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:33 2022] POST /identity/v3/users => generated 284 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:33.900318 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba093a17-0250-48ab-8e33-665bbe681ab6 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:33.908044 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0382031-0018-4390-b952-a25bd20f99a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:33.908679 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0382031-0018-4390-b952-a25bd20f99a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:33.908957 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0382031-0018-4390-b952-a25bd20f99a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:33.909229 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0382031-0018-4390-b952-a25bd20f99a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:33.910077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0382031-0018-4390-b952-a25bd20f99a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:33.912053 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0382031-0018-4390-b952-a25bd20f99a6 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:33.912830 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba093a17-0250-48ab-8e33-665bbe681ab6 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:33.920529 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464dd707-1d82-40ca-ba6e-46b8da6d281a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:33.921170 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dd707-1d82-40ca-ba6e-46b8da6d281a admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:33.921803 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dd707-1d82-40ca-ba6e-46b8da6d281a admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:33.922137 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dd707-1d82-40ca-ba6e-46b8da6d281a admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:33.922941 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464dd707-1d82-40ca-ba6e-46b8da6d281a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:33.928034 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464dd707-1d82-40ca-ba6e-46b8da6d281a admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:33.953139 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 921/1851] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:33 2022] POST /identity/v3/projects => generated 409 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:33.953139 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0382031-0018-4390-b952-a25bd20f99a6 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:33.975093 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 931/1852] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:33 2022] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:33.975971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464dd707-1d82-40ca-ba6e-46b8da6d281a admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:34.043574 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0382031-0018-4390-b952-a25bd20f99a6 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:34.077037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464dd707-1d82-40ca-ba6e-46b8da6d281a admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:34.086357 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cd829-1b0d-4195-849a-97233c94fa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:34.087008 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cd829-1b0d-4195-849a-97233c94fa1f admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:34.088055 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cd829-1b0d-4195-849a-97233c94fa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:34.088340 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cd829-1b0d-4195-849a-97233c94fa1f admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:34.089018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cd829-1b0d-4195-849a-97233c94fa1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:34.091063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cd829-1b0d-4195-849a-97233c94fa1f admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:34.103684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 932/1853] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:34.104797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cd829-1b0d-4195-849a-97233c94fa1f admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:34.116607 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cd829-1b0d-4195-849a-97233c94fa1f admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:34.126653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475d5ea-aead-4577-ad0a-b3485d5f7995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:34.128166 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475d5ea-aead-4577-ad0a-b3485d5f7995 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:34.128514 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475d5ea-aead-4577-ad0a-b3485d5f7995 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:34.128734 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475d5ea-aead-4577-ad0a-b3485d5f7995 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:34.129358 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475d5ea-aead-4577-ad0a-b3485d5f7995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:34.133676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475d5ea-aead-4577-ad0a-b3485d5f7995 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:34.158347 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ac630-5c61-4584-80dc-bbb3f5456dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:34.159130 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ac630-5c61-4584-80dc-bbb3f5456dff admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:34.159448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ac630-5c61-4584-80dc-bbb3f5456dff admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:34.159883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ac630-5c61-4584-80dc-bbb3f5456dff admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:34.160773 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ac630-5c61-4584-80dc-bbb3f5456dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:34.163147 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ac630-5c61-4584-80dc-bbb3f5456dff admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:34.172481 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 933/1854] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:34 2022] POST /identity/v3/users => generated 311 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:34.172481 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475d5ea-aead-4577-ad0a-b3485d5f7995 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:34.177083 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 922/1855] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:34.177083 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ac630-5c61-4584-80dc-bbb3f5456dff admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:34.181212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475d5ea-aead-4577-ad0a-b3485d5f7995 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:34.186443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1dd2f7-0c7f-4cfe-9d56-714d54609fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:34.187052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dd2f7-0c7f-4cfe-9d56-714d54609fbd admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:34.187450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ac630-5c61-4584-80dc-bbb3f5456dff admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:34.187557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dd2f7-0c7f-4cfe-9d56-714d54609fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:34.187744 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dd2f7-0c7f-4cfe-9d56-714d54609fbd admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:34.188898 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1dd2f7-0c7f-4cfe-9d56-714d54609fbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:34.190550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1dd2f7-0c7f-4cfe-9d56-714d54609fbd admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:34.193604 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f714148-ff53-4000-ac2b-3910f1250cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:34.194203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f714148-ff53-4000-ac2b-3910f1250cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:34.194536 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f714148-ff53-4000-ac2b-3910f1250cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:34.194817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f714148-ff53-4000-ac2b-3910f1250cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:34.196037 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f714148-ff53-4000-ac2b-3910f1250cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:34.197122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f714148-ff53-4000-ac2b-3910f1250cc7 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:34.210034 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 923/1856] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:34.213791 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f714148-ff53-4000-ac2b-3910f1250cc7 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:34.216662 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 934/1857] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:34 2022] POST /identity/v3/users => generated 291 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:34.217539 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1dd2f7-0c7f-4cfe-9d56-714d54609fbd admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:34.226978 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f714148-ff53-4000-ac2b-3910f1250cc7 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:34.231898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff487c36-1d97-4c97-93ee-89fc7da993ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:34.232509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff487c36-1d97-4c97-93ee-89fc7da993ef admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:34.232789 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff487c36-1d97-4c97-93ee-89fc7da993ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:34.233064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff487c36-1d97-4c97-93ee-89fc7da993ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:34.233740 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff487c36-1d97-4c97-93ee-89fc7da993ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:34.234754 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1dd2f7-0c7f-4cfe-9d56-714d54609fbd admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:34.235613 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff487c36-1d97-4c97-93ee-89fc7da993ef admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:34.246522 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830b74e-9fd0-419b-9638-bbcd40aad6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:34.247142 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830b74e-9fd0-419b-9638-bbcd40aad6bd admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:34.247417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830b74e-9fd0-419b-9638-bbcd40aad6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:34.247688 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830b74e-9fd0-419b-9638-bbcd40aad6bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:34.251346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830b74e-9fd0-419b-9638-bbcd40aad6bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:34.251504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 924/1858] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:34.251504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff487c36-1d97-4c97-93ee-89fc7da993ef admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:34.251669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830b74e-9fd0-419b-9638-bbcd40aad6bd admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:34.265083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 935/1859] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:34.265083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830b74e-9fd0-419b-9638-bbcd40aad6bd admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:34.268535 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff487c36-1d97-4c97-93ee-89fc7da993ef admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:34.274349 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830b74e-9fd0-419b-9638-bbcd40aad6bd admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:34.275241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de2e8c-a46a-42fd-8b57-cd5b24aa0129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:34.275929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de2e8c-a46a-42fd-8b57-cd5b24aa0129 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:34.276199 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de2e8c-a46a-42fd-8b57-cd5b24aa0129 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:34.276477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de2e8c-a46a-42fd-8b57-cd5b24aa0129 admin admin] PATH_INFO: `/v3/projects/77f0cb5a9e6d45b49aa087a0bc520533/users/0d87922549164e34802891cde258bcff/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:34.280049 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e8c53-a764-4387-9306-5ee6856e571f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:34.280822 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e8c53-a764-4387-9306-5ee6856e571f admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:34.281912 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e8c53-a764-4387-9306-5ee6856e571f admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:34.282345 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e8c53-a764-4387-9306-5ee6856e571f admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:34.283215 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e8c53-a764-4387-9306-5ee6856e571f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:34.284808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e8c53-a764-4387-9306-5ee6856e571f admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:34.296238 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 936/1860] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:34.299010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e8c53-a764-4387-9306-5ee6856e571f admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:34.300999 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de2e8c-a46a-42fd-8b57-cd5b24aa0129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77f0cb5a9e6d45b49aa087a0bc520533, user_id=0d87922549164e34802891cde258bcff, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:34.304028 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de2e8c-a46a-42fd-8b57-cd5b24aa0129 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:34.310322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e8c53-a764-4387-9306-5ee6856e571f admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:34.315894 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6e8ca-ebd1-474d-8d7d-e16a8cea80bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:34.316550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6e8ca-ebd1-474d-8d7d-e16a8cea80bb admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:34.316900 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6e8ca-ebd1-474d-8d7d-e16a8cea80bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:34.317177 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6e8ca-ebd1-474d-8d7d-e16a8cea80bb admin admin] PATH_INFO: `/v3/projects/bc35c343cd6f42aeb1ed3d937eb42a4a/users/b73f58c24c254d69b414f5e88b31afde/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:34.322426 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 925/1861] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:34 2022] PUT /identity/v3/projects/77f0cb5a9e6d45b49aa087a0bc520533/users/0d87922549164e34802891cde258bcff/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:34.323612 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de2e8c-a46a-42fd-8b57-cd5b24aa0129 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:34.341511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6e8ca-ebd1-474d-8d7d-e16a8cea80bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc35c343cd6f42aeb1ed3d937eb42a4a, user_id=b73f58c24c254d69b414f5e88b31afde, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:34.344082 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6e8ca-ebd1-474d-8d7d-e16a8cea80bb admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:34.349368 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:34.366548 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 937/1862] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:34 2022] PUT /identity/v3/projects/bc35c343cd6f42aeb1ed3d937eb42a4a/users/b73f58c24c254d69b414f5e88b31afde/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:34.367641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6e8ca-ebd1-474d-8d7d-e16a8cea80bb admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:34.375009 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:34.445124 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de2e8c-a46a-42fd-8b57-cd5b24aa0129 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:34.490522 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6e8ca-ebd1-474d-8d7d-e16a8cea80bb admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:34.495569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa76e5-c9de-4df5-a2b5-54b1edef5d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:34.496296 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa76e5-c9de-4df5-a2b5-54b1edef5d4b admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:34.496582 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa76e5-c9de-4df5-a2b5-54b1edef5d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:34.496857 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa76e5-c9de-4df5-a2b5-54b1edef5d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:34.497737 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa76e5-c9de-4df5-a2b5-54b1edef5d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:34.499765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa76e5-c9de-4df5-a2b5-54b1edef5d4b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:34.510543 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 938/1863] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:34.511815 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94b7ff-89d0-4572-a16c-5fd962f2d4f0 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:34.512112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94b7ff-89d0-4572-a16c-5fd962f2d4f0 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:34.512645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94b7ff-89d0-4572-a16c-5fd962f2d4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:34.541613 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459171e-40b8-4fb1-82aa-8e6d908b6300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:34.542628 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459171e-40b8-4fb1-82aa-8e6d908b6300 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:34.542772 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459171e-40b8-4fb1-82aa-8e6d908b6300 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:34.543024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459171e-40b8-4fb1-82aa-8e6d908b6300 admin admin] PATH_INFO: `/v3/projects/bbedcde7fcb347ecbced0efe722d1e68/users/7ec38333535b4f02b46c4fb62d81ebb6/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:34.546352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-5a94b7ff-89d0-4572-a16c-5fd962f2d4f0 None None] MFA Rules not processed for user `0d87922549164e34802891cde258bcff`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:34.548626 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-5a94b7ff-89d0-4572-a16c-5fd962f2d4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:34.559842 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459171e-40b8-4fb1-82aa-8e6d908b6300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbedcde7fcb347ecbced0efe722d1e68, user_id=7ec38333535b4f02b46c4fb62d81ebb6, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:34.563593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459171e-40b8-4fb1-82aa-8e6d908b6300 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:34.582508 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 926/1864] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:34 2022] PUT /identity/v3/projects/bbedcde7fcb347ecbced0efe722d1e68/users/7ec38333535b4f02b46c4fb62d81ebb6/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:34.590852 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459171e-40b8-4fb1-82aa-8e6d908b6300 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:34.641741 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 939/1865] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:34.642886 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94b7ff-89d0-4572-a16c-5fd962f2d4f0 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:34.654861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94b7ff-89d0-4572-a16c-5fd962f2d4f0 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:34.660403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9eae13-b343-424b-ad90-ea824149f763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:34.661222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9eae13-b343-424b-ad90-ea824149f763 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:34.661419 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9eae13-b343-424b-ad90-ea824149f763 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:34.662090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9eae13-b343-424b-ad90-ea824149f763 admin admin] PATH_INFO: `/v3/projects/bc7c4156b8cf4805a3746f52fe7198f8/users/eac069ee966e48f3a75d8d511a4d26a5/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:34.664685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459171e-40b8-4fb1-82aa-8e6d908b6300 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:34.671038 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f9d50-b2ed-4b0f-a078-4caa3324bf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:34.672033 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f9d50-b2ed-4b0f-a078-4caa3324bf24 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:34.672317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f9d50-b2ed-4b0f-a078-4caa3324bf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:34.672578 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f9d50-b2ed-4b0f-a078-4caa3324bf24 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:34.673285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f9d50-b2ed-4b0f-a078-4caa3324bf24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:34.674929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f9d50-b2ed-4b0f-a078-4caa3324bf24 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:34.678667 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9eae13-b343-424b-ad90-ea824149f763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc7c4156b8cf4805a3746f52fe7198f8, user_id=eac069ee966e48f3a75d8d511a4d26a5, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:34.681413 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9eae13-b343-424b-ad90-ea824149f763 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:34.689629 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 927/1866] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:34.691262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aab6f0-bb41-4faf-a26d-909b87cfac62 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:34.691607 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aab6f0-bb41-4faf-a26d-909b87cfac62 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:34.691878 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aab6f0-bb41-4faf-a26d-909b87cfac62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:34.701063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 940/1867] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:34 2022] PUT /identity/v3/projects/bc7c4156b8cf4805a3746f52fe7198f8/users/eac069ee966e48f3a75d8d511a4d26a5/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:34.702287 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9eae13-b343-424b-ad90-ea824149f763 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:34.751926 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-67aab6f0-bb41-4faf-a26d-909b87cfac62 None None] MFA Rules not processed for user `7ec38333535b4f02b46c4fb62d81ebb6`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:34.753986 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-67aab6f0-bb41-4faf-a26d-909b87cfac62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:34.786907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:34.802960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9eae13-b343-424b-ad90-ea824149f763 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:34.810168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bec61-8028-45bd-96b2-62bc8098689f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:34.811283 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bec61-8028-45bd-96b2-62bc8098689f admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:34.811626 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bec61-8028-45bd-96b2-62bc8098689f admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:34.812643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bec61-8028-45bd-96b2-62bc8098689f admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:34.813614 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bec61-8028-45bd-96b2-62bc8098689f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:34.816109 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bec61-8028-45bd-96b2-62bc8098689f admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:34.834180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:34.849111 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 928/1868] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:34.851815 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aab6f0-bb41-4faf-a26d-909b87cfac62 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:34.860399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 941/1869] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:34 2022] POST /identity/v3/projects => generated 367 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:34.862722 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa213abe-ab15-4863-8395-ad15c0484b88 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:34.863435 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa213abe-ab15-4863-8395-ad15c0484b88 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:34.864480 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa213abe-ab15-4863-8395-ad15c0484b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:34.865546 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aab6f0-bb41-4faf-a26d-909b87cfac62 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:34.900296 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-fa213abe-ab15-4863-8395-ad15c0484b88 None None] MFA Rules not processed for user `eac069ee966e48f3a75d8d511a4d26a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:34.901972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-fa213abe-ab15-4863-8395-ad15c0484b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:34.934815 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633e353-ee98-4194-a3a8-17327ee3ee4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:34.935523 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633e353-ee98-4194-a3a8-17327ee3ee4c admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:34.935808 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633e353-ee98-4194-a3a8-17327ee3ee4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:34.936131 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633e353-ee98-4194-a3a8-17327ee3ee4c admin admin] PATH_INFO: `/v3/projects/bc35c343cd6f42aeb1ed3d937eb42a4a/users/b73f58c24c254d69b414f5e88b31afde/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:34.938835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633e353-ee98-4194-a3a8-17327ee3ee4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc35c343cd6f42aeb1ed3d937eb42a4a, user_id=b73f58c24c254d69b414f5e88b31afde, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:34.941504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633e353-ee98-4194-a3a8-17327ee3ee4c admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:34.952268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 929/1870] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:34 2022] PUT /identity/v3/projects/bc35c343cd6f42aeb1ed3d937eb42a4a/users/b73f58c24c254d69b414f5e88b31afde/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:34.953008 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633e353-ee98-4194-a3a8-17327ee3ee4c admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:34.976305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 942/1871] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:34.977200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa213abe-ab15-4863-8395-ad15c0484b88 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:34.988738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa213abe-ab15-4863-8395-ad15c0484b88 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:35.018447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633e353-ee98-4194-a3a8-17327ee3ee4c admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:35.023118 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f1530-fb90-40bf-a1e2-5130cc9fe562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:35.023714 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f1530-fb90-40bf-a1e2-5130cc9fe562 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:35.023997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f1530-fb90-40bf-a1e2-5130cc9fe562 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:35.024271 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f1530-fb90-40bf-a1e2-5130cc9fe562 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:35.024921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f1530-fb90-40bf-a1e2-5130cc9fe562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:35.026849 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f1530-fb90-40bf-a1e2-5130cc9fe562 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:35.045253 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ac07d-f602-43d3-a6b4-5045bc3c7018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:35.046032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ac07d-f602-43d3-a6b4-5045bc3c7018 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:35.046956 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ac07d-f602-43d3-a6b4-5045bc3c7018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:35.047339 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ac07d-f602-43d3-a6b4-5045bc3c7018 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:35.047918 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ac07d-f602-43d3-a6b4-5045bc3c7018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:35.050024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ac07d-f602-43d3-a6b4-5045bc3c7018 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:35.058279 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 930/1872] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:34 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:35.058279 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340ae00-bfb7-44ce-9033-a8b144b857f4 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:35.058279 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340ae00-bfb7-44ce-9033-a8b144b857f4 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:35.058279 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340ae00-bfb7-44ce-9033-a8b144b857f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:35.072248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 943/1873] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:34 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:35.073347 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ac07d-f602-43d3-a6b4-5045bc3c7018 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:35.083168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ac07d-f602-43d3-a6b4-5045bc3c7018 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:35.088274 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-d340ae00-bfb7-44ce-9033-a8b144b857f4 None None] MFA Rules not processed for user `b73f58c24c254d69b414f5e88b31afde`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:35.089508 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-d340ae00-bfb7-44ce-9033-a8b144b857f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:35.119857 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:35.141267 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8749b-1e8e-407a-91f1-690ac17f2ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:35.141918 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8749b-1e8e-407a-91f1-690ac17f2ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:35.142199 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8749b-1e8e-407a-91f1-690ac17f2ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:35.142471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8749b-1e8e-407a-91f1-690ac17f2ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:35.143098 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8749b-1e8e-407a-91f1-690ac17f2ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:35.144984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8749b-1e8e-407a-91f1-690ac17f2ca7 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:35.161735 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:35.162525 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 931/1874] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:35 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:35.173130 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340ae00-bfb7-44ce-9033-a8b144b857f4 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:35.180692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 944/1875] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:35 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:35.180692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8749b-1e8e-407a-91f1-690ac17f2ca7 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:35.187844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340ae00-bfb7-44ce-9033-a8b144b857f4 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:35.260788 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8749b-1e8e-407a-91f1-690ac17f2ca7 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:35.263242 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fd0f2-b205-492e-9c1b-821fa59a2926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:35.263860 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fd0f2-b205-492e-9c1b-821fa59a2926 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:35.264143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fd0f2-b205-492e-9c1b-821fa59a2926 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:35.264415 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fd0f2-b205-492e-9c1b-821fa59a2926 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:35.265075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fd0f2-b205-492e-9c1b-821fa59a2926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:35.267242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d908b-1e0f-4b01-9a91-32cf56c46d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:35.267385 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fd0f2-b205-492e-9c1b-821fa59a2926 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:35.268038 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d908b-1e0f-4b01-9a91-32cf56c46d88 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:35.268468 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d908b-1e0f-4b01-9a91-32cf56c46d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:35.270009 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d908b-1e0f-4b01-9a91-32cf56c46d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:35.271561 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d908b-1e0f-4b01-9a91-32cf56c46d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:35.273558 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d908b-1e0f-4b01-9a91-32cf56c46d88 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:35.286822 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 945/1876] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:35.287677 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d908b-1e0f-4b01-9a91-32cf56c46d88 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:35.289378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-833d908b-1e0f-4b01-9a91-32cf56c46d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:35.294172 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 932/1877] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:35 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:35.295407 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fd0f2-b205-492e-9c1b-821fa59a2926 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:35.306570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fd0f2-b205-492e-9c1b-821fa59a2926 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:35.312010 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49126039-940c-45ff-929e-272348c15a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:35.313458 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49126039-940c-45ff-929e-272348c15a7f admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:35.313775 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49126039-940c-45ff-929e-272348c15a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:35.314061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49126039-940c-45ff-929e-272348c15a7f admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:35.314692 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49126039-940c-45ff-929e-272348c15a7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:35.316614 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49126039-940c-45ff-929e-272348c15a7f admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:35.345107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 933/1878] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:35 2022] POST /identity/v3/users => generated 297 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:35.345965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49126039-940c-45ff-929e-272348c15a7f admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:35.356638 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49126039-940c-45ff-929e-272348c15a7f admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:35.359526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d908b-1e0f-4b01-9a91-32cf56c46d88 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:35.361910 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e512236-c9d7-43a0-8d28-1c79a2bc219d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:35.362569 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e512236-c9d7-43a0-8d28-1c79a2bc219d admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:35.362853 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e512236-c9d7-43a0-8d28-1c79a2bc219d admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:35.363129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e512236-c9d7-43a0-8d28-1c79a2bc219d admin admin] PATH_INFO: `/v3/projects/aa893aa73e924e6797ee2f3fa38e524c/users/9690e6a4d930403c97d7e74c10b9a05d/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:35.363519 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6972e-c7f8-44f5-b12d-4c7a6b9e1ccd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:35.364124 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6972e-c7f8-44f5-b12d-4c7a6b9e1ccd service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:35.364401 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6972e-c7f8-44f5-b12d-4c7a6b9e1ccd service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:35.364672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6972e-c7f8-44f5-b12d-4c7a6b9e1ccd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:35.379035 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e512236-c9d7-43a0-8d28-1c79a2bc219d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa893aa73e924e6797ee2f3fa38e524c, user_id=9690e6a4d930403c97d7e74c10b9a05d, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:35.381750 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e512236-c9d7-43a0-8d28-1c79a2bc219d admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:35.396256 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 934/1879] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:35 2022] PUT /identity/v3/projects/aa893aa73e924e6797ee2f3fa38e524c/users/9690e6a4d930403c97d7e74c10b9a05d/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:35.397056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e512236-c9d7-43a0-8d28-1c79a2bc219d admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:35.434139 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6972e-c7f8-44f5-b12d-4c7a6b9e1ccd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:35.435745 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6972e-c7f8-44f5-b12d-4c7a6b9e1ccd service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:35.446145 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 946/1880] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:35 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:35.446967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6972e-c7f8-44f5-b12d-4c7a6b9e1ccd service cinder] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:35.457497 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6972e-c7f8-44f5-b12d-4c7a6b9e1ccd service cinder] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:35.470664 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e512236-c9d7-43a0-8d28-1c79a2bc219d admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:35.476006 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96beb6-f305-4916-8c4e-447ad2fa6372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:35.476618 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96beb6-f305-4916-8c4e-447ad2fa6372 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:35.477017 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96beb6-f305-4916-8c4e-447ad2fa6372 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:35.477190 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96beb6-f305-4916-8c4e-447ad2fa6372 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:35.477841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96beb6-f305-4916-8c4e-447ad2fa6372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:35.480360 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96beb6-f305-4916-8c4e-447ad2fa6372 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:35.493173 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 935/1881] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:35.494115 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96beb6-f305-4916-8c4e-447ad2fa6372 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:35.506663 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96beb6-f305-4916-8c4e-447ad2fa6372 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:35.511944 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae5e60-91a3-4d80-ad5a-a5edba5b3f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:35.512736 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae5e60-91a3-4d80-ad5a-a5edba5b3f4a admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:35.513175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae5e60-91a3-4d80-ad5a-a5edba5b3f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:35.513639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae5e60-91a3-4d80-ad5a-a5edba5b3f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:35.514458 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae5e60-91a3-4d80-ad5a-a5edba5b3f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:35.514901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:35.516722 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae5e60-91a3-4d80-ad5a-a5edba5b3f4a admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:35.525270 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:35.535350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 936/1882] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:35.535350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae5e60-91a3-4d80-ad5a-a5edba5b3f4a admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:35.545303 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae5e60-91a3-4d80-ad5a-a5edba5b3f4a admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:35.548283 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91feb9fa-91f8-44f1-9fe2-8ca29b243edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:35.548898 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91feb9fa-91f8-44f1-9fe2-8ca29b243edc admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:35.549212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91feb9fa-91f8-44f1-9fe2-8ca29b243edc admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:35.549510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91feb9fa-91f8-44f1-9fe2-8ca29b243edc admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:35.550228 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91feb9fa-91f8-44f1-9fe2-8ca29b243edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:35.551798 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91feb9fa-91f8-44f1-9fe2-8ca29b243edc admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:35.553175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff70359-8568-45fa-adc0-36f51a727755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:35.553922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff70359-8568-45fa-adc0-36f51a727755 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:35.554340 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff70359-8568-45fa-adc0-36f51a727755 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:35.554605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff70359-8568-45fa-adc0-36f51a727755 admin admin] PATH_INFO: `/v3/projects/378eab2a88d14688bd7558adab26fa72/users/6af72ed8e6b342cea6000429d4cdfd2a/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:35.564443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 947/1883] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:35.565565 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91feb9fa-91f8-44f1-9fe2-8ca29b243edc admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:35.579476 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff70359-8568-45fa-adc0-36f51a727755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=378eab2a88d14688bd7558adab26fa72, user_id=6af72ed8e6b342cea6000429d4cdfd2a, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:35.582228 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff70359-8568-45fa-adc0-36f51a727755 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:35.587935 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91feb9fa-91f8-44f1-9fe2-8ca29b243edc admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:35.597782 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773f9c9-83af-4cb2-a0c3-1c3ca064d48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:35.598916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773f9c9-83af-4cb2-a0c3-1c3ca064d48f admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:35.599314 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773f9c9-83af-4cb2-a0c3-1c3ca064d48f admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:35.600164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773f9c9-83af-4cb2-a0c3-1c3ca064d48f admin admin] PATH_INFO: `/v3/projects/aa893aa73e924e6797ee2f3fa38e524c/users/9690e6a4d930403c97d7e74c10b9a05d/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:35.605136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 937/1884] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:35 2022] PUT /identity/v3/projects/378eab2a88d14688bd7558adab26fa72/users/6af72ed8e6b342cea6000429d4cdfd2a/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:35.605307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773f9c9-83af-4cb2-a0c3-1c3ca064d48f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa893aa73e924e6797ee2f3fa38e524c, user_id=9690e6a4d930403c97d7e74c10b9a05d, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:35.605389 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff70359-8568-45fa-adc0-36f51a727755 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:35.607629 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773f9c9-83af-4cb2-a0c3-1c3ca064d48f admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:35.634939 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 948/1885] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:35 2022] PUT /identity/v3/projects/aa893aa73e924e6797ee2f3fa38e524c/users/9690e6a4d930403c97d7e74c10b9a05d/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:35.634939 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773f9c9-83af-4cb2-a0c3-1c3ca064d48f admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:35.689588 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff70359-8568-45fa-adc0-36f51a727755 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:35.699521 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773f9c9-83af-4cb2-a0c3-1c3ca064d48f admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:35.705071 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f08b2-5863-48f3-9ba5-5ce852a920a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:35.705720 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f08b2-5863-48f3-9ba5-5ce852a920a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:35.706051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f08b2-5863-48f3-9ba5-5ce852a920a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:35.706414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f08b2-5863-48f3-9ba5-5ce852a920a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:35.706961 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f08b2-5863-48f3-9ba5-5ce852a920a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:35.708556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f08b2-5863-48f3-9ba5-5ce852a920a3 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:35.719556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 949/1886] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:35.721392 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe31d4-a36c-4f0f-b9e8-19a10ada8fb4 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:35.721712 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe31d4-a36c-4f0f-b9e8-19a10ada8fb4 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:35.721988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe31d4-a36c-4f0f-b9e8-19a10ada8fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:35.751647 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-2cbe31d4-a36c-4f0f-b9e8-19a10ada8fb4 None None] MFA Rules not processed for user `9690e6a4d930403c97d7e74c10b9a05d`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:35.752873 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2cbe31d4-a36c-4f0f-b9e8-19a10ada8fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:35.764804 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359fd0e-e192-4633-99fb-b326ea4a855b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:35.766556 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359fd0e-e192-4633-99fb-b326ea4a855b admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:35.766935 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359fd0e-e192-4633-99fb-b326ea4a855b admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:35.767314 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359fd0e-e192-4633-99fb-b326ea4a855b admin admin] PATH_INFO: `/v3/projects/5c44c8c5e1dd4dc8912ba0dec61b7f37/users/873d1f9baf1040c28bca9765c43e0b42/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:35.786085 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359fd0e-e192-4633-99fb-b326ea4a855b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c44c8c5e1dd4dc8912ba0dec61b7f37, user_id=873d1f9baf1040c28bca9765c43e0b42, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:35.788801 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359fd0e-e192-4633-99fb-b326ea4a855b admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:35.807130 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 938/1887] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:35 2022] PUT /identity/v3/projects/5c44c8c5e1dd4dc8912ba0dec61b7f37/users/873d1f9baf1040c28bca9765c43e0b42/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:35.808264 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359fd0e-e192-4633-99fb-b326ea4a855b admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:35.835831 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 950/1888] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:35.836758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe31d4-a36c-4f0f-b9e8-19a10ada8fb4 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:35.852744 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe31d4-a36c-4f0f-b9e8-19a10ada8fb4 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:35.880800 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359fd0e-e192-4633-99fb-b326ea4a855b admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:35.886714 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7f548-a53a-4438-9f31-7fe916522bdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:35.887448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7f548-a53a-4438-9f31-7fe916522bdc service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:35.888203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7f548-a53a-4438-9f31-7fe916522bdc service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:35.888684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7f548-a53a-4438-9f31-7fe916522bdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:35.909656 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:35.916225 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:35.932502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0632d70-db95-4c15-a129-4de41b8cf3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:35.933201 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0632d70-db95-4c15-a129-4de41b8cf3c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:35.933495 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0632d70-db95-4c15-a129-4de41b8cf3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:35.933780 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0632d70-db95-4c15-a129-4de41b8cf3c9 admin admin] PATH_INFO: `/v3/projects/378eab2a88d14688bd7558adab26fa72/users/6af72ed8e6b342cea6000429d4cdfd2a/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:35.935932 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0632d70-db95-4c15-a129-4de41b8cf3c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=378eab2a88d14688bd7558adab26fa72, user_id=6af72ed8e6b342cea6000429d4cdfd2a, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:35.939080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0632d70-db95-4c15-a129-4de41b8cf3c9 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:35.951431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 951/1889] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:35 2022] PUT /identity/v3/projects/378eab2a88d14688bd7558adab26fa72/users/6af72ed8e6b342cea6000429d4cdfd2a/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:35.952189 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0632d70-db95-4c15-a129-4de41b8cf3c9 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:35.960427 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7f548-a53a-4438-9f31-7fe916522bdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:35.962102 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7f548-a53a-4438-9f31-7fe916522bdc service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:35.973823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 939/1890] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:35 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:35.974779 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7f548-a53a-4438-9f31-7fe916522bdc service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:35.976928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-fdc7f548-a53a-4438-9f31-7fe916522bdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:35.992292 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7f548-a53a-4438-9f31-7fe916522bdc service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:36.038378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0632d70-db95-4c15-a129-4de41b8cf3c9 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:36.043670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b6f29-950d-4ab2-95a4-40418664fb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:36.046300 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b6f29-950d-4ab2-95a4-40418664fb9b admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:36.047065 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b6f29-950d-4ab2-95a4-40418664fb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:36.047609 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b6f29-950d-4ab2-95a4-40418664fb9b admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:36.048506 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b6f29-950d-4ab2-95a4-40418664fb9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:36.050250 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b6f29-950d-4ab2-95a4-40418664fb9b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:36.050992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb735052-f632-48ed-8403-22d8b08fda3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:36.051634 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb735052-f632-48ed-8403-22d8b08fda3f service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:36.051911 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb735052-f632-48ed-8403-22d8b08fda3f service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:36.052181 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb735052-f632-48ed-8403-22d8b08fda3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:36.069911 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 952/1891] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:36.071291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f3b89-7b5b-4182-b628-f877a80c6183 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:36.071654 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f3b89-7b5b-4182-b628-f877a80c6183 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:36.072026 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f3b89-7b5b-4182-b628-f877a80c6183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:36.110080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-4a3f3b89-7b5b-4182-b628-f877a80c6183 None None] MFA Rules not processed for user `6af72ed8e6b342cea6000429d4cdfd2a`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:36.111753 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-4a3f3b89-7b5b-4182-b628-f877a80c6183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:36.134957 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb735052-f632-48ed-8403-22d8b08fda3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:36.136504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb735052-f632-48ed-8403-22d8b08fda3f service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:36.148710 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 940/1892] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:36.149705 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb735052-f632-48ed-8403-22d8b08fda3f service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:36.163322 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb735052-f632-48ed-8403-22d8b08fda3f service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:36.170605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e9ea2-9f00-4436-a090-6724c0badc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:36.171291 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e9ea2-9f00-4436-a090-6724c0badc76 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:36.171644 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e9ea2-9f00-4436-a090-6724c0badc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:36.171999 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e9ea2-9f00-4436-a090-6724c0badc76 admin admin] PATH_INFO: `/v3/projects/5c44c8c5e1dd4dc8912ba0dec61b7f37/users/873d1f9baf1040c28bca9765c43e0b42/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:36.174784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e9ea2-9f00-4436-a090-6724c0badc76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c44c8c5e1dd4dc8912ba0dec61b7f37, user_id=873d1f9baf1040c28bca9765c43e0b42, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:36.177682 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e9ea2-9f00-4436-a090-6724c0badc76 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:36.193498 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 941/1893] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:36 2022] PUT /identity/v3/projects/5c44c8c5e1dd4dc8912ba0dec61b7f37/users/873d1f9baf1040c28bca9765c43e0b42/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:36.202140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b9d90-914c-4433-a88f-16ab61e6548b None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:36.202378 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b9d90-914c-4433-a88f-16ab61e6548b None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:36.202720 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b9d90-914c-4433-a88f-16ab61e6548b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:36.223687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 953/1894] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:36.237735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-e06b9d90-914c-4433-a88f-16ab61e6548b None None] MFA Rules not processed for user `873d1f9baf1040c28bca9765c43e0b42`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:36.246340 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e06b9d90-914c-4433-a88f-16ab61e6548b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:36.248410 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f3b89-7b5b-4182-b628-f877a80c6183 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:36.260772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f3b89-7b5b-4182-b628-f877a80c6183 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:36.301907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:36.329574 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 942/1895] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:36.338348 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65fcc8-69fd-4819-9303-56050cc02f80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:36.338959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65fcc8-69fd-4819-9303-56050cc02f80 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:36.339233 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65fcc8-69fd-4819-9303-56050cc02f80 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:36.339506 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65fcc8-69fd-4819-9303-56050cc02f80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:36.354861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:36.391047 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b9d90-914c-4433-a88f-16ab61e6548b None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:36.401488 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b9d90-914c-4433-a88f-16ab61e6548b None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:36.406704 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f0e21-cc52-4c22-a6a8-1016f3a2f5b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:36.407988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f0e21-cc52-4c22-a6a8-1016f3a2f5b7 service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:36.408649 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f0e21-cc52-4c22-a6a8-1016f3a2f5b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:36.409325 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f0e21-cc52-4c22-a6a8-1016f3a2f5b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:36.420315 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f0e21-cc52-4c22-a6a8-1016f3a2f5b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:36.422718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f0e21-cc52-4c22-a6a8-1016f3a2f5b7 service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:36.433508 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65fcc8-69fd-4819-9303-56050cc02f80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:36.434470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 943/1896] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:45:36.435308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65fcc8-69fd-4819-9303-56050cc02f80 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:36.447354 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 954/1897] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:36 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:45:36.600271 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f0e21-cc52-4c22-a6a8-1016f3a2f5b7 service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:36.611777 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f0e21-cc52-4c22-a6a8-1016f3a2f5b7 service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:36.616425 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c080d2-73c7-48a4-9c84-2fb1872d7653 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:36.617012 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c080d2-73c7-48a4-9c84-2fb1872d7653 service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:36.617287 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c080d2-73c7-48a4-9c84-2fb1872d7653 service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:36.617729 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c080d2-73c7-48a4-9c84-2fb1872d7653 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:36.707427 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c080d2-73c7-48a4-9c84-2fb1872d7653 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:36.708975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c080d2-73c7-48a4-9c84-2fb1872d7653 service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:36.723108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 944/1898] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:37.148873 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65fcc8-69fd-4819-9303-56050cc02f80 service cinder] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:37.161899 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65fcc8-69fd-4819-9303-56050cc02f80 service cinder] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:37.168083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c12db-c36a-4a04-98c4-2b8dbd579f3b tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '873d1f9baf1040c28bca9765c43e0b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c44c8c5e1dd4dc8912ba0dec61b7f37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:37.168899 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c12db-c36a-4a04-98c4-2b8dbd579f3b tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:37.169313 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c12db-c36a-4a04-98c4-2b8dbd579f3b tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:37.169869 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c12db-c36a-4a04-98c4-2b8dbd579f3b tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:37.170752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c12db-c36a-4a04-98c4-2b8dbd579f3b tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:37.171956 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c12db-c36a-4a04-98c4-2b8dbd579f3b tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:37.175549 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c12db-c36a-4a04-98c4-2b8dbd579f3b tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:37.193063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 955/1899] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:37.194522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c080d2-73c7-48a4-9c84-2fb1872d7653 service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:37.205450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c080d2-73c7-48a4-9c84-2fb1872d7653 service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:37.210441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2418f-420e-4e91-9a92-b9c14589281b tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '873d1f9baf1040c28bca9765c43e0b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c44c8c5e1dd4dc8912ba0dec61b7f37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:37.210974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2418f-420e-4e91-9a92-b9c14589281b tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:37.211250 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2418f-420e-4e91-9a92-b9c14589281b tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:37.211528 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2418f-420e-4e91-9a92-b9c14589281b tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:37.212154 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2418f-420e-4e91-9a92-b9c14589281b tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:37.214104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2418f-420e-4e91-9a92-b9c14589281b tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:37.250436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 945/1900] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:37 2022] POST /identity/v3/projects => generated 355 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:37.254508 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c12db-c36a-4a04-98c4-2b8dbd579f3b tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:37.266092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c12db-c36a-4a04-98c4-2b8dbd579f3b tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:37.350038 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6cdf1-3277-41ae-8ab3-ea3905ba93d8 tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '873d1f9baf1040c28bca9765c43e0b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c44c8c5e1dd4dc8912ba0dec61b7f37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:37.350699 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6cdf1-3277-41ae-8ab3-ea3905ba93d8 tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:37.350983 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6cdf1-3277-41ae-8ab3-ea3905ba93d8 tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:37.351260 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6cdf1-3277-41ae-8ab3-ea3905ba93d8 tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:37.351970 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6cdf1-3277-41ae-8ab3-ea3905ba93d8 tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:37.352279 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6cdf1-3277-41ae-8ab3-ea3905ba93d8 tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:37.354121 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6cdf1-3277-41ae-8ab3-ea3905ba93d8 tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:37.378015 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 956/1901] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:37.426255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2418f-420e-4e91-9a92-b9c14589281b tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:37.436735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2418f-420e-4e91-9a92-b9c14589281b tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:37.442530 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75faed-12fa-46dc-b3ef-cabb7524b837 tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '873d1f9baf1040c28bca9765c43e0b42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c44c8c5e1dd4dc8912ba0dec61b7f37', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:37.443210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75faed-12fa-46dc-b3ef-cabb7524b837 tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:37.443499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75faed-12fa-46dc-b3ef-cabb7524b837 tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:37.443776 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75faed-12fa-46dc-b3ef-cabb7524b837 tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] PATH_INFO: `/v3/projects/d0174946275043e0952e12b953db7135` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:37.444924 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75faed-12fa-46dc-b3ef-cabb7524b837 tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d0174946275043e0952e12b953db7135)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:37.446863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75faed-12fa-46dc-b3ef-cabb7524b837 tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:37.502659 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-1a75faed-12fa-46dc-b3ef-cabb7524b837 tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0174946275043e0952e12b953db7135', 'request_id': 'req-1a75faed-12fa-46dc-b3ef-cabb7524b837'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:37.513054 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-1a75faed-12fa-46dc-b3ef-cabb7524b837 tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0174946275043e0952e12b953db7135', 'request_id': 'req-1a75faed-12fa-46dc-b3ef-cabb7524b837'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:37.522696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-1a75faed-12fa-46dc-b3ef-cabb7524b837 tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0174946275043e0952e12b953db7135', 'request_id': 'req-1a75faed-12fa-46dc-b3ef-cabb7524b837'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:37.542013 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-1a75faed-12fa-46dc-b3ef-cabb7524b837 tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] The token cache is being invalidate because project d0174946275043e0952e12b953db7135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:37.542313 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-1a75faed-12fa-46dc-b3ef-cabb7524b837 tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:37.543262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-1a75faed-12fa-46dc-b3ef-cabb7524b837 tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:37.544959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 946/1902] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:37 2022] DELETE /identity/v3/projects/d0174946275043e0952e12b953db7135 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:37.867412 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6cdf1-3277-41ae-8ab3-ea3905ba93d8 tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:37.869501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-80d6cdf1-3277-41ae-8ab3-ea3905ba93d8 tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:37.953438 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6cdf1-3277-41ae-8ab3-ea3905ba93d8 tempest-VolumeQuotaClassesTest-1600069020 tempest-VolumeQuotaClassesTest-1600069020-project-admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:37.995493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:38.018502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e56b85-ff0c-41e2-9d83-2781f4ad2ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:38.019146 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e56b85-ff0c-41e2-9d83-2781f4ad2ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:38.019428 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e56b85-ff0c-41e2-9d83-2781f4ad2ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:38.019705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e56b85-ff0c-41e2-9d83-2781f4ad2ce4 admin admin] PATH_INFO: `/v3/users/eac069ee966e48f3a75d8d511a4d26a5` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:38.020843 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e56b85-ff0c-41e2-9d83-2781f4ad2ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eac069ee966e48f3a75d8d511a4d26a5)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:38.022795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e56b85-ff0c-41e2-9d83-2781f4ad2ce4 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:38.075257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-66e56b85-ff0c-41e2-9d83-2781f4ad2ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eac069ee966e48f3a75d8d511a4d26a5'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:38.075866 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-66e56b85-ff0c-41e2-9d83-2781f4ad2ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eac069ee966e48f3a75d8d511a4d26a5'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:38.094684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-66e56b85-ff0c-41e2-9d83-2781f4ad2ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eac069ee966e48f3a75d8d511a4d26a5'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:38.107698 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-66e56b85-ff0c-41e2-9d83-2781f4ad2ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eac069ee966e48f3a75d8d511a4d26a5'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:38.122947 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-66e56b85-ff0c-41e2-9d83-2781f4ad2ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eac069ee966e48f3a75d8d511a4d26a5'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:38.134579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 957/1903] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:37 2022] DELETE /identity/v3/users/eac069ee966e48f3a75d8d511a4d26a5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:38.142393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cd29c-510b-4cbf-818c-67b50f0fed26 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:38.143474 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cd29c-510b-4cbf-818c-67b50f0fed26 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:38.143963 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cd29c-510b-4cbf-818c-67b50f0fed26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:38.167593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-880cd29c-510b-4cbf-818c-67b50f0fed26 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:38.169948 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-880cd29c-510b-4cbf-818c-67b50f0fed26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:38.232958 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:38.291213 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 947/1904] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:38.309816 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e56b85-ff0c-41e2-9d83-2781f4ad2ce4 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:38.311486 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-66e56b85-ff0c-41e2-9d83-2781f4ad2ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:38.437504 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e56b85-ff0c-41e2-9d83-2781f4ad2ce4 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:38.443189 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdec9a5-a1cb-4836-9e09-3ce2f5726b8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:38.444202 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdec9a5-a1cb-4836-9e09-3ce2f5726b8a service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:38.444786 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdec9a5-a1cb-4836-9e09-3ce2f5726b8a service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:38.445437 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdec9a5-a1cb-4836-9e09-3ce2f5726b8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:38.462855 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdec9a5-a1cb-4836-9e09-3ce2f5726b8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:38.464800 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdec9a5-a1cb-4836-9e09-3ce2f5726b8a service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:38.485454 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 958/1905] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:38.768277 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880cd29c-510b-4cbf-818c-67b50f0fed26 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:38.770743 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-880cd29c-510b-4cbf-818c-67b50f0fed26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:38.789724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880cd29c-510b-4cbf-818c-67b50f0fed26 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:38.798844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bff1b-c6d7-43f3-a5e2-b0264a03c26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:38.799497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bff1b-c6d7-43f3-a5e2-b0264a03c26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:38.799972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bff1b-c6d7-43f3-a5e2-b0264a03c26b admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:38.800413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bff1b-c6d7-43f3-a5e2-b0264a03c26b admin admin] PATH_INFO: `/v3/users/0d87922549164e34802891cde258bcff` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:38.802021 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bff1b-c6d7-43f3-a5e2-b0264a03c26b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d87922549164e34802891cde258bcff)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:38.804313 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bff1b-c6d7-43f3-a5e2-b0264a03c26b admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:38.900605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cc3bff1b-c6d7-43f3-a5e2-b0264a03c26b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d87922549164e34802891cde258bcff'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:38.901700 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cc3bff1b-c6d7-43f3-a5e2-b0264a03c26b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d87922549164e34802891cde258bcff'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:38.902396 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cc3bff1b-c6d7-43f3-a5e2-b0264a03c26b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d87922549164e34802891cde258bcff'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:38.917003 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cc3bff1b-c6d7-43f3-a5e2-b0264a03c26b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d87922549164e34802891cde258bcff'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:38.918897 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdec9a5-a1cb-4836-9e09-3ce2f5726b8a service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:38.920329 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2bdec9a5-a1cb-4836-9e09-3ce2f5726b8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:38.927566 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cc3bff1b-c6d7-43f3-a5e2-b0264a03c26b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d87922549164e34802891cde258bcff'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:38.939712 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdec9a5-a1cb-4836-9e09-3ce2f5726b8a service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:38.944323 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 948/1906] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:38 2022] DELETE /identity/v3/users/0d87922549164e34802891cde258bcff => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:38.953967 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c7ee6-a4f4-419e-a240-5eeca455ebf9 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:38.954998 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf43731-3205-461f-b4a4-2cd786ea9ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:38.957605 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf43731-3205-461f-b4a4-2cd786ea9ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:38.957605 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf43731-3205-461f-b4a4-2cd786ea9ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:38.957605 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf43731-3205-461f-b4a4-2cd786ea9ee0 admin admin] PATH_INFO: `/v3/projects/bc7c4156b8cf4805a3746f52fe7198f8` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:38.957605 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf43731-3205-461f-b4a4-2cd786ea9ee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc7c4156b8cf4805a3746f52fe7198f8)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:38.959213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf43731-3205-461f-b4a4-2cd786ea9ee0 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:38.961206 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c7ee6-a4f4-419e-a240-5eeca455ebf9 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:38.961792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c7ee6-a4f4-419e-a240-5eeca455ebf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:38.985210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-473c7ee6-a4f4-419e-a240-5eeca455ebf9 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:38.986602 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-473c7ee6-a4f4-419e-a240-5eeca455ebf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:39.026972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2cf43731-3205-461f-b4a4-2cd786ea9ee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc7c4156b8cf4805a3746f52fe7198f8', 'request_id': 'req-2cf43731-3205-461f-b4a4-2cd786ea9ee0'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:39.038869 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2cf43731-3205-461f-b4a4-2cd786ea9ee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc7c4156b8cf4805a3746f52fe7198f8', 'request_id': 'req-2cf43731-3205-461f-b4a4-2cd786ea9ee0'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:39.040611 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:39.050456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2cf43731-3205-461f-b4a4-2cd786ea9ee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc7c4156b8cf4805a3746f52fe7198f8', 'request_id': 'req-2cf43731-3205-461f-b4a4-2cd786ea9ee0'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:39.064868 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 949/1907] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:39.066416 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2cf43731-3205-461f-b4a4-2cd786ea9ee0 admin admin] The token cache is being invalidate because project bc7c4156b8cf4805a3746f52fe7198f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:39.066849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2cf43731-3205-461f-b4a4-2cd786ea9ee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:39.067664 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2cf43731-3205-461f-b4a4-2cd786ea9ee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:39.072679 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 959/1908] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:38 2022] DELETE /identity/v3/projects/bc7c4156b8cf4805a3746f52fe7198f8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:39.073985 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf43731-3205-461f-b4a4-2cd786ea9ee0 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:39.075378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2cf43731-3205-461f-b4a4-2cd786ea9ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:39.079460 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c7ee6-a4f4-419e-a240-5eeca455ebf9 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:39.081089 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-473c7ee6-a4f4-419e-a240-5eeca455ebf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:39.138514 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:39.150455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf43731-3205-461f-b4a4-2cd786ea9ee0 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:39.152165 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c7ee6-a4f4-419e-a240-5eeca455ebf9 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:39.157937 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6e3a0-7f3f-442e-a3f7-0db5a93cc6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:39.159238 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6e3a0-7f3f-442e-a3f7-0db5a93cc6ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:39.159706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6e3a0-7f3f-442e-a3f7-0db5a93cc6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:39.160135 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6e3a0-7f3f-442e-a3f7-0db5a93cc6ee admin admin] PATH_INFO: `/v3/users/873d1f9baf1040c28bca9765c43e0b42` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:39.161563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6e3a0-7f3f-442e-a3f7-0db5a93cc6ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=873d1f9baf1040c28bca9765c43e0b42)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:39.163794 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6e3a0-7f3f-442e-a3f7-0db5a93cc6ee admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:39.251965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-c4a6e3a0-7f3f-442e-a3f7-0db5a93cc6ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '873d1f9baf1040c28bca9765c43e0b42'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:39.254323 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-c4a6e3a0-7f3f-442e-a3f7-0db5a93cc6ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '873d1f9baf1040c28bca9765c43e0b42'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:39.274822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e169807-8d0e-414e-a95b-4433ff58ece6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:39.275616 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e169807-8d0e-414e-a95b-4433ff58ece6 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:39.276366 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e169807-8d0e-414e-a95b-4433ff58ece6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:39.276653 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e169807-8d0e-414e-a95b-4433ff58ece6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:39.278673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7e169807-8d0e-414e-a95b-4433ff58ece6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:39.281592 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-c4a6e3a0-7f3f-442e-a3f7-0db5a93cc6ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '873d1f9baf1040c28bca9765c43e0b42'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:39.296131 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-c4a6e3a0-7f3f-442e-a3f7-0db5a93cc6ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '873d1f9baf1040c28bca9765c43e0b42'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:39.296990 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e169807-8d0e-414e-a95b-4433ff58ece6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:39.299559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e169807-8d0e-414e-a95b-4433ff58ece6 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:39.309233 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-c4a6e3a0-7f3f-442e-a3f7-0db5a93cc6ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '873d1f9baf1040c28bca9765c43e0b42'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:39.319342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 950/1910] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:39.321902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 960/1910] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:39 2022] DELETE /identity/v3/users/873d1f9baf1040c28bca9765c43e0b42 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:39.881579 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e169807-8d0e-414e-a95b-4433ff58ece6 service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:39.883364 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7e169807-8d0e-414e-a95b-4433ff58ece6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:39.902661 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e169807-8d0e-414e-a95b-4433ff58ece6 service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:40.009853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6e3a0-7f3f-442e-a3f7-0db5a93cc6ee admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:40.011112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-c4a6e3a0-7f3f-442e-a3f7-0db5a93cc6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:40.011317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52409aee-6b3d-4746-9019-c35ac83d5081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:40.012106 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52409aee-6b3d-4746-9019-c35ac83d5081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:40.012503 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52409aee-6b3d-4746-9019-c35ac83d5081 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:40.013421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52409aee-6b3d-4746-9019-c35ac83d5081 admin admin] PATH_INFO: `/v3/projects/77f0cb5a9e6d45b49aa087a0bc520533` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:40.014683 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52409aee-6b3d-4746-9019-c35ac83d5081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77f0cb5a9e6d45b49aa087a0bc520533)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:40.017153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52409aee-6b3d-4746-9019-c35ac83d5081 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:40.035966 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6e3a0-7f3f-442e-a3f7-0db5a93cc6ee admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:40.049496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5da5b6-9e65-4713-aece-9eabd1419e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:40.050842 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5da5b6-9e65-4713-aece-9eabd1419e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:40.051329 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5da5b6-9e65-4713-aece-9eabd1419e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:40.052123 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5da5b6-9e65-4713-aece-9eabd1419e5f admin admin] PATH_INFO: `/v3/projects/5c44c8c5e1dd4dc8912ba0dec61b7f37` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:40.054030 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5da5b6-9e65-4713-aece-9eabd1419e5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c44c8c5e1dd4dc8912ba0dec61b7f37)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:40.056873 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5da5b6-9e65-4713-aece-9eabd1419e5f admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:40.104418 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-52409aee-6b3d-4746-9019-c35ac83d5081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77f0cb5a9e6d45b49aa087a0bc520533', 'request_id': 'req-52409aee-6b3d-4746-9019-c35ac83d5081'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:40.119472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-52409aee-6b3d-4746-9019-c35ac83d5081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77f0cb5a9e6d45b49aa087a0bc520533', 'request_id': 'req-52409aee-6b3d-4746-9019-c35ac83d5081'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:40.121257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3c5da5b6-9e65-4713-aece-9eabd1419e5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c44c8c5e1dd4dc8912ba0dec61b7f37', 'request_id': 'req-3c5da5b6-9e65-4713-aece-9eabd1419e5f'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:40.131850 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3c5da5b6-9e65-4713-aece-9eabd1419e5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c44c8c5e1dd4dc8912ba0dec61b7f37', 'request_id': 'req-3c5da5b6-9e65-4713-aece-9eabd1419e5f'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:40.134837 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:40.138013 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-52409aee-6b3d-4746-9019-c35ac83d5081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77f0cb5a9e6d45b49aa087a0bc520533', 'request_id': 'req-52409aee-6b3d-4746-9019-c35ac83d5081'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:40.144387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3c5da5b6-9e65-4713-aece-9eabd1419e5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c44c8c5e1dd4dc8912ba0dec61b7f37', 'request_id': 'req-3c5da5b6-9e65-4713-aece-9eabd1419e5f'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:40.159578 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-52409aee-6b3d-4746-9019-c35ac83d5081 admin admin] The token cache is being invalidate because project 77f0cb5a9e6d45b49aa087a0bc520533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:40.160126 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-52409aee-6b3d-4746-9019-c35ac83d5081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:40.160854 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-52409aee-6b3d-4746-9019-c35ac83d5081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:40.163291 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 951/1911] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:39 2022] DELETE /identity/v3/projects/77f0cb5a9e6d45b49aa087a0bc520533 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:40.164278 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3c5da5b6-9e65-4713-aece-9eabd1419e5f admin admin] The token cache is being invalidate because project 5c44c8c5e1dd4dc8912ba0dec61b7f37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:40.164740 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3c5da5b6-9e65-4713-aece-9eabd1419e5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:40.165493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3c5da5b6-9e65-4713-aece-9eabd1419e5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:40.166676 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52409aee-6b3d-4746-9019-c35ac83d5081 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:40.170359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 961/1912] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:40 2022] DELETE /identity/v3/projects/5c44c8c5e1dd4dc8912ba0dec61b7f37 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:45:40.174162 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5c5e0-a7a7-4733-9ddc-9cca3efaf3bf None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:40.174452 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5c5e0-a7a7-4733-9ddc-9cca3efaf3bf None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:40.174824 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-52409aee-6b3d-4746-9019-c35ac83d5081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:40.176525 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5c5e0-a7a7-4733-9ddc-9cca3efaf3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:40.211117 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-7bc5c5e0-a7a7-4733-9ddc-9cca3efaf3bf None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:40.220504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:40.223748 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-7bc5c5e0-a7a7-4733-9ddc-9cca3efaf3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:40.269309 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52409aee-6b3d-4746-9019-c35ac83d5081 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:40.345503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 962/1913] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:40.347193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3cfde-b9c2-4821-a154-62b670cce69b None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:40.347597 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3cfde-b9c2-4821-a154-62b670cce69b None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:40.348100 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3cfde-b9c2-4821-a154-62b670cce69b None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:40.349526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 963/1914] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 09:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:45:40.354551 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3dc1a-f658-439a-92db-b8bc1de56698 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:40.355077 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3dc1a-f658-439a-92db-b8bc1de56698 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:40.355460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3dc1a-f658-439a-92db-b8bc1de56698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:40.366586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69f00f-8bed-4943-8164-13b98f975c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:40.367226 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69f00f-8bed-4943-8164-13b98f975c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:40.367509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69f00f-8bed-4943-8164-13b98f975c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:40.367779 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69f00f-8bed-4943-8164-13b98f975c70 admin admin] PATH_INFO: `/v3/users/9690e6a4d930403c97d7e74c10b9a05d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:40.368925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69f00f-8bed-4943-8164-13b98f975c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9690e6a4d930403c97d7e74c10b9a05d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:40.371019 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69f00f-8bed-4943-8164-13b98f975c70 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:40.378892 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-1cb3dc1a-f658-439a-92db-b8bc1de56698 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:40.380113 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-1cb3dc1a-f658-439a-92db-b8bc1de56698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:40.388594 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 964/1915] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:40.389730 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd386d9-7ce9-48ab-83d6-bfc0f584f3ca None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:40.390106 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd386d9-7ce9-48ab-83d6-bfc0f584f3ca None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:40.390454 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd386d9-7ce9-48ab-83d6-bfc0f584f3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:40.412870 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-0dd386d9-7ce9-48ab-83d6-bfc0f584f3ca None None] MFA Rules not processed for user `18be8c54c9644c5e9812eea09e60c11c`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:40.414425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-0dd386d9-7ce9-48ab-83d6-bfc0f584f3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:40.443295 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-af69f00f-8bed-4943-8164-13b98f975c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9690e6a4d930403c97d7e74c10b9a05d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:40.444380 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-af69f00f-8bed-4943-8164-13b98f975c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9690e6a4d930403c97d7e74c10b9a05d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:40.445672 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-af69f00f-8bed-4943-8164-13b98f975c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9690e6a4d930403c97d7e74c10b9a05d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:40.464108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-af69f00f-8bed-4943-8164-13b98f975c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9690e6a4d930403c97d7e74c10b9a05d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:40.475829 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-af69f00f-8bed-4943-8164-13b98f975c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9690e6a4d930403c97d7e74c10b9a05d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:40.507889 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 965/1916] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 09:45:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:40.508705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd386d9-7ce9-48ab-83d6-bfc0f584f3ca None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:40.510023 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-0dd386d9-7ce9-48ab-83d6-bfc0f584f3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:40.525428 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 952/1917] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:40 2022] DELETE /identity/v3/users/9690e6a4d930403c97d7e74c10b9a05d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:40.528156 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd386d9-7ce9-48ab-83d6-bfc0f584f3ca None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:40.548550 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69f00f-8bed-4943-8164-13b98f975c70 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:40.550619 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-af69f00f-8bed-4943-8164-13b98f975c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:40.643732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209467b-455c-480a-b833-33e3c272241b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:40.644246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209467b-455c-480a-b833-33e3c272241b admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:40.644520 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209467b-455c-480a-b833-33e3c272241b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:40.644812 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209467b-455c-480a-b833-33e3c272241b admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:40.645501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209467b-455c-480a-b833-33e3c272241b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:40.645940 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209467b-455c-480a-b833-33e3c272241b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:40.647514 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209467b-455c-480a-b833-33e3c272241b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:40.652295 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:40.664146 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 966/1918] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:40.668797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209467b-455c-480a-b833-33e3c272241b admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:40.680966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69f00f-8bed-4943-8164-13b98f975c70 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:40.689191 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060e9d8-5fea-4750-be5f-40bf7d49f995 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:40.689377 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209467b-455c-480a-b833-33e3c272241b admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:40.690232 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060e9d8-5fea-4750-be5f-40bf7d49f995 service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:40.690859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060e9d8-5fea-4750-be5f-40bf7d49f995 service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:40.691326 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060e9d8-5fea-4750-be5f-40bf7d49f995 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:40.696765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380421a-1e6e-45d7-8234-2a2c4a1b4be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:40.698087 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380421a-1e6e-45d7-8234-2a2c4a1b4be3 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:40.698372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380421a-1e6e-45d7-8234-2a2c4a1b4be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:40.699035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380421a-1e6e-45d7-8234-2a2c4a1b4be3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:40.699869 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380421a-1e6e-45d7-8234-2a2c4a1b4be3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:40.702330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380421a-1e6e-45d7-8234-2a2c4a1b4be3 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:40.704926 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060e9d8-5fea-4750-be5f-40bf7d49f995 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:40.706824 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060e9d8-5fea-4750-be5f-40bf7d49f995 service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:40.714561 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:40.721865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 953/1919] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:45:40.785931 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 967/1920] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:40 2022] POST /identity/v3/projects => generated 391 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:40.790571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060e9d8-5fea-4750-be5f-40bf7d49f995 service nova] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:40.819494 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060e9d8-5fea-4750-be5f-40bf7d49f995 service nova] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:40.923057 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597dfbd-8fdb-4c29-a809-2c4fd113cb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:40.923810 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597dfbd-8fdb-4c29-a809-2c4fd113cb03 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:40.924167 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597dfbd-8fdb-4c29-a809-2c4fd113cb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:40.924522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597dfbd-8fdb-4c29-a809-2c4fd113cb03 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:40.925234 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597dfbd-8fdb-4c29-a809-2c4fd113cb03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:40.927353 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597dfbd-8fdb-4c29-a809-2c4fd113cb03 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:40.953107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 954/1921] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:40 2022] POST /identity/v3/users => generated 296 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:40.957500 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380421a-1e6e-45d7-8234-2a2c4a1b4be3 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:40.971469 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380421a-1e6e-45d7-8234-2a2c4a1b4be3 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:40.979179 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d97820-7342-4292-b2b0-b32040d83f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:40.979892 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d97820-7342-4292-b2b0-b32040d83f94 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:40.980272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d97820-7342-4292-b2b0-b32040d83f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:40.980618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d97820-7342-4292-b2b0-b32040d83f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:40.981345 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d97820-7342-4292-b2b0-b32040d83f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:40.990417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d97820-7342-4292-b2b0-b32040d83f94 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:41.011433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 968/1922] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:41.018060 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597dfbd-8fdb-4c29-a809-2c4fd113cb03 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:41.023276 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d97820-7342-4292-b2b0-b32040d83f94 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:41.029371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-79d97820-7342-4292-b2b0-b32040d83f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:41.032816 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597dfbd-8fdb-4c29-a809-2c4fd113cb03 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:41.043657 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae553fc4-eacd-4284-b8ad-f954d331d43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:41.044462 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae553fc4-eacd-4284-b8ad-f954d331d43c admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:41.044734 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae553fc4-eacd-4284-b8ad-f954d331d43c admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:41.045009 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae553fc4-eacd-4284-b8ad-f954d331d43c admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:41.045710 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae553fc4-eacd-4284-b8ad-f954d331d43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:41.049228 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae553fc4-eacd-4284-b8ad-f954d331d43c admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:41.057318 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d97820-7342-4292-b2b0-b32040d83f94 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:41.065230 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 955/1923] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:41.066818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae553fc4-eacd-4284-b8ad-f954d331d43c admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:41.072380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2d1f7-f2bd-418e-a557-69bc7a4d85af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:41.073106 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2d1f7-f2bd-418e-a557-69bc7a4d85af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:41.073587 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2d1f7-f2bd-418e-a557-69bc7a4d85af admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:41.073932 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2d1f7-f2bd-418e-a557-69bc7a4d85af admin admin] PATH_INFO: `/v3/projects/aa893aa73e924e6797ee2f3fa38e524c` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:41.076386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2d1f7-f2bd-418e-a557-69bc7a4d85af admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa893aa73e924e6797ee2f3fa38e524c)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:41.079278 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2d1f7-f2bd-418e-a557-69bc7a4d85af admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:41.082026 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae553fc4-eacd-4284-b8ad-f954d331d43c admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:41.089951 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99513dbc-f909-4ee8-945e-04371ed51644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:41.094998 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99513dbc-f909-4ee8-945e-04371ed51644 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:41.095279 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99513dbc-f909-4ee8-945e-04371ed51644 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:41.095554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99513dbc-f909-4ee8-945e-04371ed51644 admin admin] PATH_INFO: `/v3/projects/f682b4c01db2432cb73c93490f985e85/users/fa591ee7510f44f49f04afecd30fc88d/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:41.122301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99513dbc-f909-4ee8-945e-04371ed51644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f682b4c01db2432cb73c93490f985e85, user_id=fa591ee7510f44f49f04afecd30fc88d, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:41.126179 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99513dbc-f909-4ee8-945e-04371ed51644 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:41.144324 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 956/1924] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:41 2022] PUT /identity/v3/projects/f682b4c01db2432cb73c93490f985e85/users/fa591ee7510f44f49f04afecd30fc88d/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:45:41.146481 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-aea2d1f7-f2bd-418e-a557-69bc7a4d85af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa893aa73e924e6797ee2f3fa38e524c', 'request_id': 'req-aea2d1f7-f2bd-418e-a557-69bc7a4d85af'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:41.155214 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d3b24-1d45-40c3-97e9-bd0b6a6ab64a None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:41.155647 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d3b24-1d45-40c3-97e9-bd0b6a6ab64a None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:41.155960 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d3b24-1d45-40c3-97e9-bd0b6a6ab64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:41.156191 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-aea2d1f7-f2bd-418e-a557-69bc7a4d85af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa893aa73e924e6797ee2f3fa38e524c', 'request_id': 'req-aea2d1f7-f2bd-418e-a557-69bc7a4d85af'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:41.164592 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-aea2d1f7-f2bd-418e-a557-69bc7a4d85af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa893aa73e924e6797ee2f3fa38e524c', 'request_id': 'req-aea2d1f7-f2bd-418e-a557-69bc7a4d85af'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:41.177662 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-aea2d1f7-f2bd-418e-a557-69bc7a4d85af admin admin] The token cache is being invalidate because project aa893aa73e924e6797ee2f3fa38e524c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:41.177901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-aea2d1f7-f2bd-418e-a557-69bc7a4d85af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:41.178479 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-aea2d1f7-f2bd-418e-a557-69bc7a4d85af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:41.180273 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 969/1925] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:41 2022] DELETE /identity/v3/projects/aa893aa73e924e6797ee2f3fa38e524c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:41.184934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03ecf3-1b61-4e47-a75f-109a4a4ba6a5 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:41.185222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03ecf3-1b61-4e47-a75f-109a4a4ba6a5 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:41.185520 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03ecf3-1b61-4e47-a75f-109a4a4ba6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:41.187495 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-fd3d3b24-1d45-40c3-97e9-bd0b6a6ab64a None None] MFA Rules not processed for user `fa591ee7510f44f49f04afecd30fc88d`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:41.188800 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-fd3d3b24-1d45-40c3-97e9-bd0b6a6ab64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:41.212004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-2c03ecf3-1b61-4e47-a75f-109a4a4ba6a5 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:41.213913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2c03ecf3-1b61-4e47-a75f-109a4a4ba6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:41.263834 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 957/1926] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:41.268182 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d3b24-1d45-40c3-97e9-bd0b6a6ab64a None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:41.270293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-fd3d3b24-1d45-40c3-97e9-bd0b6a6ab64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:41.289840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 970/1927] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:45:41.298408 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12be1d5-003f-4632-b5de-dededcbc6c36 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:41.298697 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12be1d5-003f-4632-b5de-dededcbc6c36 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:41.298975 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12be1d5-003f-4632-b5de-dededcbc6c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:41.303149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:41.319240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-e12be1d5-003f-4632-b5de-dededcbc6c36 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:41.320624 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-e12be1d5-003f-4632-b5de-dededcbc6c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:41.329399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 971/1928] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:45:41.333522 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12be1d5-003f-4632-b5de-dededcbc6c36 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:41.340003 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d3b24-1d45-40c3-97e9-bd0b6a6ab64a None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:41.343575 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12be1d5-003f-4632-b5de-dededcbc6c36 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:41.345516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635efef6-4af5-4f8a-9f02-655d15cf6a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:41.346396 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635efef6-4af5-4f8a-9f02-655d15cf6a5c admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:41.346678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635efef6-4af5-4f8a-9f02-655d15cf6a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:41.346955 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635efef6-4af5-4f8a-9f02-655d15cf6a5c admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:41.347581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635efef6-4af5-4f8a-9f02-655d15cf6a5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:41.348572 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed39981-23d6-434f-9a6e-1380416b93e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:41.349169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed39981-23d6-434f-9a6e-1380416b93e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:41.349445 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed39981-23d6-434f-9a6e-1380416b93e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:41.349580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635efef6-4af5-4f8a-9f02-655d15cf6a5c admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:41.349742 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed39981-23d6-434f-9a6e-1380416b93e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:41.350844 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed39981-23d6-434f-9a6e-1380416b93e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:41.350844 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed39981-23d6-434f-9a6e-1380416b93e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:41.352318 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed39981-23d6-434f-9a6e-1380416b93e5 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:41.366042 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 972/1929] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:45:41.370359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed39981-23d6-434f-9a6e-1380416b93e5 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:41.382319 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed39981-23d6-434f-9a6e-1380416b93e5 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:41.384995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 958/1930] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:41 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:45:41.387723 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb1b9e-356e-4e01-ba6c-4498f2eea661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:41.388347 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb1b9e-356e-4e01-ba6c-4498f2eea661 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:41.388628 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb1b9e-356e-4e01-ba6c-4498f2eea661 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:41.388905 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb1b9e-356e-4e01-ba6c-4498f2eea661 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:41.389058 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635efef6-4af5-4f8a-9f02-655d15cf6a5c admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:41.389585 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb1b9e-356e-4e01-ba6c-4498f2eea661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:41.392142 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb1b9e-356e-4e01-ba6c-4498f2eea661 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:41.423830 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 973/1931] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:41 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:41.428362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb1b9e-356e-4e01-ba6c-4498f2eea661 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:41.449524 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:41.465049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635efef6-4af5-4f8a-9f02-655d15cf6a5c admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:41.506387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb1b9e-356e-4e01-ba6c-4498f2eea661 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:41.512771 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c68e35-ce8d-496d-bb5a-45b91693fcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:41.513676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c68e35-ce8d-496d-bb5a-45b91693fcbe admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:41.514083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c68e35-ce8d-496d-bb5a-45b91693fcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:41.514362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c68e35-ce8d-496d-bb5a-45b91693fcbe admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:41.515729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c68e35-ce8d-496d-bb5a-45b91693fcbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:41.521841 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c68e35-ce8d-496d-bb5a-45b91693fcbe admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:41.528029 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791d292-16bf-449f-b2fe-750a274c3d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:41.528641 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791d292-16bf-449f-b2fe-750a274c3d0e admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:41.528924 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791d292-16bf-449f-b2fe-750a274c3d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:41.529202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791d292-16bf-449f-b2fe-750a274c3d0e admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:41.529867 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791d292-16bf-449f-b2fe-750a274c3d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:41.532498 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791d292-16bf-449f-b2fe-750a274c3d0e admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:41.551343 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 974/1932] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:41 2022] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:45:41.552372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c68e35-ce8d-496d-bb5a-45b91693fcbe admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:41.556848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 959/1933] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:41 2022] POST /identity/v3/users => generated 303 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:45:41.558352 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791d292-16bf-449f-b2fe-750a274c3d0e admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:41.562816 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c68e35-ce8d-496d-bb5a-45b91693fcbe admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:41.567959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78629546-6068-4b85-93ba-14cec4e018f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:41.568546 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78629546-6068-4b85-93ba-14cec4e018f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:41.568813 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791d292-16bf-449f-b2fe-750a274c3d0e admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:41.568918 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78629546-6068-4b85-93ba-14cec4e018f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:41.569080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78629546-6068-4b85-93ba-14cec4e018f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:41.569779 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78629546-6068-4b85-93ba-14cec4e018f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:41.571481 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78629546-6068-4b85-93ba-14cec4e018f0 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:41.573560 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ccb45-8f41-4bfb-85aa-9f6f3b085c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:41.574153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ccb45-8f41-4bfb-85aa-9f6f3b085c56 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:41.574437 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ccb45-8f41-4bfb-85aa-9f6f3b085c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:41.574714 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ccb45-8f41-4bfb-85aa-9f6f3b085c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:41.575354 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ccb45-8f41-4bfb-85aa-9f6f3b085c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:41.577108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ccb45-8f41-4bfb-85aa-9f6f3b085c56 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:41.585411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 975/1934] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:45:41.587009 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78629546-6068-4b85-93ba-14cec4e018f0 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:41.588108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 960/1935] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:45:41.592169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ccb45-8f41-4bfb-85aa-9f6f3b085c56 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:41.599796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78629546-6068-4b85-93ba-14cec4e018f0 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:41.602348 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ccb45-8f41-4bfb-85aa-9f6f3b085c56 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:41.605874 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22a16a-2b26-42a9-9503-3a92b604980f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:41.606809 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22a16a-2b26-42a9-9503-3a92b604980f admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:41.607094 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791912b5-7217-4595-8d24-5287f7502667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:41.607589 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22a16a-2b26-42a9-9503-3a92b604980f admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:41.607766 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791912b5-7217-4595-8d24-5287f7502667 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:41.608033 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791912b5-7217-4595-8d24-5287f7502667 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:41.608308 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791912b5-7217-4595-8d24-5287f7502667 admin admin] PATH_INFO: `/v3/projects/18b8b49905e34c3fb69ee10687db0780/users/a5fe3fd06dc74a639b8b764e9e106b98/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:41.608699 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22a16a-2b26-42a9-9503-3a92b604980f admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:41.609619 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22a16a-2b26-42a9-9503-3a92b604980f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:41.613081 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22a16a-2b26-42a9-9503-3a92b604980f admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:41.625728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791912b5-7217-4595-8d24-5287f7502667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b8b49905e34c3fb69ee10687db0780, user_id=a5fe3fd06dc74a639b8b764e9e106b98, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:41.628371 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791912b5-7217-4595-8d24-5287f7502667 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:41.629332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 976/1936] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:45:41.633580 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22a16a-2b26-42a9-9503-3a92b604980f admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:41.645329 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 961/1937] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:41 2022] PUT /identity/v3/projects/18b8b49905e34c3fb69ee10687db0780/users/a5fe3fd06dc74a639b8b764e9e106b98/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:41.646311 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22a16a-2b26-42a9-9503-3a92b604980f admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:41.649517 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791912b5-7217-4595-8d24-5287f7502667 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:41.664297 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:41.717961 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791912b5-7217-4595-8d24-5287f7502667 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:41.724178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d58f6-a1bb-41f0-a56d-5d6fe729ddea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:41.724805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d58f6-a1bb-41f0-a56d-5d6fe729ddea admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:41.724911 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b47aa-9f6c-4b9a-b899-d5d8002cc4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:41.725118 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d58f6-a1bb-41f0-a56d-5d6fe729ddea admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:41.725342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d58f6-a1bb-41f0-a56d-5d6fe729ddea admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:41.725526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b47aa-9f6c-4b9a-b899-d5d8002cc4f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:41.725814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b47aa-9f6c-4b9a-b899-d5d8002cc4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:41.726067 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b47aa-9f6c-4b9a-b899-d5d8002cc4f0 admin admin] PATH_INFO: `/v3/projects/cc11af1282fe47b6b0d92af19c1e018c/users/8535df3ffe6c424e9b2674b25dbb5c47/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:41.726647 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d58f6-a1bb-41f0-a56d-5d6fe729ddea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:41.728261 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d58f6-a1bb-41f0-a56d-5d6fe729ddea admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:41.742894 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 962/1938] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:41.744497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d58f6-a1bb-41f0-a56d-5d6fe729ddea admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:41.753717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b47aa-9f6c-4b9a-b899-d5d8002cc4f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc11af1282fe47b6b0d92af19c1e018c, user_id=8535df3ffe6c424e9b2674b25dbb5c47, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:41.754853 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d58f6-a1bb-41f0-a56d-5d6fe729ddea admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:41.756661 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b47aa-9f6c-4b9a-b899-d5d8002cc4f0 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:41.759676 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3e332-72cc-45c1-a4ec-07cdbc86e689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:41.760338 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3e332-72cc-45c1-a4ec-07cdbc86e689 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:41.760613 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3e332-72cc-45c1-a4ec-07cdbc86e689 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:41.761199 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3e332-72cc-45c1-a4ec-07cdbc86e689 admin admin] PATH_INFO: `/v3/projects/18b8b49905e34c3fb69ee10687db0780/users/a5fe3fd06dc74a639b8b764e9e106b98/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:41.763322 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3e332-72cc-45c1-a4ec-07cdbc86e689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b8b49905e34c3fb69ee10687db0780, user_id=a5fe3fd06dc74a639b8b764e9e106b98, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:41.766618 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3e332-72cc-45c1-a4ec-07cdbc86e689 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:41.777557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 977/1939] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:41 2022] PUT /identity/v3/projects/cc11af1282fe47b6b0d92af19c1e018c/users/8535df3ffe6c424e9b2674b25dbb5c47/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:45:41.782003 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 963/1940] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:41 2022] PUT /identity/v3/projects/18b8b49905e34c3fb69ee10687db0780/users/a5fe3fd06dc74a639b8b764e9e106b98/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:45:41.785651 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120852f-54e0-4645-a27a-ff3b20b66863 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:41.785938 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120852f-54e0-4645-a27a-ff3b20b66863 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:41.786213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120852f-54e0-4645-a27a-ff3b20b66863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:41.792536 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae6159-9a47-439e-9fa7-c27ece8b34f7 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:41.793104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae6159-9a47-439e-9fa7-c27ece8b34f7 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:41.793612 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae6159-9a47-439e-9fa7-c27ece8b34f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:41.824858 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-f120852f-54e0-4645-a27a-ff3b20b66863 None None] MFA Rules not processed for user `8535df3ffe6c424e9b2674b25dbb5c47`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:41.826887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f120852f-54e0-4645-a27a-ff3b20b66863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:41.832424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-4fae6159-9a47-439e-9fa7-c27ece8b34f7 None None] MFA Rules not processed for user `a5fe3fd06dc74a639b8b764e9e106b98`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:41.833702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-4fae6159-9a47-439e-9fa7-c27ece8b34f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:41.914027 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:41.939716 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 978/1941] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:41.944281 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120852f-54e0-4645-a27a-ff3b20b66863 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:42.017087 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 964/1942] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:41 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:45:42.042773 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae6159-9a47-439e-9fa7-c27ece8b34f7 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:42.044172 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-4fae6159-9a47-439e-9fa7-c27ece8b34f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:42.085442 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120852f-54e0-4645-a27a-ff3b20b66863 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:42.090998 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cacc05-3071-415a-89da-2b3621f37a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:42.091657 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cacc05-3071-415a-89da-2b3621f37a08 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:42.091987 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cacc05-3071-415a-89da-2b3621f37a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:42.093214 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cacc05-3071-415a-89da-2b3621f37a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:42.094489 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cacc05-3071-415a-89da-2b3621f37a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:42.097004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cacc05-3071-415a-89da-2b3621f37a08 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:42.196778 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 979/1943] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:41 2022] POST /identity/v3/projects => generated 387 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:45:42.197854 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cacc05-3071-415a-89da-2b3621f37a08 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:42.210611 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-44cacc05-3071-415a-89da-2b3621f37a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:42.238729 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae6159-9a47-439e-9fa7-c27ece8b34f7 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:42.304299 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:42.336506 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cacc05-3071-415a-89da-2b3621f37a08 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:42.344026 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a5790-00a7-4239-a2be-4bf07ac4b825 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:42.346811 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a5790-00a7-4239-a2be-4bf07ac4b825 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:42.347100 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a5790-00a7-4239-a2be-4bf07ac4b825 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:42.347373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a5790-00a7-4239-a2be-4bf07ac4b825 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:42.376845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2a793-c80e-4ee5-9e3e-af58a886b1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:42.378580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2a793-c80e-4ee5-9e3e-af58a886b1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:42.379087 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2a793-c80e-4ee5-9e3e-af58a886b1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:42.380554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2a793-c80e-4ee5-9e3e-af58a886b1f0 admin admin] PATH_INFO: `/v3/users/bbcb171f5fcf47e3984fff5d6cf77fc3` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:42.386118 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2a793-c80e-4ee5-9e3e-af58a886b1f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbcb171f5fcf47e3984fff5d6cf77fc3)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:42.389254 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2a793-c80e-4ee5-9e3e-af58a886b1f0 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:42.471451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-45f2a793-c80e-4ee5-9e3e-af58a886b1f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbcb171f5fcf47e3984fff5d6cf77fc3'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:42.472316 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-45f2a793-c80e-4ee5-9e3e-af58a886b1f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbcb171f5fcf47e3984fff5d6cf77fc3'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:42.474702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-45f2a793-c80e-4ee5-9e3e-af58a886b1f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbcb171f5fcf47e3984fff5d6cf77fc3'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:42.498778 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-45f2a793-c80e-4ee5-9e3e-af58a886b1f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbcb171f5fcf47e3984fff5d6cf77fc3'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:42.509027 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-45f2a793-c80e-4ee5-9e3e-af58a886b1f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbcb171f5fcf47e3984fff5d6cf77fc3'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:42.526812 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 965/1944] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:42 2022] DELETE /identity/v3/users/bbcb171f5fcf47e3984fff5d6cf77fc3 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:45:42.526812 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2a793-c80e-4ee5-9e3e-af58a886b1f0 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:42.527532 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a5790-00a7-4239-a2be-4bf07ac4b825 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:42.528627 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-45f2a793-c80e-4ee5-9e3e-af58a886b1f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:42.532456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a5790-00a7-4239-a2be-4bf07ac4b825 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:42.575600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 980/1945] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:42 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:42.577112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d004c-71de-470b-a35b-31245222b651 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:42.577509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d004c-71de-470b-a35b-31245222b651 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:42.582274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d004c-71de-470b-a35b-31245222b651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:42.625970 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2a793-c80e-4ee5-9e3e-af58a886b1f0 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:42.633286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276b04f-6602-461f-8273-16d262fea4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:42.634223 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276b04f-6602-461f-8273-16d262fea4d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:42.634755 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276b04f-6602-461f-8273-16d262fea4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:42.635100 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276b04f-6602-461f-8273-16d262fea4d3 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:42.635970 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276b04f-6602-461f-8273-16d262fea4d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:42.638845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276b04f-6602-461f-8273-16d262fea4d3 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:42.663437 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-df3d004c-71de-470b-a35b-31245222b651 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:42.666070 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 966/1946] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:42 2022] POST /identity/v3/users => generated 294 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:42.668373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-df3d004c-71de-470b-a35b-31245222b651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:42.671699 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276b04f-6602-461f-8273-16d262fea4d3 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:42.686500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276b04f-6602-461f-8273-16d262fea4d3 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:42.694905 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d0799-ff0f-48b4-b3b3-3b271c466104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:42.696161 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d0799-ff0f-48b4-b3b3-3b271c466104 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:42.696627 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d0799-ff0f-48b4-b3b3-3b271c466104 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:42.697057 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d0799-ff0f-48b4-b3b3-3b271c466104 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:42.698075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d0799-ff0f-48b4-b3b3-3b271c466104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:42.700402 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d0799-ff0f-48b4-b3b3-3b271c466104 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:42.704353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 981/1947] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:42.705378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d004c-71de-470b-a35b-31245222b651 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:42.708804 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-df3d004c-71de-470b-a35b-31245222b651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:42.719563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 967/1948] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:42.726851 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d0799-ff0f-48b4-b3b3-3b271c466104 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:42.752538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d0799-ff0f-48b4-b3b3-3b271c466104 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:42.768459 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53462120-e39f-41b1-90ff-98bc63dde0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:42.769080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53462120-e39f-41b1-90ff-98bc63dde0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:42.769367 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53462120-e39f-41b1-90ff-98bc63dde0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:42.770241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53462120-e39f-41b1-90ff-98bc63dde0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:42.770891 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53462120-e39f-41b1-90ff-98bc63dde0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:42.773076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53462120-e39f-41b1-90ff-98bc63dde0b9 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:42.775001 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:42.799330 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 968/1949] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:45:42.801343 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53462120-e39f-41b1-90ff-98bc63dde0b9 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:42.804822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-53462120-e39f-41b1-90ff-98bc63dde0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:42.835062 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:42.859879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d004c-71de-470b-a35b-31245222b651 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:42.871997 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6220b1-fac0-415b-8959-7703ed369382 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:42.873120 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6220b1-fac0-415b-8959-7703ed369382 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:42.873120 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6220b1-fac0-415b-8959-7703ed369382 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:42.873306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6220b1-fac0-415b-8959-7703ed369382 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:42.878263 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-ec6220b1-fac0-415b-8959-7703ed369382 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:42.917932 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53462120-e39f-41b1-90ff-98bc63dde0b9 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:42.924201 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf719fe-c95f-4d9f-8d7f-06f2e8235a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:42.925057 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf719fe-c95f-4d9f-8d7f-06f2e8235a4f service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:42.925565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf719fe-c95f-4d9f-8d7f-06f2e8235a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:42.926023 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf719fe-c95f-4d9f-8d7f-06f2e8235a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:42.939363 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf719fe-c95f-4d9f-8d7f-06f2e8235a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:42.943953 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf719fe-c95f-4d9f-8d7f-06f2e8235a4f service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:42.956903 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 969/1950] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:42.958309 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf719fe-c95f-4d9f-8d7f-06f2e8235a4f service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:42.982510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf719fe-c95f-4d9f-8d7f-06f2e8235a4f service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:42.988702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ece02-3df0-45df-b2a7-61ee143a1616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:42.989790 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ece02-3df0-45df-b2a7-61ee143a1616 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:42.990396 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ece02-3df0-45df-b2a7-61ee143a1616 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:42.990862 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ece02-3df0-45df-b2a7-61ee143a1616 admin admin] PATH_INFO: `/v3/projects/170bc190fac54bd8b9be943ce2d54c13/users/222fc392471e4b43abf8201b3d856ceb/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:43.009975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ece02-3df0-45df-b2a7-61ee143a1616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=170bc190fac54bd8b9be943ce2d54c13, user_id=222fc392471e4b43abf8201b3d856ceb, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:43.013284 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ece02-3df0-45df-b2a7-61ee143a1616 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:43.017156 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6220b1-fac0-415b-8959-7703ed369382 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:43.019166 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6220b1-fac0-415b-8959-7703ed369382 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:43.039323 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 982/1951] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:42 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:43.053563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 970/1952] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:42 2022] PUT /identity/v3/projects/170bc190fac54bd8b9be943ce2d54c13/users/222fc392471e4b43abf8201b3d856ceb/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:43.053766 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722ae3c-b67a-4527-8428-f8c16a72f4f0 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:43.054068 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722ae3c-b67a-4527-8428-f8c16a72f4f0 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:43.054350 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722ae3c-b67a-4527-8428-f8c16a72f4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:43.116659 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-8722ae3c-b67a-4527-8428-f8c16a72f4f0 None None] MFA Rules not processed for user `222fc392471e4b43abf8201b3d856ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:43.118231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-8722ae3c-b67a-4527-8428-f8c16a72f4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:43.236986 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 983/1953] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:43.242862 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ece02-3df0-45df-b2a7-61ee143a1616 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:43.412852 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ece02-3df0-45df-b2a7-61ee143a1616 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:43.422233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2da88-834a-4b8e-b895-25678794faaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:43.422896 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2da88-834a-4b8e-b895-25678794faaf admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:43.423179 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2da88-834a-4b8e-b895-25678794faaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:43.423453 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2da88-834a-4b8e-b895-25678794faaf admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:43.424103 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2da88-834a-4b8e-b895-25678794faaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:43.426068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2da88-834a-4b8e-b895-25678794faaf admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:43.490551 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722ae3c-b67a-4527-8428-f8c16a72f4f0 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:43.500409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 971/1954] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:43 2022] POST /identity/v3/projects => generated 387 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:43.511851 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722ae3c-b67a-4527-8428-f8c16a72f4f0 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:43.597687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25970791-f71d-4da9-a6fe-a2d2024b2584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:43.598406 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25970791-f71d-4da9-a6fe-a2d2024b2584 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:43.598657 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25970791-f71d-4da9-a6fe-a2d2024b2584 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:43.598936 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25970791-f71d-4da9-a6fe-a2d2024b2584 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:43.600035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25970791-f71d-4da9-a6fe-a2d2024b2584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:43.601954 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25970791-f71d-4da9-a6fe-a2d2024b2584 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:43.621217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:43.631009 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 984/1955] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:43 2022] POST /identity/v3/users => generated 300 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:43.634344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2da88-834a-4b8e-b895-25678794faaf admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:43.647097 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2da88-834a-4b8e-b895-25678794faaf admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:43.653418 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd5565-8f5a-48b2-bf96-afeaea331966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:43.654336 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd5565-8f5a-48b2-bf96-afeaea331966 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:43.654803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd5565-8f5a-48b2-bf96-afeaea331966 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:43.655264 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd5565-8f5a-48b2-bf96-afeaea331966 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:43.656531 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd5565-8f5a-48b2-bf96-afeaea331966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:43.658517 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd5565-8f5a-48b2-bf96-afeaea331966 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:43.670798 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 972/1956] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:43.676296 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25970791-f71d-4da9-a6fe-a2d2024b2584 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:43.690519 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25970791-f71d-4da9-a6fe-a2d2024b2584 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:43.696159 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97463a-0d9c-44fc-b400-8bde7795bfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:43.697075 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97463a-0d9c-44fc-b400-8bde7795bfa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:43.697202 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97463a-0d9c-44fc-b400-8bde7795bfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:43.697447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97463a-0d9c-44fc-b400-8bde7795bfa1 admin admin] PATH_INFO: `/v3/projects/e5aab4ecad0548bb9661f5957579d8f8/users/4731707f8d4542bbac0710a71f9bc77d/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:43.716915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97463a-0d9c-44fc-b400-8bde7795bfa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5aab4ecad0548bb9661f5957579d8f8, user_id=4731707f8d4542bbac0710a71f9bc77d, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:43.720689 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f97463a-0d9c-44fc-b400-8bde7795bfa1 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:43.745915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 985/1957] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:43 2022] PUT /identity/v3/projects/e5aab4ecad0548bb9661f5957579d8f8/users/4731707f8d4542bbac0710a71f9bc77d/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:43.751112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd5565-8f5a-48b2-bf96-afeaea331966 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:43.780262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd5565-8f5a-48b2-bf96-afeaea331966 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:43.892638 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c327d5-9226-4ad2-9152-10a1f92d2129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:43.893709 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c327d5-9226-4ad2-9152-10a1f92d2129 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:43.894382 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c327d5-9226-4ad2-9152-10a1f92d2129 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:43.894755 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c327d5-9226-4ad2-9152-10a1f92d2129 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:43.895513 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c327d5-9226-4ad2-9152-10a1f92d2129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:43.898093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c327d5-9226-4ad2-9152-10a1f92d2129 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:43.915132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 973/1958] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:43.917676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97463a-0d9c-44fc-b400-8bde7795bfa1 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:43.930866 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f97463a-0d9c-44fc-b400-8bde7795bfa1 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:43.954942 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d3585-76d6-412a-83c3-91d7caeac88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:43.955840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d3585-76d6-412a-83c3-91d7caeac88b admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:43.956241 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d3585-76d6-412a-83c3-91d7caeac88b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:43.959125 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d3585-76d6-412a-83c3-91d7caeac88b admin admin] PATH_INFO: `/v3/projects/e5aab4ecad0548bb9661f5957579d8f8/users/4731707f8d4542bbac0710a71f9bc77d/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:43.980619 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d3585-76d6-412a-83c3-91d7caeac88b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5aab4ecad0548bb9661f5957579d8f8, user_id=4731707f8d4542bbac0710a71f9bc77d, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:43.988876 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d3585-76d6-412a-83c3-91d7caeac88b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:44.032390 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 986/1959] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:43 2022] PUT /identity/v3/projects/e5aab4ecad0548bb9661f5957579d8f8/users/4731707f8d4542bbac0710a71f9bc77d/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:44.042712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3ebcf-eb64-448e-838e-9e137470fadd None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:44.043006 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3ebcf-eb64-448e-838e-9e137470fadd None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:44.043716 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3ebcf-eb64-448e-838e-9e137470fadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:44.061821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:44.111046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-bfa3ebcf-eb64-448e-838e-9e137470fadd None None] MFA Rules not processed for user `4731707f8d4542bbac0710a71f9bc77d`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:44.112357 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-bfa3ebcf-eb64-448e-838e-9e137470fadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:44.227321 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 974/1960] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:44 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:44.237812 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d3585-76d6-412a-83c3-91d7caeac88b admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:44.239679 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-568d3585-76d6-412a-83c3-91d7caeac88b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:44.284170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3ebcf-eb64-448e-838e-9e137470fadd None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:44.286820 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-bfa3ebcf-eb64-448e-838e-9e137470fadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:44.352986 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d3585-76d6-412a-83c3-91d7caeac88b admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:44.361192 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051e8b8-ec41-4ed1-ae6b-66c1f2f52c67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:44.362165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051e8b8-ec41-4ed1-ae6b-66c1f2f52c67 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:44.362711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051e8b8-ec41-4ed1-ae6b-66c1f2f52c67 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:44.364550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051e8b8-ec41-4ed1-ae6b-66c1f2f52c67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:44.403672 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3ebcf-eb64-448e-838e-9e137470fadd None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:44.413778 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b30d1-1eca-485c-b359-2c37d5febbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:44.415018 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b30d1-1eca-485c-b359-2c37d5febbc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:44.415353 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b30d1-1eca-485c-b359-2c37d5febbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:44.415692 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b30d1-1eca-485c-b359-2c37d5febbc9 admin admin] PATH_INFO: `/v3/projects/bf714770cb01440aaa5c6b5017a7b635` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:44.417653 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b30d1-1eca-485c-b359-2c37d5febbc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf714770cb01440aaa5c6b5017a7b635)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:44.419999 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b30d1-1eca-485c-b359-2c37d5febbc9 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:44.450983 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051e8b8-ec41-4ed1-ae6b-66c1f2f52c67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:44.454357 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051e8b8-ec41-4ed1-ae6b-66c1f2f52c67 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:44.500999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 987/1961] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:44 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:44.549939 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-716b30d1-1eca-485c-b359-2c37d5febbc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf714770cb01440aaa5c6b5017a7b635', 'request_id': 'req-716b30d1-1eca-485c-b359-2c37d5febbc9'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:44.576096 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-716b30d1-1eca-485c-b359-2c37d5febbc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf714770cb01440aaa5c6b5017a7b635', 'request_id': 'req-716b30d1-1eca-485c-b359-2c37d5febbc9'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:44.595572 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-716b30d1-1eca-485c-b359-2c37d5febbc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf714770cb01440aaa5c6b5017a7b635', 'request_id': 'req-716b30d1-1eca-485c-b359-2c37d5febbc9'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:44.616845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-716b30d1-1eca-485c-b359-2c37d5febbc9 admin admin] The token cache is being invalidate because project bf714770cb01440aaa5c6b5017a7b635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:44.617763 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-716b30d1-1eca-485c-b359-2c37d5febbc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:44.618768 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-716b30d1-1eca-485c-b359-2c37d5febbc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:44.621332 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 975/1962] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:44 2022] DELETE /identity/v3/projects/bf714770cb01440aaa5c6b5017a7b635 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:44.625455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051e8b8-ec41-4ed1-ae6b-66c1f2f52c67 service cinder] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:44.638107 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051e8b8-ec41-4ed1-ae6b-66c1f2f52c67 service cinder] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:44.734983 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41eaf02-20b2-4350-818d-9536835d9291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:44.735579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41eaf02-20b2-4350-818d-9536835d9291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:44.736317 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41eaf02-20b2-4350-818d-9536835d9291 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:44.736630 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41eaf02-20b2-4350-818d-9536835d9291 admin admin] PATH_INFO: `/v3/users/b73f58c24c254d69b414f5e88b31afde` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:44.737964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41eaf02-20b2-4350-818d-9536835d9291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b73f58c24c254d69b414f5e88b31afde)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:44.739887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41eaf02-20b2-4350-818d-9536835d9291 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:44.844982 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-a41eaf02-20b2-4350-818d-9536835d9291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b73f58c24c254d69b414f5e88b31afde'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:44.845706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-a41eaf02-20b2-4350-818d-9536835d9291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b73f58c24c254d69b414f5e88b31afde'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:44.868421 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-a41eaf02-20b2-4350-818d-9536835d9291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b73f58c24c254d69b414f5e88b31afde'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:44.871498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:44.880845 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-a41eaf02-20b2-4350-818d-9536835d9291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b73f58c24c254d69b414f5e88b31afde'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:44.893259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-a41eaf02-20b2-4350-818d-9536835d9291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b73f58c24c254d69b414f5e88b31afde'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:44.906056 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 988/1963] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:44 2022] DELETE /identity/v3/users/b73f58c24c254d69b414f5e88b31afde => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:45.280998 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b30d1-1eca-485c-b359-2c37d5febbc9 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:45.282799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-716b30d1-1eca-485c-b359-2c37d5febbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:45.309949 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b30d1-1eca-485c-b359-2c37d5febbc9 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:45.346147 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:45.376560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41eaf02-20b2-4350-818d-9536835d9291 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:45.378101 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a41eaf02-20b2-4350-818d-9536835d9291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:45.406111 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8436630-758b-4aac-a6e3-7e69e216bc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:45.406758 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8436630-758b-4aac-a6e3-7e69e216bc82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:45.407045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8436630-758b-4aac-a6e3-7e69e216bc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:45.407317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8436630-758b-4aac-a6e3-7e69e216bc82 admin admin] PATH_INFO: `/v3/projects/bc35c343cd6f42aeb1ed3d937eb42a4a` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:45.412069 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8436630-758b-4aac-a6e3-7e69e216bc82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc35c343cd6f42aeb1ed3d937eb42a4a)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:45.412069 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8436630-758b-4aac-a6e3-7e69e216bc82 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:45.454532 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41eaf02-20b2-4350-818d-9536835d9291 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:45.464800 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-e8436630-758b-4aac-a6e3-7e69e216bc82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc35c343cd6f42aeb1ed3d937eb42a4a', 'request_id': 'req-e8436630-758b-4aac-a6e3-7e69e216bc82'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:45.475215 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-e8436630-758b-4aac-a6e3-7e69e216bc82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc35c343cd6f42aeb1ed3d937eb42a4a', 'request_id': 'req-e8436630-758b-4aac-a6e3-7e69e216bc82'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:45.483093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-e8436630-758b-4aac-a6e3-7e69e216bc82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc35c343cd6f42aeb1ed3d937eb42a4a', 'request_id': 'req-e8436630-758b-4aac-a6e3-7e69e216bc82'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:45.496825 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-e8436630-758b-4aac-a6e3-7e69e216bc82 admin admin] The token cache is being invalidate because project bc35c343cd6f42aeb1ed3d937eb42a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:45.497545 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-e8436630-758b-4aac-a6e3-7e69e216bc82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:45.498177 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-e8436630-758b-4aac-a6e3-7e69e216bc82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:45.500115 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 976/1964] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:45 2022] DELETE /identity/v3/projects/bc35c343cd6f42aeb1ed3d937eb42a4a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:45.504463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23089dc3-b582-4a5b-815e-0070d555e11b None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:45.504739 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23089dc3-b582-4a5b-815e-0070d555e11b None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:45.505386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23089dc3-b582-4a5b-815e-0070d555e11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:45.516908 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0f621-7923-4368-a372-e44fe34b269e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:45.517638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0f621-7923-4368-a372-e44fe34b269e service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:45.517991 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0f621-7923-4368-a372-e44fe34b269e service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:45.518368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0f621-7923-4368-a372-e44fe34b269e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:45.520358 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-6db0f621-7923-4368-a372-e44fe34b269e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:45.529829 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-23089dc3-b582-4a5b-815e-0070d555e11b None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:45.530570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-23089dc3-b582-4a5b-815e-0070d555e11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:45.600339 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0f621-7923-4368-a372-e44fe34b269e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:45.601807 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0f621-7923-4368-a372-e44fe34b269e service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:45.603215 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 977/1965] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:45.612063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575f835-ba4e-4a56-8883-80d2fc1972b9 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:45.612352 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575f835-ba4e-4a56-8883-80d2fc1972b9 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:45.612692 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575f835-ba4e-4a56-8883-80d2fc1972b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:45.616422 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 989/1966] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:45:45.641132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-0575f835-ba4e-4a56-8883-80d2fc1972b9 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:45.641277 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-0575f835-ba4e-4a56-8883-80d2fc1972b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:45.649435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 978/1967] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:45:45.653755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0f621-7923-4368-a372-e44fe34b269e service cinder] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:45.667369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0f621-7923-4368-a372-e44fe34b269e service cinder] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:45.672627 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16784761-805b-4878-81e7-504f5d47f37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:45.673241 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16784761-805b-4878-81e7-504f5d47f37f admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:45.673570 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16784761-805b-4878-81e7-504f5d47f37f admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:45.673846 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16784761-805b-4878-81e7-504f5d47f37f admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:45.674505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16784761-805b-4878-81e7-504f5d47f37f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:45.674829 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16784761-805b-4878-81e7-504f5d47f37f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:45.676452 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16784761-805b-4878-81e7-504f5d47f37f admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:45.691609 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 990/1968] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:45.696662 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575f835-ba4e-4a56-8883-80d2fc1972b9 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:45.707424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575f835-ba4e-4a56-8883-80d2fc1972b9 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:45.712529 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b3c10-ec0f-488a-984d-44cd58010451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:45.713167 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b3c10-ec0f-488a-984d-44cd58010451 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:45.715315 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b3c10-ec0f-488a-984d-44cd58010451 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:45.715663 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b3c10-ec0f-488a-984d-44cd58010451 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:45.716347 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b3c10-ec0f-488a-984d-44cd58010451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:45.719000 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b3c10-ec0f-488a-984d-44cd58010451 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:45.774801 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 979/1969] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:45 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:45.776016 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16784761-805b-4878-81e7-504f5d47f37f admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:45.793964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16784761-805b-4878-81e7-504f5d47f37f admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:45.889720 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:45.943986 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53780d4d-466b-4964-a505-1ae11686ca32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:45.944691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53780d4d-466b-4964-a505-1ae11686ca32 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:45.945225 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53780d4d-466b-4964-a505-1ae11686ca32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:45.945343 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53780d4d-466b-4964-a505-1ae11686ca32 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:45.946001 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53780d4d-466b-4964-a505-1ae11686ca32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:45.948019 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53780d4d-466b-4964-a505-1ae11686ca32 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:45.977529 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 991/1970] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:45 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:45.984773 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b3c10-ec0f-488a-984d-44cd58010451 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:46.013302 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b3c10-ec0f-488a-984d-44cd58010451 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:46.018665 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3a642-e5aa-4880-ae31-2e2c43d7355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:46.019662 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3a642-e5aa-4880-ae31-2e2c43d7355f admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:46.019825 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3a642-e5aa-4880-ae31-2e2c43d7355f admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:46.020633 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3a642-e5aa-4880-ae31-2e2c43d7355f admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:46.021719 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3a642-e5aa-4880-ae31-2e2c43d7355f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:46.021854 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53780d4d-466b-4964-a505-1ae11686ca32 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:46.023968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-53780d4d-466b-4964-a505-1ae11686ca32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:46.024077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3a642-e5aa-4880-ae31-2e2c43d7355f admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:46.041648 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 980/1971] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:46.041871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3a642-e5aa-4880-ae31-2e2c43d7355f admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:46.052589 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3a642-e5aa-4880-ae31-2e2c43d7355f admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:46.054358 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53780d4d-466b-4964-a505-1ae11686ca32 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:46.057832 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92659a61-b231-46ba-a577-d0b7222c5dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:46.058651 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92659a61-b231-46ba-a577-d0b7222c5dab admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:46.059255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92659a61-b231-46ba-a577-d0b7222c5dab admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:46.059532 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92659a61-b231-46ba-a577-d0b7222c5dab admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:46.060419 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92659a61-b231-46ba-a577-d0b7222c5dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:46.063127 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92659a61-b231-46ba-a577-d0b7222c5dab admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:46.064880 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07840b47-02f4-4f0e-b02c-ce866ee0c750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:46.065956 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07840b47-02f4-4f0e-b02c-ce866ee0c750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:46.066434 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07840b47-02f4-4f0e-b02c-ce866ee0c750 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:46.066865 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07840b47-02f4-4f0e-b02c-ce866ee0c750 admin admin] PATH_INFO: `/v3/users/7ec38333535b4f02b46c4fb62d81ebb6` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:46.068428 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07840b47-02f4-4f0e-b02c-ce866ee0c750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ec38333535b4f02b46c4fb62d81ebb6)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:46.070712 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07840b47-02f4-4f0e-b02c-ce866ee0c750 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:46.071262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:46.078758 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 981/1972] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:46.083785 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92659a61-b231-46ba-a577-d0b7222c5dab admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:46.100950 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92659a61-b231-46ba-a577-d0b7222c5dab admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:46.107889 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced2c67-773b-46a2-8ec0-7a67b4880431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:46.108756 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced2c67-773b-46a2-8ec0-7a67b4880431 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:46.109081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced2c67-773b-46a2-8ec0-7a67b4880431 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:46.109385 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced2c67-773b-46a2-8ec0-7a67b4880431 admin admin] PATH_INFO: `/v3/projects/90ff51a42677491996d520e7b39928e6/users/14b32262772743b4a62a524edf3dc66e/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:46.131890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced2c67-773b-46a2-8ec0-7a67b4880431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ff51a42677491996d520e7b39928e6, user_id=14b32262772743b4a62a524edf3dc66e, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:46.134608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced2c67-773b-46a2-8ec0-7a67b4880431 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:46.144015 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-07840b47-02f4-4f0e-b02c-ce866ee0c750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ec38333535b4f02b46c4fb62d81ebb6'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:46.147135 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-07840b47-02f4-4f0e-b02c-ce866ee0c750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ec38333535b4f02b46c4fb62d81ebb6'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:46.149102 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 982/1973] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:46 2022] PUT /identity/v3/projects/90ff51a42677491996d520e7b39928e6/users/14b32262772743b4a62a524edf3dc66e/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:45:46.160679 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f47d1-da5a-491a-af31-d40d1eddcebe None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:46.160976 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f47d1-da5a-491a-af31-d40d1eddcebe None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:46.161291 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f47d1-da5a-491a-af31-d40d1eddcebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:46.175557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-07840b47-02f4-4f0e-b02c-ce866ee0c750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ec38333535b4f02b46c4fb62d81ebb6'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:46.188195 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-07840b47-02f4-4f0e-b02c-ce866ee0c750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ec38333535b4f02b46c4fb62d81ebb6'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:46.196948 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-a54f47d1-da5a-491a-af31-d40d1eddcebe None None] MFA Rules not processed for user `14b32262772743b4a62a524edf3dc66e`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:46.198774 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-07840b47-02f4-4f0e-b02c-ce866ee0c750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ec38333535b4f02b46c4fb62d81ebb6'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:46.202191 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-a54f47d1-da5a-491a-af31-d40d1eddcebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:46.211794 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 992/1974] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:46 2022] DELETE /identity/v3/users/7ec38333535b4f02b46c4fb62d81ebb6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:46.216186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb98bb-c2cd-4c4c-b9f0-e1ea49a6efae None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:46.216498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb98bb-c2cd-4c4c-b9f0-e1ea49a6efae None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:46.216752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb98bb-c2cd-4c4c-b9f0-e1ea49a6efae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:46.242163 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-50fb98bb-c2cd-4c4c-b9f0-e1ea49a6efae None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:46.244066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-50fb98bb-c2cd-4c4c-b9f0-e1ea49a6efae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:46.303504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 983/1975] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:46.304917 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f47d1-da5a-491a-af31-d40d1eddcebe None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:46.306511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-a54f47d1-da5a-491a-af31-d40d1eddcebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:46.333964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 993/1976] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:46.342318 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb98bb-c2cd-4c4c-b9f0-e1ea49a6efae None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:46.344828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-50fb98bb-c2cd-4c4c-b9f0-e1ea49a6efae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:46.398018 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f47d1-da5a-491a-af31-d40d1eddcebe None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:46.403714 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2551f0e-2779-47ea-b516-cd41c859d1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:46.404452 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2551f0e-2779-47ea-b516-cd41c859d1ff admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:46.404834 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2551f0e-2779-47ea-b516-cd41c859d1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:46.405206 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2551f0e-2779-47ea-b516-cd41c859d1ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:46.406079 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2551f0e-2779-47ea-b516-cd41c859d1ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:46.406745 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:46.408345 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2551f0e-2779-47ea-b516-cd41c859d1ff admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:46.425966 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb98bb-c2cd-4c4c-b9f0-e1ea49a6efae None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:46.432352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa9f3b-ebd3-4ca2-8f86-f80fcbe5f24a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:46.432352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa9f3b-ebd3-4ca2-8f86-f80fcbe5f24a service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:46.432352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa9f3b-ebd3-4ca2-8f86-f80fcbe5f24a service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:46.432352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa9f3b-ebd3-4ca2-8f86-f80fcbe5f24a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:46.446335 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa9f3b-ebd3-4ca2-8f86-f80fcbe5f24a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:46.448491 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa9f3b-ebd3-4ca2-8f86-f80fcbe5f24a service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:46.450808 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 984/1977] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:46 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:46.455905 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2551f0e-2779-47ea-b516-cd41c859d1ff admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:46.468918 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 994/1978] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:46.527185 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:46.552306 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2551f0e-2779-47ea-b516-cd41c859d1ff admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:46.567403 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024d5b4-bd4f-4f90-9469-baeed4a34be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:46.567838 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024d5b4-bd4f-4f90-9469-baeed4a34be6 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:46.568110 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024d5b4-bd4f-4f90-9469-baeed4a34be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:46.568382 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024d5b4-bd4f-4f90-9469-baeed4a34be6 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:46.569063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024d5b4-bd4f-4f90-9469-baeed4a34be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:46.571142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024d5b4-bd4f-4f90-9469-baeed4a34be6 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:46.603844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 985/1979] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:46 2022] POST /identity/v3/users => generated 298 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:46.607898 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa9f3b-ebd3-4ca2-8f86-f80fcbe5f24a service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:46.618645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa9f3b-ebd3-4ca2-8f86-f80fcbe5f24a service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:46.630876 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d42ff-10ac-4142-8b55-734bf07d5ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:46.631637 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d42ff-10ac-4142-8b55-734bf07d5ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:46.631923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d42ff-10ac-4142-8b55-734bf07d5ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:46.632199 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d42ff-10ac-4142-8b55-734bf07d5ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:46.633210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d42ff-10ac-4142-8b55-734bf07d5ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:46.636115 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d42ff-10ac-4142-8b55-734bf07d5ae2 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:46.648517 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 995/1980] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:46.652524 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024d5b4-bd4f-4f90-9469-baeed4a34be6 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:46.663830 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024d5b4-bd4f-4f90-9469-baeed4a34be6 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:46.668335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066f989-be43-4553-a889-1edf422e559f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:46.668983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066f989-be43-4553-a889-1edf422e559f admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:46.669261 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066f989-be43-4553-a889-1edf422e559f admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:46.669588 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066f989-be43-4553-a889-1edf422e559f admin admin] PATH_INFO: `/v3/projects/ab31448fd7ab46eb946cfbaf41aa44ad/users/09ac1017fa9e41518f0daedb73046a26/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:46.689304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066f989-be43-4553-a889-1edf422e559f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab31448fd7ab46eb946cfbaf41aa44ad, user_id=09ac1017fa9e41518f0daedb73046a26, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:46.692366 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066f989-be43-4553-a889-1edf422e559f admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:46.711516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 986/1981] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:46 2022] PUT /identity/v3/projects/ab31448fd7ab46eb946cfbaf41aa44ad/users/09ac1017fa9e41518f0daedb73046a26/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:46.712780 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d42ff-10ac-4142-8b55-734bf07d5ae2 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:46.725276 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d42ff-10ac-4142-8b55-734bf07d5ae2 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:46.788196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b23e65-922c-4c5b-963b-684756820f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:46.788805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b23e65-922c-4c5b-963b-684756820f71 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:46.789082 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b23e65-922c-4c5b-963b-684756820f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:46.789353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b23e65-922c-4c5b-963b-684756820f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:46.790128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b23e65-922c-4c5b-963b-684756820f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:46.792157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b23e65-922c-4c5b-963b-684756820f71 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:46.804710 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 996/1982] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:46.809221 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066f989-be43-4553-a889-1edf422e559f admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:46.818679 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b23e65-922c-4c5b-963b-684756820f71 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:46.820483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-82b23e65-922c-4c5b-963b-684756820f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:46.821369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066f989-be43-4553-a889-1edf422e559f admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:46.826512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4b883-4109-423b-8708-e00d17ea2d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:46.828341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4b883-4109-423b-8708-e00d17ea2d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:46.828967 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4b883-4109-423b-8708-e00d17ea2d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:46.829247 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4b883-4109-423b-8708-e00d17ea2d78 admin admin] PATH_INFO: `/v3/projects/ab31448fd7ab46eb946cfbaf41aa44ad/users/09ac1017fa9e41518f0daedb73046a26/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:46.831389 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4b883-4109-423b-8708-e00d17ea2d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab31448fd7ab46eb946cfbaf41aa44ad, user_id=09ac1017fa9e41518f0daedb73046a26, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:46.836636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4b883-4109-423b-8708-e00d17ea2d78 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:46.838055 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b23e65-922c-4c5b-963b-684756820f71 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:46.844331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714d6f3-c3d1-4ece-8dbe-efabdbb6a89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:46.846468 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714d6f3-c3d1-4ece-8dbe-efabdbb6a89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:46.846784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714d6f3-c3d1-4ece-8dbe-efabdbb6a89e admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:46.847075 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714d6f3-c3d1-4ece-8dbe-efabdbb6a89e admin admin] PATH_INFO: `/v3/projects/bbedcde7fcb347ecbced0efe722d1e68` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:46.848793 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714d6f3-c3d1-4ece-8dbe-efabdbb6a89e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbedcde7fcb347ecbced0efe722d1e68)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:46.850798 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714d6f3-c3d1-4ece-8dbe-efabdbb6a89e admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:46.852770 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 987/1983] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:46 2022] PUT /identity/v3/projects/ab31448fd7ab46eb946cfbaf41aa44ad/users/09ac1017fa9e41518f0daedb73046a26/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:45:46.863852 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89df4a-a292-4dd5-accd-2a6188fb3cb6 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:46.864141 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89df4a-a292-4dd5-accd-2a6188fb3cb6 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:46.864424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89df4a-a292-4dd5-accd-2a6188fb3cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:46.894256 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-6d89df4a-a292-4dd5-accd-2a6188fb3cb6 None None] MFA Rules not processed for user `09ac1017fa9e41518f0daedb73046a26`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:46.895499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-6d89df4a-a292-4dd5-accd-2a6188fb3cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:46.904276 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1714d6f3-c3d1-4ece-8dbe-efabdbb6a89e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbedcde7fcb347ecbced0efe722d1e68', 'request_id': 'req-1714d6f3-c3d1-4ece-8dbe-efabdbb6a89e'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:46.914014 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1714d6f3-c3d1-4ece-8dbe-efabdbb6a89e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbedcde7fcb347ecbced0efe722d1e68', 'request_id': 'req-1714d6f3-c3d1-4ece-8dbe-efabdbb6a89e'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:46.921146 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1714d6f3-c3d1-4ece-8dbe-efabdbb6a89e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbedcde7fcb347ecbced0efe722d1e68', 'request_id': 'req-1714d6f3-c3d1-4ece-8dbe-efabdbb6a89e'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:46.932150 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1714d6f3-c3d1-4ece-8dbe-efabdbb6a89e admin admin] The token cache is being invalidate because project bbedcde7fcb347ecbced0efe722d1e68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:46.932443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1714d6f3-c3d1-4ece-8dbe-efabdbb6a89e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:46.933224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1714d6f3-c3d1-4ece-8dbe-efabdbb6a89e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:46.934953 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 997/1984] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:46 2022] DELETE /identity/v3/projects/bbedcde7fcb347ecbced0efe722d1e68 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:46.938796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714d6f3-c3d1-4ece-8dbe-efabdbb6a89e admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:46.940298 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-1714d6f3-c3d1-4ece-8dbe-efabdbb6a89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:46.986591 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 988/1985] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:45:46.996762 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89df4a-a292-4dd5-accd-2a6188fb3cb6 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:46.999039 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-6d89df4a-a292-4dd5-accd-2a6188fb3cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:47.011060 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:47.031825 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714d6f3-c3d1-4ece-8dbe-efabdbb6a89e admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:47.042242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672e50c-323f-4e1a-b848-0c935e308e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:47.042978 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672e50c-323f-4e1a-b848-0c935e308e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:47.043179 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672e50c-323f-4e1a-b848-0c935e308e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:47.043458 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672e50c-323f-4e1a-b848-0c935e308e19 admin admin] PATH_INFO: `/v3/users/6af72ed8e6b342cea6000429d4cdfd2a` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:47.044667 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d672e50c-323f-4e1a-b848-0c935e308e19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6af72ed8e6b342cea6000429d4cdfd2a)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:47.046831 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d672e50c-323f-4e1a-b848-0c935e308e19 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:47.089232 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89df4a-a292-4dd5-accd-2a6188fb3cb6 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:47.093797 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e437ca-de52-4193-bc1e-b7210f0e029e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:47.094494 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e437ca-de52-4193-bc1e-b7210f0e029e service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:47.094832 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e437ca-de52-4193-bc1e-b7210f0e029e service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:47.095167 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e437ca-de52-4193-bc1e-b7210f0e029e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:47.098492 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b8e437ca-de52-4193-bc1e-b7210f0e029e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:47.172054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-d672e50c-323f-4e1a-b848-0c935e308e19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6af72ed8e6b342cea6000429d4cdfd2a'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:47.173342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-d672e50c-323f-4e1a-b848-0c935e308e19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6af72ed8e6b342cea6000429d4cdfd2a'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:47.180377 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:47.209496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-d672e50c-323f-4e1a-b848-0c935e308e19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6af72ed8e6b342cea6000429d4cdfd2a'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:47.209696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e437ca-de52-4193-bc1e-b7210f0e029e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:47.209696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e437ca-de52-4193-bc1e-b7210f0e029e service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:47.209930 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-d672e50c-323f-4e1a-b848-0c935e308e19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6af72ed8e6b342cea6000429d4cdfd2a'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:47.214887 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 989/1986] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:47.221550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-d672e50c-323f-4e1a-b848-0c935e308e19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6af72ed8e6b342cea6000429d4cdfd2a'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:47.232984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 998/1987] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:46 2022] DELETE /identity/v3/users/6af72ed8e6b342cea6000429d4cdfd2a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:45:47.336853 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e437ca-de52-4193-bc1e-b7210f0e029e service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:47.339093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b8e437ca-de52-4193-bc1e-b7210f0e029e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:47.366697 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e437ca-de52-4193-bc1e-b7210f0e029e service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:47.493822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba5898-7c02-4e34-9d7b-f7eca26dda22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:47.497318 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba5898-7c02-4e34-9d7b-f7eca26dda22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:47.501753 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba5898-7c02-4e34-9d7b-f7eca26dda22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:47.502326 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba5898-7c02-4e34-9d7b-f7eca26dda22 admin admin] PATH_INFO: `/v3/users/fa591ee7510f44f49f04afecd30fc88d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:47.505997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba5898-7c02-4e34-9d7b-f7eca26dda22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa591ee7510f44f49f04afecd30fc88d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:47.510689 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba5898-7c02-4e34-9d7b-f7eca26dda22 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:47.645024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2bba5898-7c02-4e34-9d7b-f7eca26dda22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa591ee7510f44f49f04afecd30fc88d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:47.646759 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2bba5898-7c02-4e34-9d7b-f7eca26dda22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa591ee7510f44f49f04afecd30fc88d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:47.647415 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2bba5898-7c02-4e34-9d7b-f7eca26dda22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa591ee7510f44f49f04afecd30fc88d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:47.669212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672e50c-323f-4e1a-b848-0c935e308e19 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:47.672122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-d672e50c-323f-4e1a-b848-0c935e308e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:47.688486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2bba5898-7c02-4e34-9d7b-f7eca26dda22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa591ee7510f44f49f04afecd30fc88d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:47.697687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672e50c-323f-4e1a-b848-0c935e308e19 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:47.707283 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2bba5898-7c02-4e34-9d7b-f7eca26dda22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa591ee7510f44f49f04afecd30fc88d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:47.708681 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cbe2b-533d-4b92-ac1f-5586c6acc265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:47.709340 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cbe2b-533d-4b92-ac1f-5586c6acc265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:47.710517 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cbe2b-533d-4b92-ac1f-5586c6acc265 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:47.710805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cbe2b-533d-4b92-ac1f-5586c6acc265 admin admin] PATH_INFO: `/v3/projects/378eab2a88d14688bd7558adab26fa72` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:47.712948 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cbe2b-533d-4b92-ac1f-5586c6acc265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=378eab2a88d14688bd7558adab26fa72)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:47.715119 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cbe2b-533d-4b92-ac1f-5586c6acc265 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:47.736041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 990/1988] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:47 2022] DELETE /identity/v3/users/fa591ee7510f44f49f04afecd30fc88d => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:47.742857 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aaf12-21e2-4a35-baf1-5cccf487af3c None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:47.743865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aaf12-21e2-4a35-baf1-5cccf487af3c None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:47.745500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aaf12-21e2-4a35-baf1-5cccf487af3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:47.783857 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-6d4aaf12-21e2-4a35-baf1-5cccf487af3c None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:47.785304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-6d4aaf12-21e2-4a35-baf1-5cccf487af3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:47.816323 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-130cbe2b-533d-4b92-ac1f-5586c6acc265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '378eab2a88d14688bd7558adab26fa72', 'request_id': 'req-130cbe2b-533d-4b92-ac1f-5586c6acc265'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:47.831024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-130cbe2b-533d-4b92-ac1f-5586c6acc265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '378eab2a88d14688bd7558adab26fa72', 'request_id': 'req-130cbe2b-533d-4b92-ac1f-5586c6acc265'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:47.845318 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-130cbe2b-533d-4b92-ac1f-5586c6acc265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '378eab2a88d14688bd7558adab26fa72', 'request_id': 'req-130cbe2b-533d-4b92-ac1f-5586c6acc265'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:47.866642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-130cbe2b-533d-4b92-ac1f-5586c6acc265 admin admin] The token cache is being invalidate because project 378eab2a88d14688bd7558adab26fa72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:47.866943 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-130cbe2b-533d-4b92-ac1f-5586c6acc265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:47.868276 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-130cbe2b-533d-4b92-ac1f-5586c6acc265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:47.870753 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 999/1989] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:47 2022] DELETE /identity/v3/projects/378eab2a88d14688bd7558adab26fa72 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:47.877189 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1f633-2bbb-464a-83d7-ff2add973dae None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:47.877896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1f633-2bbb-464a-83d7-ff2add973dae None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:47.878453 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1f633-2bbb-464a-83d7-ff2add973dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:47.896684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 991/1990] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:47.912451 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-fde1f633-2bbb-464a-83d7-ff2add973dae None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:47.913160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4aaf12-21e2-4a35-baf1-5cccf487af3c None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:47.913732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-fde1f633-2bbb-464a-83d7-ff2add973dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:47.916059 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-6d4aaf12-21e2-4a35-baf1-5cccf487af3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:47.923530 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:47.967844 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:47.978916 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4aaf12-21e2-4a35-baf1-5cccf487af3c None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:47.982054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1000/1991] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:47.992450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1c42e-6712-4116-be76-edba1f866f33 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:47.992854 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1c42e-6712-4116-be76-edba1f866f33 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:47.993200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1c42e-6712-4116-be76-edba1f866f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:48.014991 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-c1c1c42e-6712-4116-be76-edba1f866f33 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:48.016218 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-c1c1c42e-6712-4116-be76-edba1f866f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:48.024309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1001/1992] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:48.028549 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1c42e-6712-4116-be76-edba1f866f33 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:48.029585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e52864-261c-4ecf-b72d-8200162398ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:48.030218 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e52864-261c-4ecf-b72d-8200162398ff service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:48.031179 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e52864-261c-4ecf-b72d-8200162398ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:48.031510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e52864-261c-4ecf-b72d-8200162398ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:48.038218 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1c42e-6712-4116-be76-edba1f866f33 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:48.040951 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e52864-261c-4ecf-b72d-8200162398ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:48.042443 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e52864-261c-4ecf-b72d-8200162398ff service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:48.042924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fe29a-d2b3-4d83-8490-0977becd8b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:48.043515 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fe29a-d2b3-4d83-8490-0977becd8b17 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:48.043795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fe29a-d2b3-4d83-8490-0977becd8b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:48.044070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071fe29a-d2b3-4d83-8490-0977becd8b17 admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:48.044714 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071fe29a-d2b3-4d83-8490-0977becd8b17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:48.045016 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071fe29a-d2b3-4d83-8490-0977becd8b17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:48.046979 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071fe29a-d2b3-4d83-8490-0977becd8b17 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:48.052046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 992/1993] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:45:48.058762 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1002/1994] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:45:48.063712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e52864-261c-4ecf-b72d-8200162398ff service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:48.073634 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e52864-261c-4ecf-b72d-8200162398ff service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:48.080235 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2dde6d-c4e6-486c-bf64-e37d98b53083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:48.080848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dde6d-c4e6-486c-bf64-e37d98b53083 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:48.081131 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dde6d-c4e6-486c-bf64-e37d98b53083 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:48.081410 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2dde6d-c4e6-486c-bf64-e37d98b53083 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:48.082090 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2dde6d-c4e6-486c-bf64-e37d98b53083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:48.084022 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2dde6d-c4e6-486c-bf64-e37d98b53083 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:48.113369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 993/1995] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:48 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:45:48.117816 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fe29a-d2b3-4d83-8490-0977becd8b17 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:48.130774 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071fe29a-d2b3-4d83-8490-0977becd8b17 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:48.243116 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6db2d-bd5f-4173-ae92-299ac76ca6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:48.243737 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6db2d-bd5f-4173-ae92-299ac76ca6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:48.244272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6db2d-bd5f-4173-ae92-299ac76ca6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:48.244272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6db2d-bd5f-4173-ae92-299ac76ca6e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:48.244852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6db2d-bd5f-4173-ae92-299ac76ca6e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:48.250815 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6db2d-bd5f-4173-ae92-299ac76ca6e2 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:48.296421 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1003/1996] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:48 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:48.301437 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2dde6d-c4e6-486c-bf64-e37d98b53083 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:48.315349 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2dde6d-c4e6-486c-bf64-e37d98b53083 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:48.320435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e09dc-9c68-45c7-b390-151f57dc941b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:48.321074 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e09dc-9c68-45c7-b390-151f57dc941b admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:48.321335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e09dc-9c68-45c7-b390-151f57dc941b admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:48.321650 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e09dc-9c68-45c7-b390-151f57dc941b admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:48.322369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e09dc-9c68-45c7-b390-151f57dc941b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:48.324201 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e09dc-9c68-45c7-b390-151f57dc941b admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:48.340513 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 994/1997] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:48.341786 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6db2d-bd5f-4173-ae92-299ac76ca6e2 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:48.354833 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6db2d-bd5f-4173-ae92-299ac76ca6e2 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:48.363250 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f839318-7151-46cc-89fe-e81e5408805c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:48.364006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f839318-7151-46cc-89fe-e81e5408805c admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:48.365017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f839318-7151-46cc-89fe-e81e5408805c admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:48.365444 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f839318-7151-46cc-89fe-e81e5408805c admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:48.366237 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f839318-7151-46cc-89fe-e81e5408805c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:48.368953 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f839318-7151-46cc-89fe-e81e5408805c admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:48.389503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1004/1998] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:48.393901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e09dc-9c68-45c7-b390-151f57dc941b admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:48.405625 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e09dc-9c68-45c7-b390-151f57dc941b admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:48.418967 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b2c56-c6a6-4fbb-8cca-95317fe1f015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:48.419768 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b2c56-c6a6-4fbb-8cca-95317fe1f015 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:48.420147 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b2c56-c6a6-4fbb-8cca-95317fe1f015 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:48.420485 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b2c56-c6a6-4fbb-8cca-95317fe1f015 admin admin] PATH_INFO: `/v3/projects/bd5a378497844eb59b49c293e3aa74ec/users/805a689706d34260a1c5177c41ca3bcc/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:48.447402 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b2c56-c6a6-4fbb-8cca-95317fe1f015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd5a378497844eb59b49c293e3aa74ec, user_id=805a689706d34260a1c5177c41ca3bcc, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:48.450823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b2c56-c6a6-4fbb-8cca-95317fe1f015 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:48.461310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f839318-7151-46cc-89fe-e81e5408805c admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:48.463577 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2f839318-7151-46cc-89fe-e81e5408805c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:48.473758 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 995/1999] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:48 2022] PUT /identity/v3/projects/bd5a378497844eb59b49c293e3aa74ec/users/805a689706d34260a1c5177c41ca3bcc/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:48.479391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f839318-7151-46cc-89fe-e81e5408805c admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:48.481672 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe9f14-ecaa-4713-b2d9-9e08952e3902 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:48.482021 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe9f14-ecaa-4713-b2d9-9e08952e3902 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:48.482835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe9f14-ecaa-4713-b2d9-9e08952e3902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:48.530016 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-29fe9f14-ecaa-4713-b2d9-9e08952e3902 None None] MFA Rules not processed for user `805a689706d34260a1c5177c41ca3bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:48.531871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-29fe9f14-ecaa-4713-b2d9-9e08952e3902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:48.564312 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f48962-3c52-48e6-9831-63e6f85c4539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:48.564961 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f48962-3c52-48e6-9831-63e6f85c4539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:48.565240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f48962-3c52-48e6-9831-63e6f85c4539 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:48.565560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f48962-3c52-48e6-9831-63e6f85c4539 admin admin] PATH_INFO: `/v3/projects/f682b4c01db2432cb73c93490f985e85` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:48.566825 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f48962-3c52-48e6-9831-63e6f85c4539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f682b4c01db2432cb73c93490f985e85)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:48.568731 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f48962-3c52-48e6-9831-63e6f85c4539 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:48.598168 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:48.613521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 996/2000] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:45:48.616082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe9f14-ecaa-4713-b2d9-9e08952e3902 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:48.628363 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe9f14-ecaa-4713-b2d9-9e08952e3902 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:48.629833 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-f9f48962-3c52-48e6-9831-63e6f85c4539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f682b4c01db2432cb73c93490f985e85', 'request_id': 'req-f9f48962-3c52-48e6-9831-63e6f85c4539'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:48.650378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-f9f48962-3c52-48e6-9831-63e6f85c4539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f682b4c01db2432cb73c93490f985e85', 'request_id': 'req-f9f48962-3c52-48e6-9831-63e6f85c4539'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:48.652176 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:48.660313 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-f9f48962-3c52-48e6-9831-63e6f85c4539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f682b4c01db2432cb73c93490f985e85', 'request_id': 'req-f9f48962-3c52-48e6-9831-63e6f85c4539'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:48.678187 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-f9f48962-3c52-48e6-9831-63e6f85c4539 admin admin] The token cache is being invalidate because project f682b4c01db2432cb73c93490f985e85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:48.678641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-f9f48962-3c52-48e6-9831-63e6f85c4539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:48.679842 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-f9f48962-3c52-48e6-9831-63e6f85c4539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:48.685429 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1005/2001] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:48 2022] DELETE /identity/v3/projects/f682b4c01db2432cb73c93490f985e85 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:45:48.686284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f48962-3c52-48e6-9831-63e6f85c4539 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:48.689020 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f9f48962-3c52-48e6-9831-63e6f85c4539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:48.704265 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37588fe-4f58-421b-a307-6564b4a17c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:48.704918 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37588fe-4f58-421b-a307-6564b4a17c74 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:48.705204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37588fe-4f58-421b-a307-6564b4a17c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:48.705523 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37588fe-4f58-421b-a307-6564b4a17c74 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:48.706188 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37588fe-4f58-421b-a307-6564b4a17c74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:48.708127 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37588fe-4f58-421b-a307-6564b4a17c74 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:48.739736 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 997/2002] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:48 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:45:48.743864 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37588fe-4f58-421b-a307-6564b4a17c74 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:48.756012 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e37588fe-4f58-421b-a307-6564b4a17c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:48.770884 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f48962-3c52-48e6-9831-63e6f85c4539 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:48.863124 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0c1f3-df14-4e4f-8fa2-c61712ce8686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:48.863819 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0c1f3-df14-4e4f-8fa2-c61712ce8686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:48.864280 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0c1f3-df14-4e4f-8fa2-c61712ce8686 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:48.864560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0c1f3-df14-4e4f-8fa2-c61712ce8686 admin admin] PATH_INFO: `/v3/users/a5fe3fd06dc74a639b8b764e9e106b98` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:48.866644 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0c1f3-df14-4e4f-8fa2-c61712ce8686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5fe3fd06dc74a639b8b764e9e106b98)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:48.868612 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0c1f3-df14-4e4f-8fa2-c61712ce8686 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:48.880663 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37588fe-4f58-421b-a307-6564b4a17c74 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:48.891508 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61448d25-3431-45c2-be9e-e9cf784c96cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:48.893317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61448d25-3431-45c2-be9e-e9cf784c96cb admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:48.893774 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61448d25-3431-45c2-be9e-e9cf784c96cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:48.894195 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61448d25-3431-45c2-be9e-e9cf784c96cb admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:48.894990 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61448d25-3431-45c2-be9e-e9cf784c96cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:48.897067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61448d25-3431-45c2-be9e-e9cf784c96cb admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:48.928034 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 998/2003] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:48 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:48.932217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61448d25-3431-45c2-be9e-e9cf784c96cb admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:48.963017 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61448d25-3431-45c2-be9e-e9cf784c96cb admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:48.976163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f2146-0452-46db-a64e-2e7769d9666b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:48.977065 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f2146-0452-46db-a64e-2e7769d9666b admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:48.978551 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f2146-0452-46db-a64e-2e7769d9666b admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:48.979007 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f2146-0452-46db-a64e-2e7769d9666b admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:48.984827 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f2146-0452-46db-a64e-2e7769d9666b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:48.990086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f2146-0452-46db-a64e-2e7769d9666b admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:49.008662 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 999/2004] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:49.011812 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3ec0c1f3-df14-4e4f-8fa2-c61712ce8686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5fe3fd06dc74a639b8b764e9e106b98'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:49.012881 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f2146-0452-46db-a64e-2e7769d9666b admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:49.026329 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3ec0c1f3-df14-4e4f-8fa2-c61712ce8686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5fe3fd06dc74a639b8b764e9e106b98'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:49.033363 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f2146-0452-46db-a64e-2e7769d9666b admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:49.074039 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3ec0c1f3-df14-4e4f-8fa2-c61712ce8686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5fe3fd06dc74a639b8b764e9e106b98'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:49.084570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2f6ba-1524-4de4-a5dc-198d872ca0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:49.085394 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2f6ba-1524-4de4-a5dc-198d872ca0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:49.085720 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2f6ba-1524-4de4-a5dc-198d872ca0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:49.086127 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2f6ba-1524-4de4-a5dc-198d872ca0fe admin admin] PATH_INFO: `/v3/projects/508ed447ccf646009fc789fb11e83846/users/6b149e459f364a0a81850cb2354a7a65/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:49.089703 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3ec0c1f3-df14-4e4f-8fa2-c61712ce8686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5fe3fd06dc74a639b8b764e9e106b98'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:49.102993 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3ec0c1f3-df14-4e4f-8fa2-c61712ce8686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5fe3fd06dc74a639b8b764e9e106b98'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:49.109445 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2f6ba-1524-4de4-a5dc-198d872ca0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=508ed447ccf646009fc789fb11e83846, user_id=6b149e459f364a0a81850cb2354a7a65, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:49.110375 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1006/2005] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:48 2022] DELETE /identity/v3/users/a5fe3fd06dc74a639b8b764e9e106b98 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:49.114020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2f6ba-1524-4de4-a5dc-198d872ca0fe admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:49.133913 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1000/2006] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:49 2022] PUT /identity/v3/projects/508ed447ccf646009fc789fb11e83846/users/6b149e459f364a0a81850cb2354a7a65/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:49.138450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0c1f3-df14-4e4f-8fa2-c61712ce8686 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:49.140872 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-3ec0c1f3-df14-4e4f-8fa2-c61712ce8686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:49.158956 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:49.238337 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0c1f3-df14-4e4f-8fa2-c61712ce8686 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:49.321277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dca5a0-a9fa-48d1-b802-59365802057d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:49.321931 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dca5a0-a9fa-48d1-b802-59365802057d admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:49.322221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dca5a0-a9fa-48d1-b802-59365802057d admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:49.322502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dca5a0-a9fa-48d1-b802-59365802057d admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:49.323151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dca5a0-a9fa-48d1-b802-59365802057d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:49.324812 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dca5a0-a9fa-48d1-b802-59365802057d admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:49.341515 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1007/2007] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:45:49.344883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2f6ba-1524-4de4-a5dc-198d872ca0fe admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:49.357900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2f6ba-1524-4de4-a5dc-198d872ca0fe admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:49.363550 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e9196-3ebd-4a7a-8bd9-aea53dda4939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:49.364419 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e9196-3ebd-4a7a-8bd9-aea53dda4939 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:49.364725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e9196-3ebd-4a7a-8bd9-aea53dda4939 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:49.365075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e9196-3ebd-4a7a-8bd9-aea53dda4939 admin admin] PATH_INFO: `/v3/projects/508ed447ccf646009fc789fb11e83846/users/6b149e459f364a0a81850cb2354a7a65/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:49.367215 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e9196-3ebd-4a7a-8bd9-aea53dda4939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=508ed447ccf646009fc789fb11e83846, user_id=6b149e459f364a0a81850cb2354a7a65, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:49.369984 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e9196-3ebd-4a7a-8bd9-aea53dda4939 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:49.390122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1001/2008] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:49 2022] PUT /identity/v3/projects/508ed447ccf646009fc789fb11e83846/users/6b149e459f364a0a81850cb2354a7a65/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:49.393533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e533e8-c61d-499a-b6be-55775fec61b4 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:49.394074 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e533e8-c61d-499a-b6be-55775fec61b4 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:49.394525 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e533e8-c61d-499a-b6be-55775fec61b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:49.469592 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-29e533e8-c61d-499a-b6be-55775fec61b4 None None] MFA Rules not processed for user `6b149e459f364a0a81850cb2354a7a65`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:49.471114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-29e533e8-c61d-499a-b6be-55775fec61b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:49.524995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e9196-3ebd-4a7a-8bd9-aea53dda4939 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:49.528054 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b19e9196-3ebd-4a7a-8bd9-aea53dda4939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:49.574831 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:49.629393 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1008/2009] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:49 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:45:49.640501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e533e8-c61d-499a-b6be-55775fec61b4 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:49.642132 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-29e533e8-c61d-499a-b6be-55775fec61b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:49.649914 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e9196-3ebd-4a7a-8bd9-aea53dda4939 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:49.654838 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa39f2-9277-46dd-9db5-25bcce384473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:49.656167 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa39f2-9277-46dd-9db5-25bcce384473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:49.656452 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa39f2-9277-46dd-9db5-25bcce384473 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:49.656734 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa39f2-9277-46dd-9db5-25bcce384473 admin admin] PATH_INFO: `/v3/projects/18b8b49905e34c3fb69ee10687db0780` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:49.657926 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa39f2-9277-46dd-9db5-25bcce384473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18b8b49905e34c3fb69ee10687db0780)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:49.659847 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa39f2-9277-46dd-9db5-25bcce384473 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:49.694626 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:49.714798 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-96fa39f2-9277-46dd-9db5-25bcce384473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18b8b49905e34c3fb69ee10687db0780', 'request_id': 'req-96fa39f2-9277-46dd-9db5-25bcce384473'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:49.717023 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e533e8-c61d-499a-b6be-55775fec61b4 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:49.724298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-96fa39f2-9277-46dd-9db5-25bcce384473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18b8b49905e34c3fb69ee10687db0780', 'request_id': 'req-96fa39f2-9277-46dd-9db5-25bcce384473'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:49.732579 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-96fa39f2-9277-46dd-9db5-25bcce384473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18b8b49905e34c3fb69ee10687db0780', 'request_id': 'req-96fa39f2-9277-46dd-9db5-25bcce384473'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:49.743499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-96fa39f2-9277-46dd-9db5-25bcce384473 admin admin] The token cache is being invalidate because project 18b8b49905e34c3fb69ee10687db0780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:49.743791 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-96fa39f2-9277-46dd-9db5-25bcce384473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:49.744518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-96fa39f2-9277-46dd-9db5-25bcce384473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:49.746061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1002/2010] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:49 2022] DELETE /identity/v3/projects/18b8b49905e34c3fb69ee10687db0780 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:49.752309 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7373a74-4afc-4d29-9084-8617bb3bf16a None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:49.752594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7373a74-4afc-4d29-9084-8617bb3bf16a None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:49.752866 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7373a74-4afc-4d29-9084-8617bb3bf16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:49.772553 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-b7373a74-4afc-4d29-9084-8617bb3bf16a None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:49.773698 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b7373a74-4afc-4d29-9084-8617bb3bf16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:49.783721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d4aa7-a9c2-4580-8926-d98b0d6d5c6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:49.784343 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d4aa7-a9c2-4580-8926-d98b0d6d5c6e service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:49.784610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d4aa7-a9c2-4580-8926-d98b0d6d5c6e service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:49.784884 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d4aa7-a9c2-4580-8926-d98b0d6d5c6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:49.786945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-d11d4aa7-a9c2-4580-8926-d98b0d6d5c6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:49.841629 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1003/2011] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:45:49.844196 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fefb1a-4c8c-4cd1-a0ac-62a4e9d8b1c2 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:49.844655 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fefb1a-4c8c-4cd1-a0ac-62a4e9d8b1c2 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:49.845238 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fefb1a-4c8c-4cd1-a0ac-62a4e9d8b1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:49.861068 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d4aa7-a9c2-4580-8926-d98b0d6d5c6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:49.862661 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d4aa7-a9c2-4580-8926-d98b0d6d5c6e service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:49.867293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-88fefb1a-4c8c-4cd1-a0ac-62a4e9d8b1c2 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:49.868574 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-88fefb1a-4c8c-4cd1-a0ac-62a4e9d8b1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:49.879101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1004/2012] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:45:49.883036 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fefb1a-4c8c-4cd1-a0ac-62a4e9d8b1c2 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:49.884134 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1009/2013] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:49 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:45:49.894655 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fefb1a-4c8c-4cd1-a0ac-62a4e9d8b1c2 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:49.900185 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b670a8-ba58-44a4-83ba-23192189d6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:49.900834 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b670a8-ba58-44a4-83ba-23192189d6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:49.901116 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b670a8-ba58-44a4-83ba-23192189d6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:49.901394 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b670a8-ba58-44a4-83ba-23192189d6b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:49.902910 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b670a8-ba58-44a4-83ba-23192189d6b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:49.902910 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b670a8-ba58-44a4-83ba-23192189d6b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:49.904277 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b670a8-ba58-44a4-83ba-23192189d6b1 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:49.918306 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1005/2014] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:49.924205 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d4aa7-a9c2-4580-8926-d98b0d6d5c6e service cinder] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:49.936310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d4aa7-a9c2-4580-8926-d98b0d6d5c6e service cinder] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:49.942524 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c9d54-3d46-45fd-9475-f8ee2aec7d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:49.943175 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c9d54-3d46-45fd-9475-f8ee2aec7d5a admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:49.943456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c9d54-3d46-45fd-9475-f8ee2aec7d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:49.943725 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c9d54-3d46-45fd-9475-f8ee2aec7d5a admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:49.944374 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c9d54-3d46-45fd-9475-f8ee2aec7d5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:49.946374 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c9d54-3d46-45fd-9475-f8ee2aec7d5a admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:49.975988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1010/2015] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:49 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:45:49.979679 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b670a8-ba58-44a4-83ba-23192189d6b1 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:49.993245 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b670a8-ba58-44a4-83ba-23192189d6b1 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:50.036243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:50.086686 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec212545-1625-4679-8ab6-ae04df5cd4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:50.089284 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec212545-1625-4679-8ab6-ae04df5cd4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:50.089595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec212545-1625-4679-8ab6-ae04df5cd4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:50.089878 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec212545-1625-4679-8ab6-ae04df5cd4a7 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:50.090597 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec212545-1625-4679-8ab6-ae04df5cd4a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:50.094493 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec212545-1625-4679-8ab6-ae04df5cd4a7 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:50.133638 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1006/2016] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:49 2022] POST /identity/v3/users => generated 285 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:45:50.134934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c9d54-3d46-45fd-9475-f8ee2aec7d5a admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:50.148977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c9d54-3d46-45fd-9475-f8ee2aec7d5a admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:50.156513 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b001c3-625f-4205-918a-be950ee73d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:50.158589 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b001c3-625f-4205-918a-be950ee73d17 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:50.159037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b001c3-625f-4205-918a-be950ee73d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:50.159439 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b001c3-625f-4205-918a-be950ee73d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:50.160157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b001c3-625f-4205-918a-be950ee73d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:50.162824 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b001c3-625f-4205-918a-be950ee73d17 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:50.180844 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1011/2017] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:50.182443 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec212545-1625-4679-8ab6-ae04df5cd4a7 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:50.223462 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec212545-1625-4679-8ab6-ae04df5cd4a7 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:50.236241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769b662-016c-4482-ab9a-ea6b5d7f1bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:50.236868 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769b662-016c-4482-ab9a-ea6b5d7f1bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:50.237150 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769b662-016c-4482-ab9a-ea6b5d7f1bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:50.237434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769b662-016c-4482-ab9a-ea6b5d7f1bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:50.238143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769b662-016c-4482-ab9a-ea6b5d7f1bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:50.245256 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769b662-016c-4482-ab9a-ea6b5d7f1bb7 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:50.263162 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1007/2018] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:45:50.267829 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b001c3-625f-4205-918a-be950ee73d17 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:50.288018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b001c3-625f-4205-918a-be950ee73d17 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:50.294487 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fda6d-3824-487e-a9f3-3bfdce37efc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:50.295409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fda6d-3824-487e-a9f3-3bfdce37efc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:50.295684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fda6d-3824-487e-a9f3-3bfdce37efc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:50.296412 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fda6d-3824-487e-a9f3-3bfdce37efc2 admin admin] PATH_INFO: `/v3/projects/7f5567da4a34484d9974755d675a8889/users/89ca0a6e5ac847be948e0efba9b2d412/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:50.315631 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357fda6d-3824-487e-a9f3-3bfdce37efc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f5567da4a34484d9974755d675a8889, user_id=89ca0a6e5ac847be948e0efba9b2d412, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:50.318750 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357fda6d-3824-487e-a9f3-3bfdce37efc2 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:50.320288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769b662-016c-4482-ab9a-ea6b5d7f1bb7 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:50.322555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-2769b662-016c-4482-ab9a-ea6b5d7f1bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:50.342115 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1012/2019] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:50 2022] PUT /identity/v3/projects/7f5567da4a34484d9974755d675a8889/users/89ca0a6e5ac847be948e0efba9b2d412/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:50.349846 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d4347-d910-42f1-99ab-84fe21cd763c None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:50.350185 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d4347-d910-42f1-99ab-84fe21cd763c None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:50.350473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d4347-d910-42f1-99ab-84fe21cd763c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:50.393554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-df3d4347-d910-42f1-99ab-84fe21cd763c None None] MFA Rules not processed for user `89ca0a6e5ac847be948e0efba9b2d412`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:50.395256 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-df3d4347-d910-42f1-99ab-84fe21cd763c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:50.412129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769b662-016c-4482-ab9a-ea6b5d7f1bb7 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:50.474469 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:50.482005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e345f03-9cba-4304-bb56-7332ca03ee86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:50.482702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e345f03-9cba-4304-bb56-7332ca03ee86 service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:50.482984 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e345f03-9cba-4304-bb56-7332ca03ee86 service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:50.483304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e345f03-9cba-4304-bb56-7332ca03ee86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:50.485708 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-4e345f03-9cba-4304-bb56-7332ca03ee86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:50.534769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1013/2020] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:50.540877 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d4347-d910-42f1-99ab-84fe21cd763c None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:50.542482 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-df3d4347-d910-42f1-99ab-84fe21cd763c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:50.557280 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e345f03-9cba-4304-bb56-7332ca03ee86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:50.558767 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e345f03-9cba-4304-bb56-7332ca03ee86 service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:50.581141 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1008/2021] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:50 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:45:50.707699 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d4347-d910-42f1-99ab-84fe21cd763c None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:50.721752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7250e-0b44-441a-85c9-905a1afb36cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51fe6dfa43d04cdeb0421d2613c8c2ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:50.721752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7250e-0b44-441a-85c9-905a1afb36cd service glance] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:50.722081 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7250e-0b44-441a-85c9-905a1afb36cd service glance] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:50.722497 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7250e-0b44-441a-85c9-905a1afb36cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:50.740173 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7250e-0b44-441a-85c9-905a1afb36cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:50.742286 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7250e-0b44-441a-85c9-905a1afb36cd service glance] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:50.766622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1014/2022] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:45:51.573185 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e345f03-9cba-4304-bb56-7332ca03ee86 service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:51.574710 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-4e345f03-9cba-4304-bb56-7332ca03ee86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:51.620321 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:51.715799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e345f03-9cba-4304-bb56-7332ca03ee86 service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:51.724337 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcf426-acf2-414f-b4fa-40e6a0aaf632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:51.725029 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcf426-acf2-414f-b4fa-40e6a0aaf632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:51.725398 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcf426-acf2-414f-b4fa-40e6a0aaf632 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:51.725772 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcf426-acf2-414f-b4fa-40e6a0aaf632 admin admin] PATH_INFO: `/v3/users/805a689706d34260a1c5177c41ca3bcc` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:51.727872 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdcf426-acf2-414f-b4fa-40e6a0aaf632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=805a689706d34260a1c5177c41ca3bcc)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:51.730362 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdcf426-acf2-414f-b4fa-40e6a0aaf632 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:51.786452 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-7fdcf426-acf2-414f-b4fa-40e6a0aaf632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '805a689706d34260a1c5177c41ca3bcc'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:51.786452 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-7fdcf426-acf2-414f-b4fa-40e6a0aaf632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '805a689706d34260a1c5177c41ca3bcc'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:51.789959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-7fdcf426-acf2-414f-b4fa-40e6a0aaf632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '805a689706d34260a1c5177c41ca3bcc'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:51.805496 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-7fdcf426-acf2-414f-b4fa-40e6a0aaf632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '805a689706d34260a1c5177c41ca3bcc'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:51.815704 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-7fdcf426-acf2-414f-b4fa-40e6a0aaf632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '805a689706d34260a1c5177c41ca3bcc'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:51.829088 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1009/2023] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:51 2022] DELETE /identity/v3/users/805a689706d34260a1c5177c41ca3bcc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:51.833995 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4a1b2-32fc-401c-86a3-6985b3092e1e None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:51.848156 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4a1b2-32fc-401c-86a3-6985b3092e1e None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:51.848156 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4a1b2-32fc-401c-86a3-6985b3092e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:51.867547 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-caa4a1b2-32fc-401c-86a3-6985b3092e1e None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:51.868881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-caa4a1b2-32fc-401c-86a3-6985b3092e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:51.932449 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1015/2024] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:51.942704 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcf426-acf2-414f-b4fa-40e6a0aaf632 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:51.944104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7fdcf426-acf2-414f-b4fa-40e6a0aaf632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:52.001822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcf426-acf2-414f-b4fa-40e6a0aaf632 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:52.005388 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d452b0-1253-4d12-962f-dd976c633c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:52.006013 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d452b0-1253-4d12-962f-dd976c633c4b service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:52.006290 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d452b0-1253-4d12-962f-dd976c633c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:52.006561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d452b0-1253-4d12-962f-dd976c633c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:52.015925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d452b0-1253-4d12-962f-dd976c633c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:52.017347 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d452b0-1253-4d12-962f-dd976c633c4b service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:52.027559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1010/2025] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:52.379565 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4a1b2-32fc-401c-86a3-6985b3092e1e None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:52.382868 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-caa4a1b2-32fc-401c-86a3-6985b3092e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:52.400790 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4a1b2-32fc-401c-86a3-6985b3092e1e None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:52.409737 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a489c85-c546-4905-beed-901e5e94d2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:52.410725 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a489c85-c546-4905-beed-901e5e94d2db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:52.411004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a489c85-c546-4905-beed-901e5e94d2db admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:52.412016 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a489c85-c546-4905-beed-901e5e94d2db admin admin] PATH_INFO: `/v3/projects/bd5a378497844eb59b49c293e3aa74ec` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:52.414275 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a489c85-c546-4905-beed-901e5e94d2db admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd5a378497844eb59b49c293e3aa74ec)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:52.417042 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a489c85-c546-4905-beed-901e5e94d2db admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:52.499659 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2a489c85-c546-4905-beed-901e5e94d2db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd5a378497844eb59b49c293e3aa74ec', 'request_id': 'req-2a489c85-c546-4905-beed-901e5e94d2db'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:52.507227 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2a489c85-c546-4905-beed-901e5e94d2db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd5a378497844eb59b49c293e3aa74ec', 'request_id': 'req-2a489c85-c546-4905-beed-901e5e94d2db'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:52.508506 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:52.518355 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2a489c85-c546-4905-beed-901e5e94d2db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd5a378497844eb59b49c293e3aa74ec', 'request_id': 'req-2a489c85-c546-4905-beed-901e5e94d2db'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:52.532839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2a489c85-c546-4905-beed-901e5e94d2db admin admin] The token cache is being invalidate because project bd5a378497844eb59b49c293e3aa74ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:52.533138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2a489c85-c546-4905-beed-901e5e94d2db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:52.533948 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2a489c85-c546-4905-beed-901e5e94d2db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:52.535736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1016/2026] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:52 2022] DELETE /identity/v3/projects/bd5a378497844eb59b49c293e3aa74ec => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:52.539578 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d452b0-1253-4d12-962f-dd976c633c4b service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:52.550514 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d452b0-1253-4d12-962f-dd976c633c4b service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:52.610605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:52.640155 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab28d2-1102-4afd-9b43-a7bcc928e260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:52.641527 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab28d2-1102-4afd-9b43-a7bcc928e260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:52.642038 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab28d2-1102-4afd-9b43-a7bcc928e260 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:52.642434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab28d2-1102-4afd-9b43-a7bcc928e260 admin admin] PATH_INFO: `/v3/users/6b149e459f364a0a81850cb2354a7a65` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:52.643875 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab28d2-1102-4afd-9b43-a7bcc928e260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b149e459f364a0a81850cb2354a7a65)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:52.646157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab28d2-1102-4afd-9b43-a7bcc928e260 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:52.715408 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-87ab28d2-1102-4afd-9b43-a7bcc928e260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b149e459f364a0a81850cb2354a7a65'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:52.716555 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-87ab28d2-1102-4afd-9b43-a7bcc928e260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b149e459f364a0a81850cb2354a7a65'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:52.716736 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-87ab28d2-1102-4afd-9b43-a7bcc928e260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b149e459f364a0a81850cb2354a7a65'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:52.740092 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-87ab28d2-1102-4afd-9b43-a7bcc928e260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b149e459f364a0a81850cb2354a7a65'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:52.750190 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-87ab28d2-1102-4afd-9b43-a7bcc928e260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b149e459f364a0a81850cb2354a7a65'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:52.781703 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1011/2027] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:52 2022] DELETE /identity/v3/users/6b149e459f364a0a81850cb2354a7a65 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:52.791225 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a489c85-c546-4905-beed-901e5e94d2db admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:52.792868 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2a489c85-c546-4905-beed-901e5e94d2db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:52.859920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a489c85-c546-4905-beed-901e5e94d2db admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:52.923757 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddcaaa-b5d1-4f50-9dc0-5bb46d6ba377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:52.924376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddcaaa-b5d1-4f50-9dc0-5bb46d6ba377 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:52.924647 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddcaaa-b5d1-4f50-9dc0-5bb46d6ba377 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:52.925086 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddcaaa-b5d1-4f50-9dc0-5bb46d6ba377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:52.927218 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-7dddcaaa-b5d1-4f50-9dc0-5bb46d6ba377 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:53.014343 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddcaaa-b5d1-4f50-9dc0-5bb46d6ba377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:53.016160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddcaaa-b5d1-4f50-9dc0-5bb46d6ba377 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:53.027039 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1017/2028] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:53.245064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab28d2-1102-4afd-9b43-a7bcc928e260 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:53.246764 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-87ab28d2-1102-4afd-9b43-a7bcc928e260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:53.351000 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab28d2-1102-4afd-9b43-a7bcc928e260 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:53.365632 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363011e9-8870-4f40-84d9-98a8299075a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:53.366445 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363011e9-8870-4f40-84d9-98a8299075a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:53.366879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363011e9-8870-4f40-84d9-98a8299075a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:53.367244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363011e9-8870-4f40-84d9-98a8299075a8 admin admin] PATH_INFO: `/v3/projects/508ed447ccf646009fc789fb11e83846` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:53.368588 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363011e9-8870-4f40-84d9-98a8299075a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=508ed447ccf646009fc789fb11e83846)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:53.371036 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363011e9-8870-4f40-84d9-98a8299075a8 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:53.468840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddcaaa-b5d1-4f50-9dc0-5bb46d6ba377 service cinder] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:53.470437 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-7dddcaaa-b5d1-4f50-9dc0-5bb46d6ba377 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:53.472995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-363011e9-8870-4f40-84d9-98a8299075a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '508ed447ccf646009fc789fb11e83846', 'request_id': 'req-363011e9-8870-4f40-84d9-98a8299075a8'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:53.484976 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-363011e9-8870-4f40-84d9-98a8299075a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '508ed447ccf646009fc789fb11e83846', 'request_id': 'req-363011e9-8870-4f40-84d9-98a8299075a8'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:53.501434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-363011e9-8870-4f40-84d9-98a8299075a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '508ed447ccf646009fc789fb11e83846', 'request_id': 'req-363011e9-8870-4f40-84d9-98a8299075a8'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:53.504000 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:53.535397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddcaaa-b5d1-4f50-9dc0-5bb46d6ba377 service cinder] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:53.544707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-363011e9-8870-4f40-84d9-98a8299075a8 admin admin] The token cache is being invalidate because project 508ed447ccf646009fc789fb11e83846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:53.545012 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-363011e9-8870-4f40-84d9-98a8299075a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:53.547484 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-363011e9-8870-4f40-84d9-98a8299075a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:53.555729 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1012/2029] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:53 2022] DELETE /identity/v3/projects/508ed447ccf646009fc789fb11e83846 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:53.558380 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddb0e3-cb55-43be-ab3f-7294ec7edcdf None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:53.558670 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddb0e3-cb55-43be-ab3f-7294ec7edcdf None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:53.558936 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddb0e3-cb55-43be-ab3f-7294ec7edcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:53.595403 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-03ddb0e3-cb55-43be-ab3f-7294ec7edcdf None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:53.598580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-03ddb0e3-cb55-43be-ab3f-7294ec7edcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:53.669427 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:53.687111 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1013/2030] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:53.689065 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb930c7-0892-45c6-833b-1f30d80a2937 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:53.689494 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb930c7-0892-45c6-833b-1f30d80a2937 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:53.690112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb930c7-0892-45c6-833b-1f30d80a2937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:53.692543 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964ba34-5a58-42bc-a494-29e143c9e04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:53.693353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964ba34-5a58-42bc-a494-29e143c9e04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:53.693844 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964ba34-5a58-42bc-a494-29e143c9e04e admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:53.694269 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964ba34-5a58-42bc-a494-29e143c9e04e admin admin] PATH_INFO: `/v3/users/8535df3ffe6c424e9b2674b25dbb5c47` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:53.697446 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964ba34-5a58-42bc-a494-29e143c9e04e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8535df3ffe6c424e9b2674b25dbb5c47)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:53.702949 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964ba34-5a58-42bc-a494-29e143c9e04e admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:53.723464 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-8bb930c7-0892-45c6-833b-1f30d80a2937 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:53.726150 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-8bb930c7-0892-45c6-833b-1f30d80a2937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:53.756383 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1014/2031] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:53.757603 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb930c7-0892-45c6-833b-1f30d80a2937 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:53.768322 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb930c7-0892-45c6-833b-1f30d80a2937 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:53.774593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f81b5b-fe99-44ce-87e4-f78d1878e08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:53.775206 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f81b5b-fe99-44ce-87e4-f78d1878e08e admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:53.775532 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f81b5b-fe99-44ce-87e4-f78d1878e08e admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:53.775927 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f81b5b-fe99-44ce-87e4-f78d1878e08e admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:53.776608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f81b5b-fe99-44ce-87e4-f78d1878e08e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:53.776913 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f81b5b-fe99-44ce-87e4-f78d1878e08e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:53.779178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f81b5b-fe99-44ce-87e4-f78d1878e08e admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:53.785942 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-c964ba34-5a58-42bc-a494-29e143c9e04e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8535df3ffe6c424e9b2674b25dbb5c47'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:53.788164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-c964ba34-5a58-42bc-a494-29e143c9e04e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8535df3ffe6c424e9b2674b25dbb5c47'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:53.794651 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1015/2032] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:45:53.802145 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f81b5b-fe99-44ce-87e4-f78d1878e08e admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:53.815065 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-c964ba34-5a58-42bc-a494-29e143c9e04e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8535df3ffe6c424e9b2674b25dbb5c47'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:53.833063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f81b5b-fe99-44ce-87e4-f78d1878e08e admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:53.839588 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-c964ba34-5a58-42bc-a494-29e143c9e04e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8535df3ffe6c424e9b2674b25dbb5c47'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:53.840463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1788bb-2f9d-402e-8c4c-0a61d932f066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:53.841230 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1788bb-2f9d-402e-8c4c-0a61d932f066 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:53.841518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1788bb-2f9d-402e-8c4c-0a61d932f066 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:53.841829 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1788bb-2f9d-402e-8c4c-0a61d932f066 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:53.842729 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1788bb-2f9d-402e-8c4c-0a61d932f066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:53.846857 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1788bb-2f9d-402e-8c4c-0a61d932f066 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:53.848199 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-c964ba34-5a58-42bc-a494-29e143c9e04e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8535df3ffe6c424e9b2674b25dbb5c47'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:53.854419 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1018/2033] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:53 2022] DELETE /identity/v3/users/8535df3ffe6c424e9b2674b25dbb5c47 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:45:53.859388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c864984-304d-4796-ba0c-c5fea879f1d8 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:53.859778 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c864984-304d-4796-ba0c-c5fea879f1d8 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:53.860065 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c864984-304d-4796-ba0c-c5fea879f1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:53.880609 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-7c864984-304d-4796-ba0c-c5fea879f1d8 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:53.881204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1016/2034] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:53 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:53.885347 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1788bb-2f9d-402e-8c4c-0a61d932f066 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:53.885511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-7c864984-304d-4796-ba0c-c5fea879f1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:53.887101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-cd1788bb-2f9d-402e-8c4c-0a61d932f066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:53.953500 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1019/2035] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:45:53.960112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1788bb-2f9d-402e-8c4c-0a61d932f066 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:53.964573 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c864984-304d-4796-ba0c-c5fea879f1d8 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:53.965486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e000c3d-4512-4ae0-a7f2-6024e46d8666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:53.965969 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-7c864984-304d-4796-ba0c-c5fea879f1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:53.966149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e000c3d-4512-4ae0-a7f2-6024e46d8666 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:53.966738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e000c3d-4512-4ae0-a7f2-6024e46d8666 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:53.966873 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e000c3d-4512-4ae0-a7f2-6024e46d8666 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:53.967691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e000c3d-4512-4ae0-a7f2-6024e46d8666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:53.969808 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e000c3d-4512-4ae0-a7f2-6024e46d8666 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:54.012455 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1017/2036] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:53 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:45:54.016207 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e000c3d-4512-4ae0-a7f2-6024e46d8666 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:54.027700 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e000c3d-4512-4ae0-a7f2-6024e46d8666 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:54.033237 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c864984-304d-4796-ba0c-c5fea879f1d8 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:54.036747 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388eb65-2e5a-4123-8258-c6e5ea0d3663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:54.037454 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388eb65-2e5a-4123-8258-c6e5ea0d3663 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:54.037619 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddb042-9e68-412b-992f-09764734083e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:54.037897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388eb65-2e5a-4123-8258-c6e5ea0d3663 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:54.038239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388eb65-2e5a-4123-8258-c6e5ea0d3663 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:54.038439 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddb042-9e68-412b-992f-09764734083e service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:54.038796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddb042-9e68-412b-992f-09764734083e service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:54.039140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddb042-9e68-412b-992f-09764734083e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:54.039425 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388eb65-2e5a-4123-8258-c6e5ea0d3663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:54.041091 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388eb65-2e5a-4123-8258-c6e5ea0d3663 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:54.049632 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddb042-9e68-412b-992f-09764734083e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:54.050728 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddb042-9e68-412b-992f-09764734083e service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:54.052983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1018/2037] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:54.056869 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388eb65-2e5a-4123-8258-c6e5ea0d3663 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:54.063296 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1020/2038] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:45:54.068497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388eb65-2e5a-4123-8258-c6e5ea0d3663 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:54.073222 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa90b1-18b1-422d-ba81-58da1eaee7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:54.073917 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa90b1-18b1-422d-ba81-58da1eaee7da admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:54.074204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa90b1-18b1-422d-ba81-58da1eaee7da admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:54.074483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa90b1-18b1-422d-ba81-58da1eaee7da admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:54.075133 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa90b1-18b1-422d-ba81-58da1eaee7da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:54.076936 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa90b1-18b1-422d-ba81-58da1eaee7da admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:54.089509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1019/2039] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:45:54.093841 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddb042-9e68-412b-992f-09764734083e service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:54.110608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddb042-9e68-412b-992f-09764734083e service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:54.116393 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a81e86-9a0f-48ec-8f45-d693833351ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:54.117695 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a81e86-9a0f-48ec-8f45-d693833351ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:54.118181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a81e86-9a0f-48ec-8f45-d693833351ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:54.118463 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a81e86-9a0f-48ec-8f45-d693833351ed admin admin] PATH_INFO: `/v3/projects/55d499da45534e539f1cf3fb6bad7efc/users/63cc1f9e479e41c2bc0d5baa2c60b903/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:54.130745 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:54.135737 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a81e86-9a0f-48ec-8f45-d693833351ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d499da45534e539f1cf3fb6bad7efc, user_id=63cc1f9e479e41c2bc0d5baa2c60b903, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:54.140738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a81e86-9a0f-48ec-8f45-d693833351ed admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:54.161543 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1021/2040] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:54 2022] PUT /identity/v3/projects/55d499da45534e539f1cf3fb6bad7efc/users/63cc1f9e479e41c2bc0d5baa2c60b903/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:54.164071 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360e17a-4db7-462d-a038-681bebc17eff None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:54.164590 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360e17a-4db7-462d-a038-681bebc17eff None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:54.165087 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360e17a-4db7-462d-a038-681bebc17eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:54.188920 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-7360e17a-4db7-462d-a038-681bebc17eff None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:54.190121 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7360e17a-4db7-462d-a038-681bebc17eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:54.203262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:54.281427 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1020/2041] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:54.291575 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a81e86-9a0f-48ec-8f45-d693833351ed admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:54.294057 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-01a81e86-9a0f-48ec-8f45-d693833351ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:54.366464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a81e86-9a0f-48ec-8f45-d693833351ed admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:54.371014 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dee9b-0241-479a-861a-9d2197ed1c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:54.371380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dee9b-0241-479a-861a-9d2197ed1c62 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:54.371861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dee9b-0241-479a-861a-9d2197ed1c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:54.372002 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dee9b-0241-479a-861a-9d2197ed1c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:54.384257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20dee9b-0241-479a-861a-9d2197ed1c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:54.385758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20dee9b-0241-479a-861a-9d2197ed1c62 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:54.397235 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1022/2042] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:54.516167 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360e17a-4db7-462d-a038-681bebc17eff None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:54.517841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7360e17a-4db7-462d-a038-681bebc17eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:54.532714 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360e17a-4db7-462d-a038-681bebc17eff None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:54.538777 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f14ad-737f-4618-9ecb-05092c4529e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:54.562266 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f14ad-737f-4618-9ecb-05092c4529e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:54.562266 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f14ad-737f-4618-9ecb-05092c4529e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:54.562266 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f14ad-737f-4618-9ecb-05092c4529e4 admin admin] PATH_INFO: `/v3/projects/cc11af1282fe47b6b0d92af19c1e018c` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:54.570202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f14ad-737f-4618-9ecb-05092c4529e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc11af1282fe47b6b0d92af19c1e018c)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:54.572165 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f14ad-737f-4618-9ecb-05092c4529e4 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:54.668849 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-600f14ad-737f-4618-9ecb-05092c4529e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc11af1282fe47b6b0d92af19c1e018c', 'request_id': 'req-600f14ad-737f-4618-9ecb-05092c4529e4'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:54.729930 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-600f14ad-737f-4618-9ecb-05092c4529e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc11af1282fe47b6b0d92af19c1e018c', 'request_id': 'req-600f14ad-737f-4618-9ecb-05092c4529e4'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:54.745164 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-600f14ad-737f-4618-9ecb-05092c4529e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc11af1282fe47b6b0d92af19c1e018c', 'request_id': 'req-600f14ad-737f-4618-9ecb-05092c4529e4'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:54.776772 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-600f14ad-737f-4618-9ecb-05092c4529e4 admin admin] The token cache is being invalidate because project cc11af1282fe47b6b0d92af19c1e018c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:54.777169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-600f14ad-737f-4618-9ecb-05092c4529e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:54.777980 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-600f14ad-737f-4618-9ecb-05092c4529e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:54.780409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1021/2043] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:54 2022] DELETE /identity/v3/projects/cc11af1282fe47b6b0d92af19c1e018c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:54.784350 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dee9b-0241-479a-861a-9d2197ed1c62 service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:54.805598 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dee9b-0241-479a-861a-9d2197ed1c62 service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:54.946781 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e591b96-38a9-424b-8f25-bb828b514f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:54.947443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e591b96-38a9-424b-8f25-bb828b514f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:54.947726 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e591b96-38a9-424b-8f25-bb828b514f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:54.948002 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e591b96-38a9-424b-8f25-bb828b514f81 admin admin] PATH_INFO: `/v3/users/222fc392471e4b43abf8201b3d856ceb` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:54.949450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e591b96-38a9-424b-8f25-bb828b514f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=222fc392471e4b43abf8201b3d856ceb)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:54.953042 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e591b96-38a9-424b-8f25-bb828b514f81 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:55.029627 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2e591b96-38a9-424b-8f25-bb828b514f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '222fc392471e4b43abf8201b3d856ceb'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:55.032170 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2e591b96-38a9-424b-8f25-bb828b514f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '222fc392471e4b43abf8201b3d856ceb'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:55.058752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2e591b96-38a9-424b-8f25-bb828b514f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '222fc392471e4b43abf8201b3d856ceb'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:55.074968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2e591b96-38a9-424b-8f25-bb828b514f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '222fc392471e4b43abf8201b3d856ceb'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:55.084222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2e591b96-38a9-424b-8f25-bb828b514f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '222fc392471e4b43abf8201b3d856ceb'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:55.094229 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1023/2044] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:54 2022] DELETE /identity/v3/users/222fc392471e4b43abf8201b3d856ceb => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:55.640139 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f14ad-737f-4618-9ecb-05092c4529e4 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:55.641922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-600f14ad-737f-4618-9ecb-05092c4529e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:55.657295 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f14ad-737f-4618-9ecb-05092c4529e4 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:55.684793 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e8230-2d9f-4b00-9f15-5b4af65fede2 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:55.685044 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e8230-2d9f-4b00-9f15-5b4af65fede2 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:55.685319 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e8230-2d9f-4b00-9f15-5b4af65fede2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:55.734913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:55.749805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-219e8230-2d9f-4b00-9f15-5b4af65fede2 None None] MFA Rules not processed for user `63cc1f9e479e41c2bc0d5baa2c60b903`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:55.760641 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb47ca-b95e-4283-a910-cb427b9d2643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:55.761389 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb47ca-b95e-4283-a910-cb427b9d2643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:55.762141 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb47ca-b95e-4283-a910-cb427b9d2643 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:55.762462 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb47ca-b95e-4283-a910-cb427b9d2643 admin admin] PATH_INFO: `/v3/projects/170bc190fac54bd8b9be943ce2d54c13` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:55.764104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb47ca-b95e-4283-a910-cb427b9d2643 admin admin] RBAC: Authorizing `identity:delete_project(project_id=170bc190fac54bd8b9be943ce2d54c13)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:55.765195 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-219e8230-2d9f-4b00-9f15-5b4af65fede2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:55.771157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb47ca-b95e-4283-a910-cb427b9d2643 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:55.916013 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:55.922044 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-60fb47ca-b95e-4283-a910-cb427b9d2643 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '170bc190fac54bd8b9be943ce2d54c13', 'request_id': 'req-60fb47ca-b95e-4283-a910-cb427b9d2643'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:55.934507 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-60fb47ca-b95e-4283-a910-cb427b9d2643 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '170bc190fac54bd8b9be943ce2d54c13', 'request_id': 'req-60fb47ca-b95e-4283-a910-cb427b9d2643'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:55.942143 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1024/2045] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:55.957343 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-60fb47ca-b95e-4283-a910-cb427b9d2643 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '170bc190fac54bd8b9be943ce2d54c13', 'request_id': 'req-60fb47ca-b95e-4283-a910-cb427b9d2643'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:55.958559 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e8230-2d9f-4b00-9f15-5b4af65fede2 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:55.961666 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-219e8230-2d9f-4b00-9f15-5b4af65fede2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:55.970403 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-60fb47ca-b95e-4283-a910-cb427b9d2643 admin admin] The token cache is being invalidate because project 170bc190fac54bd8b9be943ce2d54c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:55.971744 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-60fb47ca-b95e-4283-a910-cb427b9d2643 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:55.972305 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-60fb47ca-b95e-4283-a910-cb427b9d2643 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:55.974082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1022/2046] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:55 2022] DELETE /identity/v3/projects/170bc190fac54bd8b9be943ce2d54c13 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:55.978710 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb47ca-b95e-4283-a910-cb427b9d2643 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:55.980162 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-60fb47ca-b95e-4283-a910-cb427b9d2643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:56.039411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e8230-2d9f-4b00-9f15-5b4af65fede2 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:56.074355 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb47ca-b95e-4283-a910-cb427b9d2643 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:56.079999 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ccfbc-67a2-4775-b64c-ca7a1b2a470d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:56.080644 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ccfbc-67a2-4775-b64c-ca7a1b2a470d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:56.080925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ccfbc-67a2-4775-b64c-ca7a1b2a470d admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:56.081200 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ccfbc-67a2-4775-b64c-ca7a1b2a470d admin admin] PATH_INFO: `/v3/users/4731707f8d4542bbac0710a71f9bc77d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:56.082407 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ccfbc-67a2-4775-b64c-ca7a1b2a470d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4731707f8d4542bbac0710a71f9bc77d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:56.084440 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ccfbc-67a2-4775-b64c-ca7a1b2a470d admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:56.095363 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6352b1-3643-4ec5-9ede-4b24c3cb3822 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:56.096319 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6352b1-3643-4ec5-9ede-4b24c3cb3822 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:56.096676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6352b1-3643-4ec5-9ede-4b24c3cb3822 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:56.097016 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6352b1-3643-4ec5-9ede-4b24c3cb3822 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:56.098863 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-ed6352b1-3643-4ec5-9ede-4b24c3cb3822 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:56.147481 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a70ccfbc-67a2-4775-b64c-ca7a1b2a470d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4731707f8d4542bbac0710a71f9bc77d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:56.148433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a70ccfbc-67a2-4775-b64c-ca7a1b2a470d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4731707f8d4542bbac0710a71f9bc77d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:56.149225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a70ccfbc-67a2-4775-b64c-ca7a1b2a470d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4731707f8d4542bbac0710a71f9bc77d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:56.164905 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a70ccfbc-67a2-4775-b64c-ca7a1b2a470d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4731707f8d4542bbac0710a71f9bc77d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:56.167140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6352b1-3643-4ec5-9ede-4b24c3cb3822 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:56.168554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6352b1-3643-4ec5-9ede-4b24c3cb3822 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:56.175326 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a70ccfbc-67a2-4775-b64c-ca7a1b2a470d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4731707f8d4542bbac0710a71f9bc77d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:56.179938 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1025/2047] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:45:56.192547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1023/2048] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:55 2022] DELETE /identity/v3/users/4731707f8d4542bbac0710a71f9bc77d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:45:56.526658 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6352b1-3643-4ec5-9ede-4b24c3cb3822 service cinder] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:56.565943 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6352b1-3643-4ec5-9ede-4b24c3cb3822 service cinder] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:56.591781 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:56.677338 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2d98e-6860-4f6b-95b4-c800f54c5fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:56.678177 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2d98e-6860-4f6b-95b4-c800f54c5fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:56.678482 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2d98e-6860-4f6b-95b4-c800f54c5fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:56.678772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2d98e-6860-4f6b-95b4-c800f54c5fe3 admin admin] PATH_INFO: `/v3/projects/e5aab4ecad0548bb9661f5957579d8f8` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:56.680831 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2d98e-6860-4f6b-95b4-c800f54c5fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5aab4ecad0548bb9661f5957579d8f8)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:56.682772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2d98e-6860-4f6b-95b4-c800f54c5fe3 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:56.744213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1cd2d98e-6860-4f6b-95b4-c800f54c5fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5aab4ecad0548bb9661f5957579d8f8', 'request_id': 'req-1cd2d98e-6860-4f6b-95b4-c800f54c5fe3'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:56.752866 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1cd2d98e-6860-4f6b-95b4-c800f54c5fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5aab4ecad0548bb9661f5957579d8f8', 'request_id': 'req-1cd2d98e-6860-4f6b-95b4-c800f54c5fe3'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:56.763341 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1cd2d98e-6860-4f6b-95b4-c800f54c5fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5aab4ecad0548bb9661f5957579d8f8', 'request_id': 'req-1cd2d98e-6860-4f6b-95b4-c800f54c5fe3'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:56.775041 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1cd2d98e-6860-4f6b-95b4-c800f54c5fe3 admin admin] The token cache is being invalidate because project e5aab4ecad0548bb9661f5957579d8f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:45:56.775329 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1cd2d98e-6860-4f6b-95b4-c800f54c5fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:56.775976 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1cd2d98e-6860-4f6b-95b4-c800f54c5fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:56.777488 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1026/2049] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:56 2022] DELETE /identity/v3/projects/e5aab4ecad0548bb9661f5957579d8f8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:56.784140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202efa7-062c-410a-acd0-00a6c80d0bb9 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:56.784622 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202efa7-062c-410a-acd0-00a6c80d0bb9 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:56.784712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202efa7-062c-410a-acd0-00a6c80d0bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:56.805325 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-d202efa7-062c-410a-acd0-00a6c80d0bb9 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:56.806664 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-d202efa7-062c-410a-acd0-00a6c80d0bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:56.873294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:56.891304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1024/2050] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:45:56.900745 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe3ad9-e4be-403f-b661-43d22ffaa372 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:56.901064 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe3ad9-e4be-403f-b661-43d22ffaa372 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:56.901346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe3ad9-e4be-403f-b661-43d22ffaa372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:56.922381 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-85fe3ad9-e4be-403f-b661-43d22ffaa372 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:56.923691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-85fe3ad9-e4be-403f-b661-43d22ffaa372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:56.932141 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1027/2051] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:56.937842 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202efa7-062c-410a-acd0-00a6c80d0bb9 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:56.951392 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202efa7-062c-410a-acd0-00a6c80d0bb9 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:56.956915 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c9705-5996-4800-9cab-b29140df80b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:56.957569 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c9705-5996-4800-9cab-b29140df80b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:56.957980 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c9705-5996-4800-9cab-b29140df80b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:56.958263 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c9705-5996-4800-9cab-b29140df80b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:56.958922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c9705-5996-4800-9cab-b29140df80b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:45:56.959261 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c9705-5996-4800-9cab-b29140df80b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:56.960847 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c9705-5996-4800-9cab-b29140df80b4 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:56.975155 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1025/2052] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:45:56.980360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe3ad9-e4be-403f-b661-43d22ffaa372 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:56.991374 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe3ad9-e4be-403f-b661-43d22ffaa372 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:56.996796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b5d1c-4370-4d44-982a-7176026133bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:56.997559 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b5d1c-4370-4d44-982a-7176026133bc admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:56.997932 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b5d1c-4370-4d44-982a-7176026133bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:56.998274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b5d1c-4370-4d44-982a-7176026133bc admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:56.999530 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b5d1c-4370-4d44-982a-7176026133bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:57.001605 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b5d1c-4370-4d44-982a-7176026133bc admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:57.031407 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1028/2053] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:56 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:57.035471 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c9705-5996-4800-9cab-b29140df80b4 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:57.046828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c9705-5996-4800-9cab-b29140df80b4 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:57.109354 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088c9bd-f2e6-4150-bbfd-7c3114e73069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:57.109989 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088c9bd-f2e6-4150-bbfd-7c3114e73069 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:57.110269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088c9bd-f2e6-4150-bbfd-7c3114e73069 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:57.110538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088c9bd-f2e6-4150-bbfd-7c3114e73069 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:57.111172 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088c9bd-f2e6-4150-bbfd-7c3114e73069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:57.113071 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088c9bd-f2e6-4150-bbfd-7c3114e73069 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:57.141837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1026/2054] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:57 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:57.142730 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b5d1c-4370-4d44-982a-7176026133bc admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:57.153768 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b5d1c-4370-4d44-982a-7176026133bc admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:57.159294 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032d8f2-0926-4e3c-be5a-d0a616718cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:57.159930 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032d8f2-0926-4e3c-be5a-d0a616718cbc admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:57.160212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032d8f2-0926-4e3c-be5a-d0a616718cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:57.160710 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032d8f2-0926-4e3c-be5a-d0a616718cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:57.161131 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032d8f2-0926-4e3c-be5a-d0a616718cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:57.162862 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032d8f2-0926-4e3c-be5a-d0a616718cbc admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:57.177527 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1029/2055] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:45:57.180662 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088c9bd-f2e6-4150-bbfd-7c3114e73069 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:57.190517 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088c9bd-f2e6-4150-bbfd-7c3114e73069 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:57.195442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5dee29-d1e6-472d-a0e1-d5cec1d22c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:57.196193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dee29-d1e6-472d-a0e1-d5cec1d22c00 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:57.196604 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dee29-d1e6-472d-a0e1-d5cec1d22c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:57.197017 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dee29-d1e6-472d-a0e1-d5cec1d22c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:57.197831 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5dee29-d1e6-472d-a0e1-d5cec1d22c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:57.199633 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5dee29-d1e6-472d-a0e1-d5cec1d22c00 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:57.217856 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1027/2056] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:57.220312 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032d8f2-0926-4e3c-be5a-d0a616718cbc admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:57.236701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032d8f2-0926-4e3c-be5a-d0a616718cbc admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:57.245487 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7e7fc-ba0e-4eb2-99ca-94104fc0d62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:57.245487 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7e7fc-ba0e-4eb2-99ca-94104fc0d62c admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:57.245487 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7e7fc-ba0e-4eb2-99ca-94104fc0d62c admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:57.245487 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7e7fc-ba0e-4eb2-99ca-94104fc0d62c admin admin] PATH_INFO: `/v3/projects/209e38177a694ad29bb7c5f50b97412e/users/431103a00780418b8bd59490a3b050b9/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:57.265995 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7e7fc-ba0e-4eb2-99ca-94104fc0d62c admin admin] RBAC: Authorizing `identity:create_grant(project_id=209e38177a694ad29bb7c5f50b97412e, user_id=431103a00780418b8bd59490a3b050b9, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:57.268881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7e7fc-ba0e-4eb2-99ca-94104fc0d62c admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:57.314446 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1030/2057] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:57 2022] PUT /identity/v3/projects/209e38177a694ad29bb7c5f50b97412e/users/431103a00780418b8bd59490a3b050b9/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:57.316672 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57f71c-b3c0-4e88-81c0-a80a7e287fca None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:57.317155 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57f71c-b3c0-4e88-81c0-a80a7e287fca None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:57.317632 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57f71c-b3c0-4e88-81c0-a80a7e287fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:57.359513 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-2d57f71c-b3c0-4e88-81c0-a80a7e287fca None None] MFA Rules not processed for user `431103a00780418b8bd59490a3b050b9`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:57.362833 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-2d57f71c-b3c0-4e88-81c0-a80a7e287fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:57.496195 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1028/2058] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:57.501810 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7e7fc-ba0e-4eb2-99ca-94104fc0d62c admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:57.558312 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:57.589507 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7e7fc-ba0e-4eb2-99ca-94104fc0d62c admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:57.595303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97697c5-a5b5-4de8-900f-8fc851bbfb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:57.596360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97697c5-a5b5-4de8-900f-8fc851bbfb2d admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:57.596768 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97697c5-a5b5-4de8-900f-8fc851bbfb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:57.597087 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97697c5-a5b5-4de8-900f-8fc851bbfb2d admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:57.597863 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97697c5-a5b5-4de8-900f-8fc851bbfb2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:57.599781 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97697c5-a5b5-4de8-900f-8fc851bbfb2d admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:57.644982 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1031/2059] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:45:57 2022] POST /identity/v3/projects => generated 389 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:45:57.648873 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57f71c-b3c0-4e88-81c0-a80a7e287fca None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:57.667910 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57f71c-b3c0-4e88-81c0-a80a7e287fca None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:57.720071 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf3c8e-233c-4cdc-9acc-996e7936e47a None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:57.720464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf3c8e-233c-4cdc-9acc-996e7936e47a None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:57.721132 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf3c8e-233c-4cdc-9acc-996e7936e47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:57.747948 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-e7bf3c8e-233c-4cdc-9acc-996e7936e47a None None] MFA Rules not processed for user `63cc1f9e479e41c2bc0d5baa2c60b903`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:57.750784 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-e7bf3c8e-233c-4cdc-9acc-996e7936e47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:57.793947 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:57.818086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221fecd-ac21-4819-bd57-f7a272fe94ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:57.818991 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221fecd-ac21-4819-bd57-f7a272fe94ea admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:57.819306 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221fecd-ac21-4819-bd57-f7a272fe94ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:57.819628 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221fecd-ac21-4819-bd57-f7a272fe94ea admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:57.820359 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e221fecd-ac21-4819-bd57-f7a272fe94ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:57.823061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e221fecd-ac21-4819-bd57-f7a272fe94ea admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:57.839773 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1032/2060] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:57.860879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1029/2061] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:45:57 2022] POST /identity/v3/users => generated 301 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:45:57.863905 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf3c8e-233c-4cdc-9acc-996e7936e47a None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:57.879076 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf3c8e-233c-4cdc-9acc-996e7936e47a None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:57.886488 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a54f15-e7df-42de-bc79-ab6753d8c510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:57.887826 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a54f15-e7df-42de-bc79-ab6753d8c510 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:57.887826 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a54f15-e7df-42de-bc79-ab6753d8c510 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:57.888048 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a54f15-e7df-42de-bc79-ab6753d8c510 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:57.888927 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a54f15-e7df-42de-bc79-ab6753d8c510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:57.918016 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a54f15-e7df-42de-bc79-ab6753d8c510 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:57.941580 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1033/2062] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:57.943246 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221fecd-ac21-4819-bd57-f7a272fe94ea admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:57.955352 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221fecd-ac21-4819-bd57-f7a272fe94ea admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:57.962006 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccad095-a23b-4bdd-bffe-479dd328acdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:57.962892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccad095-a23b-4bdd-bffe-479dd328acdf admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:57.963438 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccad095-a23b-4bdd-bffe-479dd328acdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:57.964548 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccad095-a23b-4bdd-bffe-479dd328acdf admin admin] PATH_INFO: `/v3/projects/f493d959e5fa4759935146f67a4ed8b1/users/94d03b6148d943a19baa6e922b486a3b/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:58.010796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccad095-a23b-4bdd-bffe-479dd328acdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f493d959e5fa4759935146f67a4ed8b1, user_id=94d03b6148d943a19baa6e922b486a3b, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:58.019981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccad095-a23b-4bdd-bffe-479dd328acdf admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:58.055860 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1030/2063] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:57 2022] PUT /identity/v3/projects/f493d959e5fa4759935146f67a4ed8b1/users/94d03b6148d943a19baa6e922b486a3b/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:58.059733 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a54f15-e7df-42de-bc79-ab6753d8c510 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:58.074075 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a54f15-e7df-42de-bc79-ab6753d8c510 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:58.201430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc018a-335d-490d-aa18-bff0c17596b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:58.203076 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc018a-335d-490d-aa18-bff0c17596b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:58.203537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc018a-335d-490d-aa18-bff0c17596b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:58.204013 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc018a-335d-490d-aa18-bff0c17596b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:58.205516 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc018a-335d-490d-aa18-bff0c17596b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:58.207813 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc018a-335d-490d-aa18-bff0c17596b7 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:58.222303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1034/2064] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:45:58.229865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccad095-a23b-4bdd-bffe-479dd328acdf admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:58.253169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccad095-a23b-4bdd-bffe-479dd328acdf admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:58.259833 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54844d1-b439-4f00-b7a5-9118b7edc4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:58.259833 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54844d1-b439-4f00-b7a5-9118b7edc4ce admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:58.260248 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54844d1-b439-4f00-b7a5-9118b7edc4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:58.260636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54844d1-b439-4f00-b7a5-9118b7edc4ce admin admin] PATH_INFO: `/v3/projects/f493d959e5fa4759935146f67a4ed8b1/users/94d03b6148d943a19baa6e922b486a3b/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:58.262913 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54844d1-b439-4f00-b7a5-9118b7edc4ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f493d959e5fa4759935146f67a4ed8b1, user_id=94d03b6148d943a19baa6e922b486a3b, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:58.266007 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54844d1-b439-4f00-b7a5-9118b7edc4ce admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:58.281522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1031/2065] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:45:58 2022] PUT /identity/v3/projects/f493d959e5fa4759935146f67a4ed8b1/users/94d03b6148d943a19baa6e922b486a3b/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:58.290264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264afca-2525-46c2-b38a-47a8b7911072 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:58.290602 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264afca-2525-46c2-b38a-47a8b7911072 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:58.291934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264afca-2525-46c2-b38a-47a8b7911072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:58.321684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-f264afca-2525-46c2-b38a-47a8b7911072 None None] MFA Rules not processed for user `94d03b6148d943a19baa6e922b486a3b`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:58.322831 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f264afca-2525-46c2-b38a-47a8b7911072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:58.374678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:58.414211 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1035/2066] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:58 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:58.427429 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54844d1-b439-4f00-b7a5-9118b7edc4ce admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:58.430361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-a54844d1-b439-4f00-b7a5-9118b7edc4ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:58.495783 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264afca-2525-46c2-b38a-47a8b7911072 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:58.497209 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f264afca-2525-46c2-b38a-47a8b7911072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:58.510865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54844d1-b439-4f00-b7a5-9118b7edc4ce admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:58.517608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657abab8-97e7-4d50-b12e-ce9a80dc0fe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:58.518233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657abab8-97e7-4d50-b12e-ce9a80dc0fe1 service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:58.518515 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657abab8-97e7-4d50-b12e-ce9a80dc0fe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:58.518787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657abab8-97e7-4d50-b12e-ce9a80dc0fe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:58.534238 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657abab8-97e7-4d50-b12e-ce9a80dc0fe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:58.537269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657abab8-97e7-4d50-b12e-ce9a80dc0fe1 service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:58.556127 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1032/2067] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:58 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:58.604866 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264afca-2525-46c2-b38a-47a8b7911072 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:58.618055 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0714bc-9d10-4096-8ecd-50eea01c8eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:58.620285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0714bc-9d10-4096-8ecd-50eea01c8eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:58.620567 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0714bc-9d10-4096-8ecd-50eea01c8eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:58.620841 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0714bc-9d10-4096-8ecd-50eea01c8eb6 admin admin] PATH_INFO: `/v3/users/14b32262772743b4a62a524edf3dc66e` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:58.622519 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0714bc-9d10-4096-8ecd-50eea01c8eb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b32262772743b4a62a524edf3dc66e)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:58.624751 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0714bc-9d10-4096-8ecd-50eea01c8eb6 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:58.691393 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-5d0714bc-9d10-4096-8ecd-50eea01c8eb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b32262772743b4a62a524edf3dc66e'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:58.692374 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-5d0714bc-9d10-4096-8ecd-50eea01c8eb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b32262772743b4a62a524edf3dc66e'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:58.708052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-5d0714bc-9d10-4096-8ecd-50eea01c8eb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b32262772743b4a62a524edf3dc66e'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:58.724777 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-5d0714bc-9d10-4096-8ecd-50eea01c8eb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b32262772743b4a62a524edf3dc66e'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:58.751698 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-5d0714bc-9d10-4096-8ecd-50eea01c8eb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b32262772743b4a62a524edf3dc66e'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:58.761873 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657abab8-97e7-4d50-b12e-ce9a80dc0fe1 service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:58.777714 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657abab8-97e7-4d50-b12e-ce9a80dc0fe1 service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:58.781523 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1036/2068] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:58 2022] DELETE /identity/v3/users/14b32262772743b4a62a524edf3dc66e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:58.786099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9b297-8164-421a-859e-cc0846320b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:58.787114 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9b297-8164-421a-859e-cc0846320b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:58.787240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6544ff-a09c-4eab-9549-b10cedd050ec None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:58.787654 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9b297-8164-421a-859e-cc0846320b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:58.787892 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6544ff-a09c-4eab-9549-b10cedd050ec None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:58.788009 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9b297-8164-421a-859e-cc0846320b66 admin admin] PATH_INFO: `/v3/users/431103a00780418b8bd59490a3b050b9` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:58.788466 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6544ff-a09c-4eab-9549-b10cedd050ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:58.789737 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9b297-8164-421a-859e-cc0846320b66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=431103a00780418b8bd59490a3b050b9)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:58.794872 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9b297-8164-421a-859e-cc0846320b66 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:58.865018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-7c6544ff-a09c-4eab-9549-b10cedd050ec None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:58.866714 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-7c6544ff-a09c-4eab-9549-b10cedd050ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:58.966170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a1f9b297-8164-421a-859e-cc0846320b66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '431103a00780418b8bd59490a3b050b9'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:58.969926 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a1f9b297-8164-421a-859e-cc0846320b66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '431103a00780418b8bd59490a3b050b9'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:58.970561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a1f9b297-8164-421a-859e-cc0846320b66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '431103a00780418b8bd59490a3b050b9'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:58.979145 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:58.991900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a1f9b297-8164-421a-859e-cc0846320b66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '431103a00780418b8bd59490a3b050b9'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:59.007490 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1037/2069] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:59.007682 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a1f9b297-8164-421a-859e-cc0846320b66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '431103a00780418b8bd59490a3b050b9'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:45:59.021680 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6544ff-a09c-4eab-9549-b10cedd050ec None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:59.025922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-7c6544ff-a09c-4eab-9549-b10cedd050ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:59.026398 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1033/2070] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:45:58 2022] DELETE /identity/v3/users/431103a00780418b8bd59490a3b050b9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:45:59.031398 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951154cf-a491-4142-9387-1584cc4db0ed None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:59.032005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951154cf-a491-4142-9387-1584cc4db0ed None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:59.032480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951154cf-a491-4142-9387-1584cc4db0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:59.062903 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-951154cf-a491-4142-9387-1584cc4db0ed None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:45:59.064417 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-951154cf-a491-4142-9387-1584cc4db0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:59.083513 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:59.130500 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6544ff-a09c-4eab-9549-b10cedd050ec None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:59.218409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1034/2071] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:45:59.226101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951154cf-a491-4142-9387-1584cc4db0ed None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:59.238031 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5613df5-54ab-4d7f-a9f6-591b635a2a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:59.242030 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5613df5-54ab-4d7f-a9f6-591b635a2a9a service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:59.242363 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5613df5-54ab-4d7f-a9f6-591b635a2a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:59.242753 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5613df5-54ab-4d7f-a9f6-591b635a2a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:59.274452 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5613df5-54ab-4d7f-a9f6-591b635a2a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:59.276655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5613df5-54ab-4d7f-a9f6-591b635a2a9a service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:59.317264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1038/2072] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:59.363020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951154cf-a491-4142-9387-1584cc4db0ed None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:59.375562 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59673bd0-6967-4d2d-94df-417d2ed38c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:59.376536 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59673bd0-6967-4d2d-94df-417d2ed38c0a service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:59.380241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59673bd0-6967-4d2d-94df-417d2ed38c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:59.380767 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59673bd0-6967-4d2d-94df-417d2ed38c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:59.391978 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59673bd0-6967-4d2d-94df-417d2ed38c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:59.393616 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59673bd0-6967-4d2d-94df-417d2ed38c0a service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:59.405508 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1035/2073] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:45:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:45:59.883218 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5613df5-54ab-4d7f-a9f6-591b635a2a9a service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:59.885382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f5613df5-54ab-4d7f-a9f6-591b635a2a9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:59.907328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59673bd0-6967-4d2d-94df-417d2ed38c0a service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:45:59.909613 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-59673bd0-6967-4d2d-94df-417d2ed38c0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:45:59.924459 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59673bd0-6967-4d2d-94df-417d2ed38c0a service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:59.930185 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa9127-c76e-42f5-910b-8bd10f39468e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:59.930842 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa9127-c76e-42f5-910b-8bd10f39468e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:59.931083 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa9127-c76e-42f5-910b-8bd10f39468e admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:59.931375 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa9127-c76e-42f5-910b-8bd10f39468e admin admin] PATH_INFO: `/v3/projects/209e38177a694ad29bb7c5f50b97412e` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:59.932865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa9127-c76e-42f5-910b-8bd10f39468e admin admin] RBAC: Authorizing `identity:delete_project(project_id=209e38177a694ad29bb7c5f50b97412e)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:59.936160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa9127-c76e-42f5-910b-8bd10f39468e admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:45:59.943579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5613df5-54ab-4d7f-a9f6-591b635a2a9a service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:45:59.959146 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb25bd5-a7d3-40cd-873f-d84d26dbddde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:45:59.961294 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb25bd5-a7d3-40cd-873f-d84d26dbddde admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:45:59.961858 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb25bd5-a7d3-40cd-873f-d84d26dbddde admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:45:59.962212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb25bd5-a7d3-40cd-873f-d84d26dbddde admin admin] PATH_INFO: `/v3/projects/90ff51a42677491996d520e7b39928e6` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:45:59.965355 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb25bd5-a7d3-40cd-873f-d84d26dbddde admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ff51a42677491996d520e7b39928e6)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:45:59.968844 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb25bd5-a7d3-40cd-873f-d84d26dbddde admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:00.007395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-4afa9127-c76e-42f5-910b-8bd10f39468e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '209e38177a694ad29bb7c5f50b97412e', 'request_id': 'req-4afa9127-c76e-42f5-910b-8bd10f39468e'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:00.026454 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-4afa9127-c76e-42f5-910b-8bd10f39468e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '209e38177a694ad29bb7c5f50b97412e', 'request_id': 'req-4afa9127-c76e-42f5-910b-8bd10f39468e'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:00.037434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-4afa9127-c76e-42f5-910b-8bd10f39468e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '209e38177a694ad29bb7c5f50b97412e', 'request_id': 'req-4afa9127-c76e-42f5-910b-8bd10f39468e'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:00.041741 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-aeb25bd5-a7d3-40cd-873f-d84d26dbddde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ff51a42677491996d520e7b39928e6', 'request_id': 'req-aeb25bd5-a7d3-40cd-873f-d84d26dbddde'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:00.052625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-aeb25bd5-a7d3-40cd-873f-d84d26dbddde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ff51a42677491996d520e7b39928e6', 'request_id': 'req-aeb25bd5-a7d3-40cd-873f-d84d26dbddde'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:00.056090 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-4afa9127-c76e-42f5-910b-8bd10f39468e admin admin] The token cache is being invalidate because project 209e38177a694ad29bb7c5f50b97412e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:46:00.056789 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-4afa9127-c76e-42f5-910b-8bd10f39468e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:00.057932 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-4afa9127-c76e-42f5-910b-8bd10f39468e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:00.059685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1036/2074] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:59 2022] DELETE /identity/v3/projects/209e38177a694ad29bb7c5f50b97412e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:46:00.062718 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-aeb25bd5-a7d3-40cd-873f-d84d26dbddde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ff51a42677491996d520e7b39928e6', 'request_id': 'req-aeb25bd5-a7d3-40cd-873f-d84d26dbddde'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:00.064478 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa9127-c76e-42f5-910b-8bd10f39468e admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:00.066869 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-4afa9127-c76e-42f5-910b-8bd10f39468e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:00.105792 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-aeb25bd5-a7d3-40cd-873f-d84d26dbddde admin admin] The token cache is being invalidate because project 90ff51a42677491996d520e7b39928e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:46:00.106027 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-aeb25bd5-a7d3-40cd-873f-d84d26dbddde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:00.106789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-aeb25bd5-a7d3-40cd-873f-d84d26dbddde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:00.110366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1039/2075] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:45:59 2022] DELETE /identity/v3/projects/90ff51a42677491996d520e7b39928e6 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:00.112819 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb25bd5-a7d3-40cd-873f-d84d26dbddde admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:00.114624 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-aeb25bd5-a7d3-40cd-873f-d84d26dbddde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:00.124004 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:00.153957 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa9127-c76e-42f5-910b-8bd10f39468e admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:00.176614 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:00.208261 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb25bd5-a7d3-40cd-873f-d84d26dbddde admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:00.213338 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df47963-1ede-4911-8eb7-0f4eeca90511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:00.214014 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df47963-1ede-4911-8eb7-0f4eeca90511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:00.214297 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df47963-1ede-4911-8eb7-0f4eeca90511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:00.214597 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df47963-1ede-4911-8eb7-0f4eeca90511 admin admin] PATH_INFO: `/v3/users/09ac1017fa9e41518f0daedb73046a26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:00.215763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df47963-1ede-4911-8eb7-0f4eeca90511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09ac1017fa9e41518f0daedb73046a26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:00.218694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df47963-1ede-4911-8eb7-0f4eeca90511 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:00.224776 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146e4af-4b64-48db-879b-f333ac66b2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:00.224776 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146e4af-4b64-48db-879b-f333ac66b2c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:00.224776 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146e4af-4b64-48db-879b-f333ac66b2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:00.224776 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146e4af-4b64-48db-879b-f333ac66b2c8 admin admin] PATH_INFO: `/v3/users/94d03b6148d943a19baa6e922b486a3b` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:00.226151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146e4af-4b64-48db-879b-f333ac66b2c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94d03b6148d943a19baa6e922b486a3b)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:00.228271 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146e4af-4b64-48db-879b-f333ac66b2c8 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:00.297064 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-6df47963-1ede-4911-8eb7-0f4eeca90511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09ac1017fa9e41518f0daedb73046a26'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:00.298285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-6df47963-1ede-4911-8eb7-0f4eeca90511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09ac1017fa9e41518f0daedb73046a26'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:00.298637 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c146e4af-4b64-48db-879b-f333ac66b2c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94d03b6148d943a19baa6e922b486a3b'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:00.299379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c146e4af-4b64-48db-879b-f333ac66b2c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94d03b6148d943a19baa6e922b486a3b'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:00.303137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c146e4af-4b64-48db-879b-f333ac66b2c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94d03b6148d943a19baa6e922b486a3b'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:00.315537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-6df47963-1ede-4911-8eb7-0f4eeca90511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09ac1017fa9e41518f0daedb73046a26'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:00.325070 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c146e4af-4b64-48db-879b-f333ac66b2c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94d03b6148d943a19baa6e922b486a3b'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:00.329140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-6df47963-1ede-4911-8eb7-0f4eeca90511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09ac1017fa9e41518f0daedb73046a26'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:00.337242 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c146e4af-4b64-48db-879b-f333ac66b2c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94d03b6148d943a19baa6e922b486a3b'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:00.337470 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-6df47963-1ede-4911-8eb7-0f4eeca90511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09ac1017fa9e41518f0daedb73046a26'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:00.344997 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1040/2076] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:46:00 2022] DELETE /identity/v3/users/09ac1017fa9e41518f0daedb73046a26 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:00.359833 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1037/2077] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:46:00 2022] DELETE /identity/v3/users/94d03b6148d943a19baa6e922b486a3b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:46:00.971984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df47963-1ede-4911-8eb7-0f4eeca90511 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:00.973750 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-6df47963-1ede-4911-8eb7-0f4eeca90511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:00.988254 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146e4af-4b64-48db-879b-f333ac66b2c8 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:00.989778 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-c146e4af-4b64-48db-879b-f333ac66b2c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:01.065992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146e4af-4b64-48db-879b-f333ac66b2c8 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:01.069517 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df47963-1ede-4911-8eb7-0f4eeca90511 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:01.071319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ee751-002c-481c-8bba-582f2fd752c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:01.072211 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ee751-002c-481c-8bba-582f2fd752c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:01.072605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ee751-002c-481c-8bba-582f2fd752c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:01.072967 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ee751-002c-481c-8bba-582f2fd752c7 admin admin] PATH_INFO: `/v3/projects/ab31448fd7ab46eb946cfbaf41aa44ad` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:01.074376 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ee751-002c-481c-8bba-582f2fd752c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab31448fd7ab46eb946cfbaf41aa44ad)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:01.074808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f58620-4cbe-4980-bd36-b2f251230518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:01.075464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f58620-4cbe-4980-bd36-b2f251230518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:01.075883 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f58620-4cbe-4980-bd36-b2f251230518 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:01.076167 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f58620-4cbe-4980-bd36-b2f251230518 admin admin] PATH_INFO: `/v3/projects/f493d959e5fa4759935146f67a4ed8b1` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:01.076346 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ee751-002c-481c-8bba-582f2fd752c7 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:01.077442 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f58620-4cbe-4980-bd36-b2f251230518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f493d959e5fa4759935146f67a4ed8b1)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:01.079524 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f58620-4cbe-4980-bd36-b2f251230518 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:01.085895 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:01.156703 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-56f58620-4cbe-4980-bd36-b2f251230518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f493d959e5fa4759935146f67a4ed8b1', 'request_id': 'req-56f58620-4cbe-4980-bd36-b2f251230518'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:01.158900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-401ee751-002c-481c-8bba-582f2fd752c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab31448fd7ab46eb946cfbaf41aa44ad', 'request_id': 'req-401ee751-002c-481c-8bba-582f2fd752c7'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:01.175467 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-56f58620-4cbe-4980-bd36-b2f251230518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f493d959e5fa4759935146f67a4ed8b1', 'request_id': 'req-56f58620-4cbe-4980-bd36-b2f251230518'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:01.189951 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-401ee751-002c-481c-8bba-582f2fd752c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab31448fd7ab46eb946cfbaf41aa44ad', 'request_id': 'req-401ee751-002c-481c-8bba-582f2fd752c7'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:01.191449 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-56f58620-4cbe-4980-bd36-b2f251230518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f493d959e5fa4759935146f67a4ed8b1', 'request_id': 'req-56f58620-4cbe-4980-bd36-b2f251230518'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:01.192984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:01.207831 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-56f58620-4cbe-4980-bd36-b2f251230518 admin admin] The token cache is being invalidate because project f493d959e5fa4759935146f67a4ed8b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:46:01.208153 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-56f58620-4cbe-4980-bd36-b2f251230518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:01.209036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-56f58620-4cbe-4980-bd36-b2f251230518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:01.211316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1041/2078] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:46:00 2022] DELETE /identity/v3/projects/f493d959e5fa4759935146f67a4ed8b1 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:01.214388 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-401ee751-002c-481c-8bba-582f2fd752c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab31448fd7ab46eb946cfbaf41aa44ad', 'request_id': 'req-401ee751-002c-481c-8bba-582f2fd752c7'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:01.216085 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865dd39-4ad5-41eb-ad30-fad058af45f2 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:01.216369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865dd39-4ad5-41eb-ad30-fad058af45f2 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:01.217062 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865dd39-4ad5-41eb-ad30-fad058af45f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:01.229543 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-401ee751-002c-481c-8bba-582f2fd752c7 admin admin] The token cache is being invalidate because project ab31448fd7ab46eb946cfbaf41aa44ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:46:01.229847 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-401ee751-002c-481c-8bba-582f2fd752c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:01.230859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-401ee751-002c-481c-8bba-582f2fd752c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:01.236641 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1038/2079] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:46:00 2022] DELETE /identity/v3/projects/ab31448fd7ab46eb946cfbaf41aa44ad => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:01.258391 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a96b9-c97c-48e0-97cd-ca8c1684768f None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:01.258864 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a96b9-c97c-48e0-97cd-ca8c1684768f None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:01.260022 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a96b9-c97c-48e0-97cd-ca8c1684768f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:01.262216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-7865dd39-4ad5-41eb-ad30-fad058af45f2 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:01.263500 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-7865dd39-4ad5-41eb-ad30-fad058af45f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:01.297801 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-265a96b9-c97c-48e0-97cd-ca8c1684768f None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:01.299062 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-265a96b9-c97c-48e0-97cd-ca8c1684768f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:01.363687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1042/2080] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:01.376271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29eb33a-8a5a-467b-b461-5d372239a442 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:01.376693 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29eb33a-8a5a-467b-b461-5d372239a442 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:01.376979 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29eb33a-8a5a-467b-b461-5d372239a442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:01.396496 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1039/2081] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:46:01.407000 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18deb34f-af16-42f6-9cc6-661f41d37f33 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:01.407538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18deb34f-af16-42f6-9cc6-661f41d37f33 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:01.408074 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18deb34f-af16-42f6-9cc6-661f41d37f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:01.439958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-b29eb33a-8a5a-467b-b461-5d372239a442 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:01.442124 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-b29eb33a-8a5a-467b-b461-5d372239a442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:01.443762 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-18deb34f-af16-42f6-9cc6-661f41d37f33 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:01.445282 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-18deb34f-af16-42f6-9cc6-661f41d37f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:01.457050 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1043/2082] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:01.458287 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29eb33a-8a5a-467b-b461-5d372239a442 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:01.460439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1040/2083] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:46:01.464311 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18deb34f-af16-42f6-9cc6-661f41d37f33 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:01.471445 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29eb33a-8a5a-467b-b461-5d372239a442 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:01.477709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f4d18-b479-4f7f-a7cc-8e4c4882b682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:01.478720 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f4d18-b479-4f7f-a7cc-8e4c4882b682 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:01.479120 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f4d18-b479-4f7f-a7cc-8e4c4882b682 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:01.479519 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f4d18-b479-4f7f-a7cc-8e4c4882b682 admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:01.480399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f4d18-b479-4f7f-a7cc-8e4c4882b682 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:01.480772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f4d18-b479-4f7f-a7cc-8e4c4882b682 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:01.482515 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f4d18-b479-4f7f-a7cc-8e4c4882b682 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:01.482859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18deb34f-af16-42f6-9cc6-661f41d37f33 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:01.491717 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a79a8-de6a-4706-9358-215bcdd83c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:01.492342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a79a8-de6a-4706-9358-215bcdd83c06 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:01.492603 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a79a8-de6a-4706-9358-215bcdd83c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:01.492871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a79a8-de6a-4706-9358-215bcdd83c06 admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:01.493578 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a79a8-de6a-4706-9358-215bcdd83c06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:01.493883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a79a8-de6a-4706-9358-215bcdd83c06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:01.499387 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a79a8-de6a-4706-9358-215bcdd83c06 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:01.499527 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1044/2084] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:01.500557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f4d18-b479-4f7f-a7cc-8e4c4882b682 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:01.509065 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1041/2085] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:01.511636 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f4d18-b479-4f7f-a7cc-8e4c4882b682 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:01.513181 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a79a8-de6a-4706-9358-215bcdd83c06 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:01.519433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf68262-1d7b-4718-bfda-e5f2b3875def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:01.520830 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf68262-1d7b-4718-bfda-e5f2b3875def admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:01.521262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf68262-1d7b-4718-bfda-e5f2b3875def admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:01.521859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf68262-1d7b-4718-bfda-e5f2b3875def admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:01.522679 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf68262-1d7b-4718-bfda-e5f2b3875def admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:01.524945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf68262-1d7b-4718-bfda-e5f2b3875def admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:01.528700 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a79a8-de6a-4706-9358-215bcdd83c06 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:01.534635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f5aa9-9340-4a22-80e7-228571a9a2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:01.534999 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f5aa9-9340-4a22-80e7-228571a9a2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:01.535280 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f5aa9-9340-4a22-80e7-228571a9a2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:01.535715 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f5aa9-9340-4a22-80e7-228571a9a2a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:01.536468 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f5aa9-9340-4a22-80e7-228571a9a2a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:01.538316 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f5aa9-9340-4a22-80e7-228571a9a2a9 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:01.565907 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1045/2086] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:46:01 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:01.573213 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1042/2087] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:46:01 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:01.573527 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf68262-1d7b-4718-bfda-e5f2b3875def admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:01.574583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f5aa9-9340-4a22-80e7-228571a9a2a9 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:01.651784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:01.655438 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf68262-1d7b-4718-bfda-e5f2b3875def admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:01.657447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f5aa9-9340-4a22-80e7-228571a9a2a9 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:01.663054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e75598-6875-4136-92d4-ea3e78d71e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:01.664854 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e75598-6875-4136-92d4-ea3e78d71e7d admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:01.665127 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e75598-6875-4136-92d4-ea3e78d71e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:01.665429 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e75598-6875-4136-92d4-ea3e78d71e7d admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:01.666198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e75598-6875-4136-92d4-ea3e78d71e7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:01.666636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65b040-8aa6-47de-a623-bf7e0f101589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:01.667390 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65b040-8aa6-47de-a623-bf7e0f101589 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:01.667764 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65b040-8aa6-47de-a623-bf7e0f101589 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:01.668199 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e75598-6875-4136-92d4-ea3e78d71e7d admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:01.668813 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65b040-8aa6-47de-a623-bf7e0f101589 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:01.669748 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65b040-8aa6-47de-a623-bf7e0f101589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:01.672560 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65b040-8aa6-47de-a623-bf7e0f101589 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:01.700293 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1046/2088] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:46:01 2022] POST /identity/v3/users => generated 290 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:46:01.701735 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e75598-6875-4136-92d4-ea3e78d71e7d admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:01.706135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1043/2089] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:46:01 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:46:01.709940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65b040-8aa6-47de-a623-bf7e0f101589 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:01.715153 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e75598-6875-4136-92d4-ea3e78d71e7d admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:01.721974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65b040-8aa6-47de-a623-bf7e0f101589 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:01.722132 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d7c82-717f-4d10-b432-f42bf4167409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:01.723006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d7c82-717f-4d10-b432-f42bf4167409 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:01.723006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d7c82-717f-4d10-b432-f42bf4167409 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:01.723214 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d7c82-717f-4d10-b432-f42bf4167409 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:01.723850 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d7c82-717f-4d10-b432-f42bf4167409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:01.725494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d7c82-717f-4d10-b432-f42bf4167409 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:01.728072 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3201c-e29c-4e6e-8003-d994801dbb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:01.728956 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3201c-e29c-4e6e-8003-d994801dbb99 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:01.729312 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3201c-e29c-4e6e-8003-d994801dbb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:01.729687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3201c-e29c-4e6e-8003-d994801dbb99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:01.730701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3201c-e29c-4e6e-8003-d994801dbb99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:01.732682 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3201c-e29c-4e6e-8003-d994801dbb99 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:01.739284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1047/2090] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:01.743127 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d7c82-717f-4d10-b432-f42bf4167409 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:01.749911 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1044/2091] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:46:01.751107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3201c-e29c-4e6e-8003-d994801dbb99 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:01.753597 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d7c82-717f-4d10-b432-f42bf4167409 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:01.758391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142b884-fe97-40e0-aa9f-f01b7dd8b318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:01.759064 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142b884-fe97-40e0-aa9f-f01b7dd8b318 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:01.759346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142b884-fe97-40e0-aa9f-f01b7dd8b318 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:01.759618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142b884-fe97-40e0-aa9f-f01b7dd8b318 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:01.760257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142b884-fe97-40e0-aa9f-f01b7dd8b318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:01.761866 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142b884-fe97-40e0-aa9f-f01b7dd8b318 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:01.763190 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3201c-e29c-4e6e-8003-d994801dbb99 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:01.769191 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15cd50-ac6c-4bd2-b917-f07a4725f3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:01.770386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15cd50-ac6c-4bd2-b917-f07a4725f3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:01.770827 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15cd50-ac6c-4bd2-b917-f07a4725f3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:01.771259 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15cd50-ac6c-4bd2-b917-f07a4725f3f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:01.772086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15cd50-ac6c-4bd2-b917-f07a4725f3f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:01.772694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1048/2092] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:46:01.774891 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15cd50-ac6c-4bd2-b917-f07a4725f3f1 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:01.777033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142b884-fe97-40e0-aa9f-f01b7dd8b318 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:01.792018 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1045/2093] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:01.793103 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142b884-fe97-40e0-aa9f-f01b7dd8b318 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:01.795048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15cd50-ac6c-4bd2-b917-f07a4725f3f1 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:01.798855 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8ff2c-2a24-4bb8-8afd-6639e91f0e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:01.799523 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8ff2c-2a24-4bb8-8afd-6639e91f0e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:01.799801 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8ff2c-2a24-4bb8-8afd-6639e91f0e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:01.800073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8ff2c-2a24-4bb8-8afd-6639e91f0e7f admin admin] PATH_INFO: `/v3/projects/5083dae6fdd74c76b4b8d16cd05f4b62/users/d4a85f3b33af4c9db3de948a0943918e/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:01.809440 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15cd50-ac6c-4bd2-b917-f07a4725f3f1 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:01.813833 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:01.817382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8ff2c-2a24-4bb8-8afd-6639e91f0e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5083dae6fdd74c76b4b8d16cd05f4b62, user_id=d4a85f3b33af4c9db3de948a0943918e, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:01.818124 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183beabf-9c55-4bf3-8c99-98370aca0296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:01.818819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183beabf-9c55-4bf3-8c99-98370aca0296 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:01.819098 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183beabf-9c55-4bf3-8c99-98370aca0296 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:01.819386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183beabf-9c55-4bf3-8c99-98370aca0296 admin admin] PATH_INFO: `/v3/projects/e33ee16551a347fb85e657265994776c/users/07d277daf99840498860ea3c7738750b/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:01.823234 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8ff2c-2a24-4bb8-8afd-6639e91f0e7f admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:01.838149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183beabf-9c55-4bf3-8c99-98370aca0296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33ee16551a347fb85e657265994776c, user_id=07d277daf99840498860ea3c7738750b, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:01.838382 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1049/2094] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:46:01 2022] PUT /identity/v3/projects/5083dae6fdd74c76b4b8d16cd05f4b62/users/d4a85f3b33af4c9db3de948a0943918e/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:01.843887 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183beabf-9c55-4bf3-8c99-98370aca0296 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:01.849263 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa0d02-feec-41a8-a936-aa5b459cf1f7 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:01.849613 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa0d02-feec-41a8-a936-aa5b459cf1f7 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:01.849953 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa0d02-feec-41a8-a936-aa5b459cf1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:01.869437 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1046/2095] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:46:01 2022] PUT /identity/v3/projects/e33ee16551a347fb85e657265994776c/users/07d277daf99840498860ea3c7738750b/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:01.876328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0617ac-3e0e-40d5-931d-cd8a0dff5dcc None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:01.876610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0617ac-3e0e-40d5-931d-cd8a0dff5dcc None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:01.876914 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0617ac-3e0e-40d5-931d-cd8a0dff5dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:01.888430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-edfa0d02-feec-41a8-a936-aa5b459cf1f7 None None] MFA Rules not processed for user `d4a85f3b33af4c9db3de948a0943918e`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:01.890401 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-edfa0d02-feec-41a8-a936-aa5b459cf1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:01.918226 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-5e0617ac-3e0e-40d5-931d-cd8a0dff5dcc None None] MFA Rules not processed for user `07d277daf99840498860ea3c7738750b`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:01.920997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-5e0617ac-3e0e-40d5-931d-cd8a0dff5dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:01.984387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1050/2096] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:46:01.988374 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa0d02-feec-41a8-a936-aa5b459cf1f7 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:02.019660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1047/2097] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:46:02.032867 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0617ac-3e0e-40d5-931d-cd8a0dff5dcc None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:02.035903 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-5e0617ac-3e0e-40d5-931d-cd8a0dff5dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:02.080297 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa0d02-feec-41a8-a936-aa5b459cf1f7 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:02.091349 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dcbc9-43dc-4b23-a7a6-815bf606d67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:02.092001 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dcbc9-43dc-4b23-a7a6-815bf606d67f admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:02.092464 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dcbc9-43dc-4b23-a7a6-815bf606d67f admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:02.092618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dcbc9-43dc-4b23-a7a6-815bf606d67f admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:02.093390 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dcbc9-43dc-4b23-a7a6-815bf606d67f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:02.096069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dcbc9-43dc-4b23-a7a6-815bf606d67f admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:02.108860 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0617ac-3e0e-40d5-931d-cd8a0dff5dcc None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:02.134478 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd66cf-5939-4a44-bb77-5435c4eb988e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:02.135469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd66cf-5939-4a44-bb77-5435c4eb988e service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:02.135975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd66cf-5939-4a44-bb77-5435c4eb988e service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:02.136475 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd66cf-5939-4a44-bb77-5435c4eb988e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:02.152966 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1051/2098] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:46:01 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:46:02.153736 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd66cf-5939-4a44-bb77-5435c4eb988e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:02.154157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dcbc9-43dc-4b23-a7a6-815bf606d67f admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:02.157784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd66cf-5939-4a44-bb77-5435c4eb988e service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:02.182480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1048/2099] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:46:02.211313 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd66cf-5939-4a44-bb77-5435c4eb988e service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:02.233908 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd66cf-5939-4a44-bb77-5435c4eb988e service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:02.242673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cefde-faa4-495f-8cec-80a42ccdce44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:02.243362 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cefde-faa4-495f-8cec-80a42ccdce44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:02.243658 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cefde-faa4-495f-8cec-80a42ccdce44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:02.243936 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cefde-faa4-495f-8cec-80a42ccdce44 admin admin] PATH_INFO: `/v3/users/07d277daf99840498860ea3c7738750b` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:02.246664 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cefde-faa4-495f-8cec-80a42ccdce44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07d277daf99840498860ea3c7738750b)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:02.247405 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dcbc9-43dc-4b23-a7a6-815bf606d67f admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:02.248968 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cefde-faa4-495f-8cec-80a42ccdce44 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:02.259328 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3124c-1208-4502-a1d1-c9be8e7fcf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:02.260102 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3124c-1208-4502-a1d1-c9be8e7fcf31 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:02.260485 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3124c-1208-4502-a1d1-c9be8e7fcf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:02.260859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3124c-1208-4502-a1d1-c9be8e7fcf31 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:02.261911 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3124c-1208-4502-a1d1-c9be8e7fcf31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:02.264504 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3124c-1208-4502-a1d1-c9be8e7fcf31 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:02.297167 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:02.314734 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1052/2100] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:46:02 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:02.319147 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:02.320326 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3124c-1208-4502-a1d1-c9be8e7fcf31 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:02.341808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3124c-1208-4502-a1d1-c9be8e7fcf31 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:02.346696 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b0fce-9b03-488e-8c48-9e78bcc492f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:02.347131 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b0fce-9b03-488e-8c48-9e78bcc492f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:02.347423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b0fce-9b03-488e-8c48-9e78bcc492f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:02.347761 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b0fce-9b03-488e-8c48-9e78bcc492f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:02.348511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b0fce-9b03-488e-8c48-9e78bcc492f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:02.350273 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b0fce-9b03-488e-8c48-9e78bcc492f3 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:02.376393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-294cefde-faa4-495f-8cec-80a42ccdce44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07d277daf99840498860ea3c7738750b'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:02.377375 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-294cefde-faa4-495f-8cec-80a42ccdce44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07d277daf99840498860ea3c7738750b'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:02.377815 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1053/2101] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:02.379086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-294cefde-faa4-495f-8cec-80a42ccdce44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07d277daf99840498860ea3c7738750b'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:02.385350 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b0fce-9b03-488e-8c48-9e78bcc492f3 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:02.387653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-112b0fce-9b03-488e-8c48-9e78bcc492f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:02.404713 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-294cefde-faa4-495f-8cec-80a42ccdce44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07d277daf99840498860ea3c7738750b'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:02.416911 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b0fce-9b03-488e-8c48-9e78bcc492f3 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:02.421606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-294cefde-faa4-495f-8cec-80a42ccdce44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07d277daf99840498860ea3c7738750b'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:02.439723 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bbf5c-d393-41bb-b84b-5ffcd4515bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:02.442401 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bbf5c-d393-41bb-b84b-5ffcd4515bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:02.444726 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bbf5c-d393-41bb-b84b-5ffcd4515bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:02.445151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bbf5c-d393-41bb-b84b-5ffcd4515bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:02.446005 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910bbf5c-d393-41bb-b84b-5ffcd4515bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:02.452508 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910bbf5c-d393-41bb-b84b-5ffcd4515bf7 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:02.470925 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1049/2102] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:46:02 2022] DELETE /identity/v3/users/07d277daf99840498860ea3c7738750b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:46:02.475303 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43332a-bacd-497a-bda1-78e7ec6abf26 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:02.476164 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43332a-bacd-497a-bda1-78e7ec6abf26 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:02.476477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43332a-bacd-497a-bda1-78e7ec6abf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:02.485401 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1054/2103] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:02.489527 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bbf5c-d393-41bb-b84b-5ffcd4515bf7 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:02.537894 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bbf5c-d393-41bb-b84b-5ffcd4515bf7 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:02.547256 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-fa43332a-bacd-497a-bda1-78e7ec6abf26 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:02.548534 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-fa43332a-bacd-497a-bda1-78e7ec6abf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:02.680406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1050/2104] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:02.691809 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865e565-c19b-49cf-9cb0-8916222a0ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:02.692747 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865e565-c19b-49cf-9cb0-8916222a0ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:02.693187 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865e565-c19b-49cf-9cb0-8916222a0ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:02.693668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865e565-c19b-49cf-9cb0-8916222a0ce7 admin admin] PATH_INFO: `/v3/projects/cc9de56e0a5e4047a42047792e1fb202/users/a87c45e76dc34c0c8f1ea9e524c92c67/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:02.711934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865e565-c19b-49cf-9cb0-8916222a0ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc9de56e0a5e4047a42047792e1fb202, user_id=a87c45e76dc34c0c8f1ea9e524c92c67, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:02.714807 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865e565-c19b-49cf-9cb0-8916222a0ce7 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:02.753570 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1055/2105] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:46:02 2022] PUT /identity/v3/projects/cc9de56e0a5e4047a42047792e1fb202/users/a87c45e76dc34c0c8f1ea9e524c92c67/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:02.759417 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965814d-41be-418f-9683-7ca29bb0012f None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:02.760516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965814d-41be-418f-9683-7ca29bb0012f None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:02.761101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965814d-41be-418f-9683-7ca29bb0012f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:02.800683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865e565-c19b-49cf-9cb0-8916222a0ce7 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:02.803922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f865e565-c19b-49cf-9cb0-8916222a0ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:02.879264 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-2965814d-41be-418f-9683-7ca29bb0012f None None] MFA Rules not processed for user `a87c45e76dc34c0c8f1ea9e524c92c67`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:02.901449 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-2965814d-41be-418f-9683-7ca29bb0012f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:02.946489 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865e565-c19b-49cf-9cb0-8916222a0ce7 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:02.950770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07772842-cc6e-45d4-b848-12323dcd8766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:02.951414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07772842-cc6e-45d4-b848-12323dcd8766 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:02.951699 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07772842-cc6e-45d4-b848-12323dcd8766 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:02.951973 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07772842-cc6e-45d4-b848-12323dcd8766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:03.009376 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1051/2106] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:03.013796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965814d-41be-418f-9683-7ca29bb0012f None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:03.028575 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07772842-cc6e-45d4-b848-12323dcd8766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:03.030772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07772842-cc6e-45d4-b848-12323dcd8766 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:03.043403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1056/2107] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:46:03.051158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:03.089382 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965814d-41be-418f-9683-7ca29bb0012f None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:03.094735 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92035f09-6684-4fc4-b55e-21fcd2140e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:03.095345 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92035f09-6684-4fc4-b55e-21fcd2140e55 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:03.095915 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92035f09-6684-4fc4-b55e-21fcd2140e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:03.096189 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92035f09-6684-4fc4-b55e-21fcd2140e55 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:03.096823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92035f09-6684-4fc4-b55e-21fcd2140e55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:03.098876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92035f09-6684-4fc4-b55e-21fcd2140e55 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:03.139381 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1052/2108] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:46:03 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:46:03.141005 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07772842-cc6e-45d4-b848-12323dcd8766 service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:03.151102 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07772842-cc6e-45d4-b848-12323dcd8766 service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:03.155373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:03.228199 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ea39e-fa6c-4a45-a0d2-2df80bda1143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:03.228824 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ea39e-fa6c-4a45-a0d2-2df80bda1143 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:03.229102 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ea39e-fa6c-4a45-a0d2-2df80bda1143 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:03.229795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ea39e-fa6c-4a45-a0d2-2df80bda1143 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:03.230253 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ea39e-fa6c-4a45-a0d2-2df80bda1143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:03.232196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ea39e-fa6c-4a45-a0d2-2df80bda1143 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:03.263395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1057/2109] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:46:03 2022] POST /identity/v3/users => generated 296 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:46:03.265270 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92035f09-6684-4fc4-b55e-21fcd2140e55 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:03.283841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92035f09-6684-4fc4-b55e-21fcd2140e55 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:03.290583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda08a4-88bd-4578-a0ca-a9c435bf0578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:03.291390 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda08a4-88bd-4578-a0ca-a9c435bf0578 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:03.291680 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda08a4-88bd-4578-a0ca-a9c435bf0578 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:03.291954 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda08a4-88bd-4578-a0ca-a9c435bf0578 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:03.292761 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda08a4-88bd-4578-a0ca-a9c435bf0578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:03.294788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda08a4-88bd-4578-a0ca-a9c435bf0578 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:03.313726 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1053/2110] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:03.317414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ea39e-fa6c-4a45-a0d2-2df80bda1143 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:03.331457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ea39e-fa6c-4a45-a0d2-2df80bda1143 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:03.344516 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2927f5-cbf2-4c77-8ea8-66ee6769b552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:03.345850 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2927f5-cbf2-4c77-8ea8-66ee6769b552 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:03.346324 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2927f5-cbf2-4c77-8ea8-66ee6769b552 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:03.346797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2927f5-cbf2-4c77-8ea8-66ee6769b552 admin admin] PATH_INFO: `/v3/projects/a8dc64d7a85047f793c42ec7f2b6359f/users/cf3bf1e41ff24d45887f52cfc75de28d/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:03.376125 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2927f5-cbf2-4c77-8ea8-66ee6769b552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8dc64d7a85047f793c42ec7f2b6359f, user_id=cf3bf1e41ff24d45887f52cfc75de28d, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:03.380211 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2927f5-cbf2-4c77-8ea8-66ee6769b552 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:03.407281 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1058/2111] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:46:03 2022] PUT /identity/v3/projects/a8dc64d7a85047f793c42ec7f2b6359f/users/cf3bf1e41ff24d45887f52cfc75de28d/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:03.411107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda08a4-88bd-4578-a0ca-a9c435bf0578 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:03.423702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda08a4-88bd-4578-a0ca-a9c435bf0578 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:03.527869 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53f3eb-c089-4b0d-a233-fab0282476f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:03.529003 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53f3eb-c089-4b0d-a233-fab0282476f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:03.529293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53f3eb-c089-4b0d-a233-fab0282476f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:03.529739 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53f3eb-c089-4b0d-a233-fab0282476f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:03.531028 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53f3eb-c089-4b0d-a233-fab0282476f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:03.533007 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53f3eb-c089-4b0d-a233-fab0282476f8 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:03.549509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1054/2112] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:03.550113 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2927f5-cbf2-4c77-8ea8-66ee6769b552 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:03.560763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2927f5-cbf2-4c77-8ea8-66ee6769b552 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:03.566572 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501604f-fd2e-4352-80fc-a1339f1081c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:03.567244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501604f-fd2e-4352-80fc-a1339f1081c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:03.567520 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501604f-fd2e-4352-80fc-a1339f1081c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:03.567794 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501604f-fd2e-4352-80fc-a1339f1081c3 admin admin] PATH_INFO: `/v3/projects/a8dc64d7a85047f793c42ec7f2b6359f/users/cf3bf1e41ff24d45887f52cfc75de28d/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:03.570710 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501604f-fd2e-4352-80fc-a1339f1081c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8dc64d7a85047f793c42ec7f2b6359f, user_id=cf3bf1e41ff24d45887f52cfc75de28d, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:03.574813 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501604f-fd2e-4352-80fc-a1339f1081c3 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:03.590719 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1059/2113] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:46:03 2022] PUT /identity/v3/projects/a8dc64d7a85047f793c42ec7f2b6359f/users/cf3bf1e41ff24d45887f52cfc75de28d/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:46:03.601120 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ab971-47f3-4150-abb6-79f0f69353f6 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:03.601430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ab971-47f3-4150-abb6-79f0f69353f6 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:03.601744 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ab971-47f3-4150-abb6-79f0f69353f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:03.644416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-6b7ab971-47f3-4150-abb6-79f0f69353f6 None None] MFA Rules not processed for user `cf3bf1e41ff24d45887f52cfc75de28d`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:03.646032 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-6b7ab971-47f3-4150-abb6-79f0f69353f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:03.681023 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501604f-fd2e-4352-80fc-a1339f1081c3 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:03.684070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-5501604f-fd2e-4352-80fc-a1339f1081c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:03.758758 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1055/2114] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:03 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:03.770659 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ab971-47f3-4150-abb6-79f0f69353f6 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:03.772523 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-6b7ab971-47f3-4150-abb6-79f0f69353f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:03.791517 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501604f-fd2e-4352-80fc-a1339f1081c3 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:03.797965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4cd5a-acaa-4e5a-a76f-cd1b737c0deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:03.801697 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4cd5a-acaa-4e5a-a76f-cd1b737c0deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:03.802024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4cd5a-acaa-4e5a-a76f-cd1b737c0deb admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:03.802323 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4cd5a-acaa-4e5a-a76f-cd1b737c0deb admin admin] PATH_INFO: `/v3/projects/e33ee16551a347fb85e657265994776c` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:03.803640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4cd5a-acaa-4e5a-a76f-cd1b737c0deb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e33ee16551a347fb85e657265994776c)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:03.805635 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4cd5a-acaa-4e5a-a76f-cd1b737c0deb admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:03.818984 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:03.856761 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ab971-47f3-4150-abb6-79f0f69353f6 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:03.860698 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-cbd4cd5a-acaa-4e5a-a76f-cd1b737c0deb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e33ee16551a347fb85e657265994776c', 'request_id': 'req-cbd4cd5a-acaa-4e5a-a76f-cd1b737c0deb'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:03.878604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-cbd4cd5a-acaa-4e5a-a76f-cd1b737c0deb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e33ee16551a347fb85e657265994776c', 'request_id': 'req-cbd4cd5a-acaa-4e5a-a76f-cd1b737c0deb'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:03.887521 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-cbd4cd5a-acaa-4e5a-a76f-cd1b737c0deb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e33ee16551a347fb85e657265994776c', 'request_id': 'req-cbd4cd5a-acaa-4e5a-a76f-cd1b737c0deb'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:03.888858 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:03.902354 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-cbd4cd5a-acaa-4e5a-a76f-cd1b737c0deb admin admin] The token cache is being invalidate because project e33ee16551a347fb85e657265994776c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:46:03.902713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-cbd4cd5a-acaa-4e5a-a76f-cd1b737c0deb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:03.903627 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-cbd4cd5a-acaa-4e5a-a76f-cd1b737c0deb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:03.906691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1060/2115] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:46:03 2022] DELETE /identity/v3/projects/e33ee16551a347fb85e657265994776c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:46:03.911774 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9169f12-8ba2-4f98-98c0-f610d3548164 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:03.912066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9169f12-8ba2-4f98-98c0-f610d3548164 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:03.912346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9169f12-8ba2-4f98-98c0-f610d3548164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:03.931310 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa3891-d5d1-410a-a362-e8a7b1e29816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:03.932194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa3891-d5d1-410a-a362-e8a7b1e29816 service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:03.932808 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa3891-d5d1-410a-a362-e8a7b1e29816 service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:03.933228 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa3891-d5d1-410a-a362-e8a7b1e29816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:03.935571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-72fa3891-d5d1-410a-a362-e8a7b1e29816 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:03.943859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-f9169f12-8ba2-4f98-98c0-f610d3548164 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:03.945060 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f9169f12-8ba2-4f98-98c0-f610d3548164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:04.020183 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa3891-d5d1-410a-a362-e8a7b1e29816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:04.021565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa3891-d5d1-410a-a362-e8a7b1e29816 service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:04.022131 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1061/2116] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:04.030477 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d78929-6865-4b10-8ecf-646362d8ee40 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:04.030755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d78929-6865-4b10-8ecf-646362d8ee40 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:04.031027 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d78929-6865-4b10-8ecf-646362d8ee40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:04.041645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1056/2117] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:03 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:46:04.056971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-f3d78929-6865-4b10-8ecf-646362d8ee40 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:04.058426 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f3d78929-6865-4b10-8ecf-646362d8ee40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:04.067644 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1062/2118] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:46:04.072272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa3891-d5d1-410a-a362-e8a7b1e29816 service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:04.086449 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa3891-d5d1-410a-a362-e8a7b1e29816 service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:04.091257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d78929-6865-4b10-8ecf-646362d8ee40 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:04.091645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed49cca-38e1-4f0f-99cb-3249ec1d18cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:04.092997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed49cca-38e1-4f0f-99cb-3249ec1d18cc admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:04.093368 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed49cca-38e1-4f0f-99cb-3249ec1d18cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:04.093607 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f3d78929-6865-4b10-8ecf-646362d8ee40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:04.093859 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed49cca-38e1-4f0f-99cb-3249ec1d18cc admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:04.094639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed49cca-38e1-4f0f-99cb-3249ec1d18cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:04.095034 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed49cca-38e1-4f0f-99cb-3249ec1d18cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:04.096958 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed49cca-38e1-4f0f-99cb-3249ec1d18cc admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:04.107033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d78929-6865-4b10-8ecf-646362d8ee40 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:04.110730 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1057/2119] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:04.110889 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee504f5-e56d-4186-8c55-29190f94ad37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:04.111991 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee504f5-e56d-4186-8c55-29190f94ad37 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:04.111991 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee504f5-e56d-4186-8c55-29190f94ad37 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:04.111991 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee504f5-e56d-4186-8c55-29190f94ad37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:04.113804 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-1ee504f5-e56d-4186-8c55-29190f94ad37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:04.115027 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed49cca-38e1-4f0f-99cb-3249ec1d18cc admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:04.125608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed49cca-38e1-4f0f-99cb-3249ec1d18cc admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:04.130304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed900ae-5adf-493f-8697-23927431d208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:04.130969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed900ae-5adf-493f-8697-23927431d208 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:04.131314 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed900ae-5adf-493f-8697-23927431d208 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:04.131653 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed900ae-5adf-493f-8697-23927431d208 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:04.132421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed900ae-5adf-493f-8697-23927431d208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:04.134629 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed900ae-5adf-493f-8697-23927431d208 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:04.172348 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1058/2120] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:46:04 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:46:04.173754 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed900ae-5adf-493f-8697-23927431d208 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:04.193493 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee504f5-e56d-4186-8c55-29190f94ad37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:04.195928 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee504f5-e56d-4186-8c55-29190f94ad37 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:04.208532 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1063/2121] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:46:04.261589 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed900ae-5adf-493f-8697-23927431d208 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:04.268410 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802b5e7-6e21-4db5-ab9f-118c30292216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:04.269082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802b5e7-6e21-4db5-ab9f-118c30292216 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:04.269434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802b5e7-6e21-4db5-ab9f-118c30292216 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:04.269808 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802b5e7-6e21-4db5-ab9f-118c30292216 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:04.274238 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802b5e7-6e21-4db5-ab9f-118c30292216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:04.276317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802b5e7-6e21-4db5-ab9f-118c30292216 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:04.297347 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:04.324883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1059/2122] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:46:04 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:46:04.326270 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee504f5-e56d-4186-8c55-29190f94ad37 service cinder] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:04.343301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee504f5-e56d-4186-8c55-29190f94ad37 service cinder] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:04.360148 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84458e95-380a-40da-90f4-1624d856e288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:04.361342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84458e95-380a-40da-90f4-1624d856e288 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:04.361855 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84458e95-380a-40da-90f4-1624d856e288 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:04.362577 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84458e95-380a-40da-90f4-1624d856e288 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:04.363961 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84458e95-380a-40da-90f4-1624d856e288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:04.366323 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84458e95-380a-40da-90f4-1624d856e288 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:04.381594 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1064/2123] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:04.385513 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802b5e7-6e21-4db5-ab9f-118c30292216 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:04.404513 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802b5e7-6e21-4db5-ab9f-118c30292216 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:04.414749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6e1c5-4c08-4d78-ae3f-04473ff3cf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:04.415597 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6e1c5-4c08-4d78-ae3f-04473ff3cf1d admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:04.415955 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6e1c5-4c08-4d78-ae3f-04473ff3cf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:04.417140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6e1c5-4c08-4d78-ae3f-04473ff3cf1d admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:04.417916 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6e1c5-4c08-4d78-ae3f-04473ff3cf1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:04.419507 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6e1c5-4c08-4d78-ae3f-04473ff3cf1d admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:04.441906 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1060/2124] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:04.442711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84458e95-380a-40da-90f4-1624d856e288 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:04.457222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84458e95-380a-40da-90f4-1624d856e288 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:04.469234 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7000f03-9ce1-4c63-bcbc-24485e20065f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:04.472090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7000f03-9ce1-4c63-bcbc-24485e20065f admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:04.473067 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7000f03-9ce1-4c63-bcbc-24485e20065f admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:04.473418 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7000f03-9ce1-4c63-bcbc-24485e20065f admin admin] PATH_INFO: `/v3/projects/a129b48f3ffd4b58aa0b0b1a8dde0182/users/4fff29b49edd4536b189ed3ce98f73f1/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:04.496188 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7000f03-9ce1-4c63-bcbc-24485e20065f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a129b48f3ffd4b58aa0b0b1a8dde0182, user_id=4fff29b49edd4536b189ed3ce98f73f1, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:04.500103 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7000f03-9ce1-4c63-bcbc-24485e20065f admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:04.525759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1065/2125] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:46:04 2022] PUT /identity/v3/projects/a129b48f3ffd4b58aa0b0b1a8dde0182/users/4fff29b49edd4536b189ed3ce98f73f1/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:46:04.531513 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded8099-96d1-476f-ad5a-44605adfb516 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:04.531798 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded8099-96d1-476f-ad5a-44605adfb516 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:04.532076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded8099-96d1-476f-ad5a-44605adfb516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:04.584489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-6ded8099-96d1-476f-ad5a-44605adfb516 None None] MFA Rules not processed for user `4fff29b49edd4536b189ed3ce98f73f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:04.585855 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-6ded8099-96d1-476f-ad5a-44605adfb516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:04.792513 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1061/2126] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:04.803684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7000f03-9ce1-4c63-bcbc-24485e20065f admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:04.806684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-b7000f03-9ce1-4c63-bcbc-24485e20065f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:04.934116 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:04.940832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7000f03-9ce1-4c63-bcbc-24485e20065f admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:04.946502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ee8b4-1831-4742-ae97-c461f917aed4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:04.947823 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ee8b4-1831-4742-ae97-c461f917aed4 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:04.948442 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ee8b4-1831-4742-ae97-c461f917aed4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:04.949080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ee8b4-1831-4742-ae97-c461f917aed4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:04.964584 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ee8b4-1831-4742-ae97-c461f917aed4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:04.967658 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ee8b4-1831-4742-ae97-c461f917aed4 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:04.987182 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1066/2127] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:46:08.696785 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded8099-96d1-476f-ad5a-44605adfb516 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:08.769820 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded8099-96d1-476f-ad5a-44605adfb516 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:08.774363 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bf967-88b2-4eeb-bdc3-9e1c4ca7d58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:08.774990 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bf967-88b2-4eeb-bdc3-9e1c4ca7d58a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:08.775293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bf967-88b2-4eeb-bdc3-9e1c4ca7d58a admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:08.775564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bf967-88b2-4eeb-bdc3-9e1c4ca7d58a admin admin] PATH_INFO: `/v3/users/4fff29b49edd4536b189ed3ce98f73f1` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:08.776712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868bf967-88b2-4eeb-bdc3-9e1c4ca7d58a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fff29b49edd4536b189ed3ce98f73f1)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:08.778627 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868bf967-88b2-4eeb-bdc3-9e1c4ca7d58a admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:08.847441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-868bf967-88b2-4eeb-bdc3-9e1c4ca7d58a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fff29b49edd4536b189ed3ce98f73f1'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:08.848244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-868bf967-88b2-4eeb-bdc3-9e1c4ca7d58a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fff29b49edd4536b189ed3ce98f73f1'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:08.848922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-868bf967-88b2-4eeb-bdc3-9e1c4ca7d58a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fff29b49edd4536b189ed3ce98f73f1'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:08.866371 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-868bf967-88b2-4eeb-bdc3-9e1c4ca7d58a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fff29b49edd4536b189ed3ce98f73f1'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:08.874639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:08.878900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-868bf967-88b2-4eeb-bdc3-9e1c4ca7d58a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fff29b49edd4536b189ed3ce98f73f1'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:08.900871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1062/2128] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:46:08 2022] DELETE /identity/v3/users/4fff29b49edd4536b189ed3ce98f73f1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:08.909716 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cbf1f-5411-4fc8-bb73-514722e14c31 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:08.910156 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cbf1f-5411-4fc8-bb73-514722e14c31 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:08.910409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cbf1f-5411-4fc8-bb73-514722e14c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:08.930517 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bf967-88b2-4eeb-bdc3-9e1c4ca7d58a admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:08.932305 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-868bf967-88b2-4eeb-bdc3-9e1c4ca7d58a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:08.935506 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-8f7cbf1f-5411-4fc8-bb73-514722e14c31 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:08.937049 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-8f7cbf1f-5411-4fc8-bb73-514722e14c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:09.006501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1067/2129] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:09.017683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cbf1f-5411-4fc8-bb73-514722e14c31 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:09.018392 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bf967-88b2-4eeb-bdc3-9e1c4ca7d58a admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:09.019299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-8f7cbf1f-5411-4fc8-bb73-514722e14c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:09.023242 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcd6ee-1529-4fd9-b4f2-8564c3c5730f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:09.023893 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcd6ee-1529-4fd9-b4f2-8564c3c5730f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:09.024175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcd6ee-1529-4fd9-b4f2-8564c3c5730f admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:09.024609 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcd6ee-1529-4fd9-b4f2-8564c3c5730f admin admin] PATH_INFO: `/v3/users/d4a85f3b33af4c9db3de948a0943918e` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:09.026014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bcd6ee-1529-4fd9-b4f2-8564c3c5730f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4a85f3b33af4c9db3de948a0943918e)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:09.027968 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bcd6ee-1529-4fd9-b4f2-8564c3c5730f admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:09.088412 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cbf1f-5411-4fc8-bb73-514722e14c31 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:09.093121 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8c9d3-2d94-4d09-a55b-3ce155f30b12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:09.093777 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8c9d3-2d94-4d09-a55b-3ce155f30b12 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:09.094057 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8c9d3-2d94-4d09-a55b-3ce155f30b12 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:09.094331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8c9d3-2d94-4d09-a55b-3ce155f30b12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:09.099320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f4bcd6ee-1529-4fd9-b4f2-8564c3c5730f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4a85f3b33af4c9db3de948a0943918e'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:09.100283 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f4bcd6ee-1529-4fd9-b4f2-8564c3c5730f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4a85f3b33af4c9db3de948a0943918e'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:09.101090 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f4bcd6ee-1529-4fd9-b4f2-8564c3c5730f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4a85f3b33af4c9db3de948a0943918e'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:09.104400 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8c9d3-2d94-4d09-a55b-3ce155f30b12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:09.107368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8c9d3-2d94-4d09-a55b-3ce155f30b12 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:09.117656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1068/2130] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:46:09.124636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f4bcd6ee-1529-4fd9-b4f2-8564c3c5730f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4a85f3b33af4c9db3de948a0943918e'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:09.136020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f4bcd6ee-1529-4fd9-b4f2-8564c3c5730f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4a85f3b33af4c9db3de948a0943918e'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:09.162413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1063/2131] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:46:08 2022] DELETE /identity/v3/users/d4a85f3b33af4c9db3de948a0943918e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:09.171938 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6643d94-d7c7-47c6-90ef-2149502aa7d7 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:09.172451 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6643d94-d7c7-47c6-90ef-2149502aa7d7 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:09.172697 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6643d94-d7c7-47c6-90ef-2149502aa7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:09.195452 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-a6643d94-d7c7-47c6-90ef-2149502aa7d7 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:09.197110 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a6643d94-d7c7-47c6-90ef-2149502aa7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:09.272794 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1069/2132] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:09.282484 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcd6ee-1529-4fd9-b4f2-8564c3c5730f admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:09.284086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-f4bcd6ee-1529-4fd9-b4f2-8564c3c5730f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:09.358188 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcd6ee-1529-4fd9-b4f2-8564c3c5730f admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:09.362543 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523acd2-8a3c-4aa6-add4-44c3fd2c88f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:09.363163 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523acd2-8a3c-4aa6-add4-44c3fd2c88f3 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:09.363468 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523acd2-8a3c-4aa6-add4-44c3fd2c88f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:09.363751 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523acd2-8a3c-4aa6-add4-44c3fd2c88f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:09.374452 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523acd2-8a3c-4aa6-add4-44c3fd2c88f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:09.376535 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523acd2-8a3c-4aa6-add4-44c3fd2c88f3 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:09.391633 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1064/2133] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:46:09.455096 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6643d94-d7c7-47c6-90ef-2149502aa7d7 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:09.459257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a6643d94-d7c7-47c6-90ef-2149502aa7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:09.486695 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6643d94-d7c7-47c6-90ef-2149502aa7d7 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:09.504345 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1762ce-25bd-499e-97ad-79f4471cdb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:09.505297 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1762ce-25bd-499e-97ad-79f4471cdb0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:09.505481 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1762ce-25bd-499e-97ad-79f4471cdb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:09.505908 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1762ce-25bd-499e-97ad-79f4471cdb0c admin admin] PATH_INFO: `/v3/projects/a129b48f3ffd4b58aa0b0b1a8dde0182` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:09.508685 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1762ce-25bd-499e-97ad-79f4471cdb0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a129b48f3ffd4b58aa0b0b1a8dde0182)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:09.513333 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1762ce-25bd-499e-97ad-79f4471cdb0c admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:09.558166 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:09.584849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-9f1762ce-25bd-499e-97ad-79f4471cdb0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a129b48f3ffd4b58aa0b0b1a8dde0182', 'request_id': 'req-9f1762ce-25bd-499e-97ad-79f4471cdb0c'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:09.598004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-9f1762ce-25bd-499e-97ad-79f4471cdb0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a129b48f3ffd4b58aa0b0b1a8dde0182', 'request_id': 'req-9f1762ce-25bd-499e-97ad-79f4471cdb0c'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:09.605333 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-9f1762ce-25bd-499e-97ad-79f4471cdb0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a129b48f3ffd4b58aa0b0b1a8dde0182', 'request_id': 'req-9f1762ce-25bd-499e-97ad-79f4471cdb0c'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:09.619614 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-9f1762ce-25bd-499e-97ad-79f4471cdb0c admin admin] The token cache is being invalidate because project a129b48f3ffd4b58aa0b0b1a8dde0182 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:46:09.619914 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-9f1762ce-25bd-499e-97ad-79f4471cdb0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:09.620815 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-9f1762ce-25bd-499e-97ad-79f4471cdb0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:09.622511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1070/2134] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:46:09 2022] DELETE /identity/v3/projects/a129b48f3ffd4b58aa0b0b1a8dde0182 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:09.629186 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be228189-51ae-42f9-9160-af2107f95b7a None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:09.629808 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be228189-51ae-42f9-9160-af2107f95b7a None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:09.630215 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be228189-51ae-42f9-9160-af2107f95b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:09.653439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-be228189-51ae-42f9-9160-af2107f95b7a None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:09.655151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-be228189-51ae-42f9-9160-af2107f95b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:09.660126 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:09.723164 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1065/2135] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:46:09.731042 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9a026-c2a2-4985-a67e-330223731736 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:09.731332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9a026-c2a2-4985-a67e-330223731736 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:09.731611 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9a026-c2a2-4985-a67e-330223731736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:09.754609 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be228189-51ae-42f9-9160-af2107f95b7a None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:09.757978 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-be228189-51ae-42f9-9160-af2107f95b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:09.765846 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-cef9a026-c2a2-4985-a67e-330223731736 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:09.767075 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-cef9a026-c2a2-4985-a67e-330223731736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:09.775188 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be228189-51ae-42f9-9160-af2107f95b7a None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:09.783450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ea414-a47c-415b-a4b4-da139af62ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:09.784254 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ea414-a47c-415b-a4b4-da139af62ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:09.784683 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ea414-a47c-415b-a4b4-da139af62ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:09.785290 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ea414-a47c-415b-a4b4-da139af62ac9 admin admin] PATH_INFO: `/v3/projects/5083dae6fdd74c76b4b8d16cd05f4b62` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:09.786657 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1071/2136] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:09.789978 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ea414-a47c-415b-a4b4-da139af62ac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5083dae6fdd74c76b4b8d16cd05f4b62)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:09.791168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9a026-c2a2-4985-a67e-330223731736 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:09.791783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ea414-a47c-415b-a4b4-da139af62ac9 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:09.802558 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9a026-c2a2-4985-a67e-330223731736 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:09.807811 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9d1b1-0b19-4906-9e13-945288c662dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:09.808507 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9d1b1-0b19-4906-9e13-945288c662dd admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:09.808869 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9d1b1-0b19-4906-9e13-945288c662dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:09.809202 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9d1b1-0b19-4906-9e13-945288c662dd admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:09.809965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9d1b1-0b19-4906-9e13-945288c662dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:09.810398 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9d1b1-0b19-4906-9e13-945288c662dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:09.813190 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9d1b1-0b19-4906-9e13-945288c662dd admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:09.828104 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1072/2137] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:46:09.833676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9d1b1-0b19-4906-9e13-945288c662dd admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:09.846613 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9d1b1-0b19-4906-9e13-945288c662dd admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:09.858678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-4c1ea414-a47c-415b-a4b4-da139af62ac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5083dae6fdd74c76b4b8d16cd05f4b62', 'request_id': 'req-4c1ea414-a47c-415b-a4b4-da139af62ac9'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:09.868870 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-4c1ea414-a47c-415b-a4b4-da139af62ac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5083dae6fdd74c76b4b8d16cd05f4b62', 'request_id': 'req-4c1ea414-a47c-415b-a4b4-da139af62ac9'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:09.877592 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-4c1ea414-a47c-415b-a4b4-da139af62ac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5083dae6fdd74c76b4b8d16cd05f4b62', 'request_id': 'req-4c1ea414-a47c-415b-a4b4-da139af62ac9'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:09.891191 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-4c1ea414-a47c-415b-a4b4-da139af62ac9 admin admin] The token cache is being invalidate because project 5083dae6fdd74c76b4b8d16cd05f4b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:46:09.891747 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-4c1ea414-a47c-415b-a4b4-da139af62ac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:09.892607 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-4c1ea414-a47c-415b-a4b4-da139af62ac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:09.895168 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1066/2138] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:46:09 2022] DELETE /identity/v3/projects/5083dae6fdd74c76b4b8d16cd05f4b62 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:09.898806 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ea414-a47c-415b-a4b4-da139af62ac9 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:09.900683 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-4c1ea414-a47c-415b-a4b4-da139af62ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:09.923071 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30647ea1-5646-4e9c-b2ae-23b1429b1d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:09.923696 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30647ea1-5646-4e9c-b2ae-23b1429b1d66 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:09.923972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30647ea1-5646-4e9c-b2ae-23b1429b1d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:09.924246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30647ea1-5646-4e9c-b2ae-23b1429b1d66 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:09.924880 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30647ea1-5646-4e9c-b2ae-23b1429b1d66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:09.926882 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30647ea1-5646-4e9c-b2ae-23b1429b1d66 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:09.958032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1073/2139] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:46:09 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:09.962215 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30647ea1-5646-4e9c-b2ae-23b1429b1d66 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:09.963799 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-30647ea1-5646-4e9c-b2ae-23b1429b1d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:09.977262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ea414-a47c-415b-a4b4-da139af62ac9 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:10.016250 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:10.027523 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30647ea1-5646-4e9c-b2ae-23b1429b1d66 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:10.033413 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a7fe5-0f50-479b-8c86-e131e708143a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:10.034049 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a7fe5-0f50-479b-8c86-e131e708143a admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:10.034330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a7fe5-0f50-479b-8c86-e131e708143a admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:10.034605 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a7fe5-0f50-479b-8c86-e131e708143a admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:10.035229 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a7fe5-0f50-479b-8c86-e131e708143a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:10.037138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a7fe5-0f50-479b-8c86-e131e708143a admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:10.037343 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381f4ab-3872-43ff-a5cb-bcb096e8a0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:10.038188 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381f4ab-3872-43ff-a5cb-bcb096e8a0a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:10.038468 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381f4ab-3872-43ff-a5cb-bcb096e8a0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:10.038739 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381f4ab-3872-43ff-a5cb-bcb096e8a0a0 admin admin] PATH_INFO: `/v3/users/a87c45e76dc34c0c8f1ea9e524c92c67` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:10.039950 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381f4ab-3872-43ff-a5cb-bcb096e8a0a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a87c45e76dc34c0c8f1ea9e524c92c67)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:10.041874 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381f4ab-3872-43ff-a5cb-bcb096e8a0a0 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:10.061375 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1074/2140] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:46:09 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:46:10.065414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a7fe5-0f50-479b-8c86-e131e708143a admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:10.077010 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a7fe5-0f50-479b-8c86-e131e708143a admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:10.082419 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12249aca-d056-4b2e-ba00-2969ff12d9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:10.083172 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12249aca-d056-4b2e-ba00-2969ff12d9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:10.083781 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12249aca-d056-4b2e-ba00-2969ff12d9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:10.083781 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12249aca-d056-4b2e-ba00-2969ff12d9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:10.084391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12249aca-d056-4b2e-ba00-2969ff12d9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:10.086043 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12249aca-d056-4b2e-ba00-2969ff12d9c2 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:10.091437 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:10.097870 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-1381f4ab-3872-43ff-a5cb-bcb096e8a0a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a87c45e76dc34c0c8f1ea9e524c92c67'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:10.098107 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1075/2141] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:46:10.101678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-1381f4ab-3872-43ff-a5cb-bcb096e8a0a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a87c45e76dc34c0c8f1ea9e524c92c67'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:10.102403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12249aca-d056-4b2e-ba00-2969ff12d9c2 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:10.102523 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-1381f4ab-3872-43ff-a5cb-bcb096e8a0a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a87c45e76dc34c0c8f1ea9e524c92c67'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:10.105301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-12249aca-d056-4b2e-ba00-2969ff12d9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:10.115899 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-1381f4ab-3872-43ff-a5cb-bcb096e8a0a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a87c45e76dc34c0c8f1ea9e524c92c67'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:10.122363 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12249aca-d056-4b2e-ba00-2969ff12d9c2 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:10.128666 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-1381f4ab-3872-43ff-a5cb-bcb096e8a0a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a87c45e76dc34c0c8f1ea9e524c92c67'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:10.129056 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6e768-5cff-4eed-a88f-e94dad02cf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:10.130025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6e768-5cff-4eed-a88f-e94dad02cf33 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:10.130188 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6e768-5cff-4eed-a88f-e94dad02cf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:10.130602 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6e768-5cff-4eed-a88f-e94dad02cf33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:10.131256 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6e768-5cff-4eed-a88f-e94dad02cf33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:10.133758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6e768-5cff-4eed-a88f-e94dad02cf33 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:10.146752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1076/2142] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:10.148594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1067/2143] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:46:09 2022] DELETE /identity/v3/users/a87c45e76dc34c0c8f1ea9e524c92c67 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:46:10.151308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6e768-5cff-4eed-a88f-e94dad02cf33 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:10.163372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6e768-5cff-4eed-a88f-e94dad02cf33 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:10.265985 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d59725-d89f-44b9-8d25-b4bf93914cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:10.266669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d59725-d89f-44b9-8d25-b4bf93914cce admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:10.267052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d59725-d89f-44b9-8d25-b4bf93914cce admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:10.267229 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d59725-d89f-44b9-8d25-b4bf93914cce admin admin] PATH_INFO: `/v3/projects/03e5ba5dbd7244a7bad2d4ff5dfc5013/users/448c4e0626c7433b9ca21a13207cace4/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:10.284629 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d59725-d89f-44b9-8d25-b4bf93914cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e5ba5dbd7244a7bad2d4ff5dfc5013, user_id=448c4e0626c7433b9ca21a13207cace4, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:10.287352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d59725-d89f-44b9-8d25-b4bf93914cce admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:10.302843 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1077/2144] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:46:10 2022] PUT /identity/v3/projects/03e5ba5dbd7244a7bad2d4ff5dfc5013/users/448c4e0626c7433b9ca21a13207cace4/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:10.308047 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d74d1-8111-4c56-bceb-e6d25d6ef62a None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:10.308612 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d74d1-8111-4c56-bceb-e6d25d6ef62a None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:10.309243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d74d1-8111-4c56-bceb-e6d25d6ef62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:10.333251 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-ac1d74d1-8111-4c56-bceb-e6d25d6ef62a None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:10.334567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ac1d74d1-8111-4c56-bceb-e6d25d6ef62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:10.402837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1068/2145] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:10.412646 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d59725-d89f-44b9-8d25-b4bf93914cce admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:10.414650 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a4d59725-d89f-44b9-8d25-b4bf93914cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:10.469964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d74d1-8111-4c56-bceb-e6d25d6ef62a None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:10.471768 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ac1d74d1-8111-4c56-bceb-e6d25d6ef62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:10.481107 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d59725-d89f-44b9-8d25-b4bf93914cce admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:10.485566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80215f-aa06-4d2f-8d1e-1b33dec0022f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:10.486181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80215f-aa06-4d2f-8d1e-1b33dec0022f service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:10.486461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80215f-aa06-4d2f-8d1e-1b33dec0022f service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:10.486732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80215f-aa06-4d2f-8d1e-1b33dec0022f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:10.487750 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d74d1-8111-4c56-bceb-e6d25d6ef62a None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:10.493083 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2d0c6-def5-4846-b9c5-0a350019581b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:10.493852 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2d0c6-def5-4846-b9c5-0a350019581b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:10.494740 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2d0c6-def5-4846-b9c5-0a350019581b admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:10.495092 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2d0c6-def5-4846-b9c5-0a350019581b admin admin] PATH_INFO: `/v3/projects/cc9de56e0a5e4047a42047792e1fb202` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:10.496321 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2d0c6-def5-4846-b9c5-0a350019581b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc9de56e0a5e4047a42047792e1fb202)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:10.496443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80215f-aa06-4d2f-8d1e-1b33dec0022f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:10.497843 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80215f-aa06-4d2f-8d1e-1b33dec0022f service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:10.500496 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2d0c6-def5-4846-b9c5-0a350019581b admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:10.510417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1078/2146] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:46:10.555877 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cef2d0c6-def5-4846-b9c5-0a350019581b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc9de56e0a5e4047a42047792e1fb202', 'request_id': 'req-cef2d0c6-def5-4846-b9c5-0a350019581b'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:10.560239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:10.564745 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cef2d0c6-def5-4846-b9c5-0a350019581b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc9de56e0a5e4047a42047792e1fb202', 'request_id': 'req-cef2d0c6-def5-4846-b9c5-0a350019581b'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:10.574564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cef2d0c6-def5-4846-b9c5-0a350019581b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc9de56e0a5e4047a42047792e1fb202', 'request_id': 'req-cef2d0c6-def5-4846-b9c5-0a350019581b'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:10.585921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cef2d0c6-def5-4846-b9c5-0a350019581b admin admin] The token cache is being invalidate because project cc9de56e0a5e4047a42047792e1fb202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:46:10.586542 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cef2d0c6-def5-4846-b9c5-0a350019581b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:10.587245 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cef2d0c6-def5-4846-b9c5-0a350019581b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:10.588799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1069/2147] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:46:10 2022] DELETE /identity/v3/projects/cc9de56e0a5e4047a42047792e1fb202 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:46:10.593434 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80215f-aa06-4d2f-8d1e-1b33dec0022f service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:10.604214 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80215f-aa06-4d2f-8d1e-1b33dec0022f service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:10.671944 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea2201-862e-410e-9af2-7fa1a97fb59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:10.672567 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea2201-862e-410e-9af2-7fa1a97fb59b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:10.672843 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea2201-862e-410e-9af2-7fa1a97fb59b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:10.673117 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea2201-862e-410e-9af2-7fa1a97fb59b admin admin] PATH_INFO: `/v3/users/cf3bf1e41ff24d45887f52cfc75de28d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:10.674314 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea2201-862e-410e-9af2-7fa1a97fb59b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf3bf1e41ff24d45887f52cfc75de28d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:10.678648 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea2201-862e-410e-9af2-7fa1a97fb59b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:10.707301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:10.747442 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-c2ea2201-862e-410e-9af2-7fa1a97fb59b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf3bf1e41ff24d45887f52cfc75de28d'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:10.747776 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-c2ea2201-862e-410e-9af2-7fa1a97fb59b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf3bf1e41ff24d45887f52cfc75de28d'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:10.769062 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-c2ea2201-862e-410e-9af2-7fa1a97fb59b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf3bf1e41ff24d45887f52cfc75de28d'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:10.779088 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-c2ea2201-862e-410e-9af2-7fa1a97fb59b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf3bf1e41ff24d45887f52cfc75de28d'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:10.789544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-c2ea2201-862e-410e-9af2-7fa1a97fb59b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf3bf1e41ff24d45887f52cfc75de28d'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:10.798130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1079/2148] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:46:10 2022] DELETE /identity/v3/users/cf3bf1e41ff24d45887f52cfc75de28d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:11.427260 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2d0c6-def5-4846-b9c5-0a350019581b admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:11.428775 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-cef2d0c6-def5-4846-b9c5-0a350019581b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:11.460149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2d0c6-def5-4846-b9c5-0a350019581b admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:11.520695 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5d981-7c1e-4385-9212-7d3c98196fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:11.521333 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5d981-7c1e-4385-9212-7d3c98196fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:11.521654 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5d981-7c1e-4385-9212-7d3c98196fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:11.521932 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5d981-7c1e-4385-9212-7d3c98196fd0 admin admin] PATH_INFO: `/v3/projects/a8dc64d7a85047f793c42ec7f2b6359f` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:11.523064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5d981-7c1e-4385-9212-7d3c98196fd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8dc64d7a85047f793c42ec7f2b6359f)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:11.524975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5d981-7c1e-4385-9212-7d3c98196fd0 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:11.575616 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-dff5d981-7c1e-4385-9212-7d3c98196fd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8dc64d7a85047f793c42ec7f2b6359f', 'request_id': 'req-dff5d981-7c1e-4385-9212-7d3c98196fd0'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:11.583862 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-dff5d981-7c1e-4385-9212-7d3c98196fd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8dc64d7a85047f793c42ec7f2b6359f', 'request_id': 'req-dff5d981-7c1e-4385-9212-7d3c98196fd0'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:11.590892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-dff5d981-7c1e-4385-9212-7d3c98196fd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8dc64d7a85047f793c42ec7f2b6359f', 'request_id': 'req-dff5d981-7c1e-4385-9212-7d3c98196fd0'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:11.603500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-dff5d981-7c1e-4385-9212-7d3c98196fd0 admin admin] The token cache is being invalidate because project a8dc64d7a85047f793c42ec7f2b6359f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:46:11.603714 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-dff5d981-7c1e-4385-9212-7d3c98196fd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:11.604376 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-dff5d981-7c1e-4385-9212-7d3c98196fd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:11.605989 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1070/2149] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:46:11 2022] DELETE /identity/v3/projects/a8dc64d7a85047f793c42ec7f2b6359f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:11.612260 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097d501-33bd-4f4a-8da8-2d6f360e13ca None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:11.612755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097d501-33bd-4f4a-8da8-2d6f360e13ca None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:11.612869 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097d501-33bd-4f4a-8da8-2d6f360e13ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:11.633271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-c097d501-33bd-4f4a-8da8-2d6f360e13ca None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:11.634526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-c097d501-33bd-4f4a-8da8-2d6f360e13ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:11.700540 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1080/2150] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:11.708746 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d5578-5c4d-499a-bfe3-a82d5ebb2776 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:11.709033 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d5578-5c4d-499a-bfe3-a82d5ebb2776 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:11.709310 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d5578-5c4d-499a-bfe3-a82d5ebb2776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:11.731113 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-8e5d5578-5c4d-499a-bfe3-a82d5ebb2776 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:11.733221 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-8e5d5578-5c4d-499a-bfe3-a82d5ebb2776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:11.743843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1071/2151] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:11.748530 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097d501-33bd-4f4a-8da8-2d6f360e13ca None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:11.758965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097d501-33bd-4f4a-8da8-2d6f360e13ca None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:11.763732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da2096-6b6c-400a-8445-0048958c01aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:11.764368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da2096-6b6c-400a-8445-0048958c01aa admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:11.764727 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da2096-6b6c-400a-8445-0048958c01aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:11.765007 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da2096-6b6c-400a-8445-0048958c01aa admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:11.765720 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da2096-6b6c-400a-8445-0048958c01aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:11.766015 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da2096-6b6c-400a-8445-0048958c01aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:11.767618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da2096-6b6c-400a-8445-0048958c01aa admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:11.784256 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1081/2152] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:11.785417 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d5578-5c4d-499a-bfe3-a82d5ebb2776 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:11.796397 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d5578-5c4d-499a-bfe3-a82d5ebb2776 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:11.801656 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239bb61-9798-4977-a055-db7e17594b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:11.802272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239bb61-9798-4977-a055-db7e17594b19 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:11.802552 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239bb61-9798-4977-a055-db7e17594b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:11.802822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239bb61-9798-4977-a055-db7e17594b19 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:11.803900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239bb61-9798-4977-a055-db7e17594b19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:11.805459 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239bb61-9798-4977-a055-db7e17594b19 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:11.847626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1072/2153] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:46:11 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:11.848944 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da2096-6b6c-400a-8445-0048958c01aa admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:11.864907 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da2096-6b6c-400a-8445-0048958c01aa admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:11.950312 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab1293-4025-4a00-b174-94a5e3abfe24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:11.951447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab1293-4025-4a00-b174-94a5e3abfe24 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:11.951934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab1293-4025-4a00-b174-94a5e3abfe24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:11.952419 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab1293-4025-4a00-b174-94a5e3abfe24 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:11.953349 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab1293-4025-4a00-b174-94a5e3abfe24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:11.956120 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab1293-4025-4a00-b174-94a5e3abfe24 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:11.993389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1082/2154] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:46:11 2022] POST /identity/v3/users => generated 291 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:11.997199 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239bb61-9798-4977-a055-db7e17594b19 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:12.010728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239bb61-9798-4977-a055-db7e17594b19 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:12.016979 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544ae8f-af13-483a-bbf1-c81191c0f579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:12.017868 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544ae8f-af13-483a-bbf1-c81191c0f579 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:12.018928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544ae8f-af13-483a-bbf1-c81191c0f579 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:12.019834 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544ae8f-af13-483a-bbf1-c81191c0f579 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:12.021221 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544ae8f-af13-483a-bbf1-c81191c0f579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:12.024072 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544ae8f-af13-483a-bbf1-c81191c0f579 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:12.044188 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1073/2155] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:12.048158 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab1293-4025-4a00-b174-94a5e3abfe24 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:12.059012 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab1293-4025-4a00-b174-94a5e3abfe24 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:12.065088 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22ce76-4b65-4edd-b135-eecb99c6182b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:12.066371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22ce76-4b65-4edd-b135-eecb99c6182b admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:12.067000 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22ce76-4b65-4edd-b135-eecb99c6182b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:12.067630 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22ce76-4b65-4edd-b135-eecb99c6182b admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:12.068555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c22ce76-4b65-4edd-b135-eecb99c6182b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:12.070354 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c22ce76-4b65-4edd-b135-eecb99c6182b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:12.078766 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:12.091802 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544ae8f-af13-483a-bbf1-c81191c0f579 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:12.098656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1083/2156] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:12.105072 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544ae8f-af13-483a-bbf1-c81191c0f579 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:12.110263 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bc295-80b2-4d53-8478-e85aa8b4b317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:12.111211 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bc295-80b2-4d53-8478-e85aa8b4b317 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:12.120285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bc295-80b2-4d53-8478-e85aa8b4b317 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:12.122167 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bc295-80b2-4d53-8478-e85aa8b4b317 admin admin] PATH_INFO: `/v3/projects/7ee4207cf1874fcea483d466d5c7c3a7/users/3033e0c0260d426abadd92f7bbf2fa0c/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:12.165358 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1bc295-80b2-4d53-8478-e85aa8b4b317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee4207cf1874fcea483d466d5c7c3a7, user_id=3033e0c0260d426abadd92f7bbf2fa0c, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:12.168443 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1bc295-80b2-4d53-8478-e85aa8b4b317 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:12.196821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1074/2157] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:46:12 2022] PUT /identity/v3/projects/7ee4207cf1874fcea483d466d5c7c3a7/users/3033e0c0260d426abadd92f7bbf2fa0c/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:46:12.199004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef9678-eacb-4dd6-bddd-0bdec319293c None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:12.199679 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef9678-eacb-4dd6-bddd-0bdec319293c None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:12.200147 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef9678-eacb-4dd6-bddd-0bdec319293c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:12.252856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-b7ef9678-eacb-4dd6-bddd-0bdec319293c None None] MFA Rules not processed for user `3033e0c0260d426abadd92f7bbf2fa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:12.254136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-b7ef9678-eacb-4dd6-bddd-0bdec319293c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:12.370971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1084/2158] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:12.375803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bc295-80b2-4d53-8478-e85aa8b4b317 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:12.387059 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:12.505442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bc295-80b2-4d53-8478-e85aa8b4b317 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:12.512470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b5e66-865f-4e63-a6f3-81c7f6048c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:12.514147 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b5e66-865f-4e63-a6f3-81c7f6048c69 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:12.514653 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b5e66-865f-4e63-a6f3-81c7f6048c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:12.515099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b5e66-865f-4e63-a6f3-81c7f6048c69 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:12.516017 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b5e66-865f-4e63-a6f3-81c7f6048c69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:12.521362 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b5e66-865f-4e63-a6f3-81c7f6048c69 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:12.566679 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1075/2159] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:46:12 2022] POST /identity/v3/projects => generated 379 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:12.570455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef9678-eacb-4dd6-bddd-0bdec319293c None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:12.591499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef9678-eacb-4dd6-bddd-0bdec319293c None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:12.725252 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aeb02d-907e-4f0c-b47b-3c7518a27f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:12.726019 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aeb02d-907e-4f0c-b47b-3c7518a27f9e admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:12.726499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aeb02d-907e-4f0c-b47b-3c7518a27f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:12.726843 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aeb02d-907e-4f0c-b47b-3c7518a27f9e admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:12.727619 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aeb02d-907e-4f0c-b47b-3c7518a27f9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:12.729648 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aeb02d-907e-4f0c-b47b-3c7518a27f9e admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:12.778055 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1085/2160] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:46:12 2022] POST /identity/v3/users => generated 296 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:46:12.782263 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b5e66-865f-4e63-a6f3-81c7f6048c69 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:12.792873 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b5e66-865f-4e63-a6f3-81c7f6048c69 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:12.809498 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a0d09-5469-476b-a054-fbc4a02d444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:12.810138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a0d09-5469-476b-a054-fbc4a02d444d admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:12.810500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a0d09-5469-476b-a054-fbc4a02d444d admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:12.810780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a0d09-5469-476b-a054-fbc4a02d444d admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:12.811429 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a0d09-5469-476b-a054-fbc4a02d444d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:12.813030 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a0d09-5469-476b-a054-fbc4a02d444d admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:12.826352 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1076/2161] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:12.830420 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aeb02d-907e-4f0c-b47b-3c7518a27f9e admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:12.843446 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aeb02d-907e-4f0c-b47b-3c7518a27f9e admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:12.851020 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fd399-3a0a-4d46-9d5c-45b722fdc047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:12.851820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fd399-3a0a-4d46-9d5c-45b722fdc047 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:12.852194 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fd399-3a0a-4d46-9d5c-45b722fdc047 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:12.852561 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fd399-3a0a-4d46-9d5c-45b722fdc047 admin admin] PATH_INFO: `/v3/projects/23d9e8acebf94fc9a65c99ccd5e0e395/users/547f57f63fd740e1b33b8318c27393be/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:12.878184 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94fd399-3a0a-4d46-9d5c-45b722fdc047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d9e8acebf94fc9a65c99ccd5e0e395, user_id=547f57f63fd740e1b33b8318c27393be, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:12.881740 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94fd399-3a0a-4d46-9d5c-45b722fdc047 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:12.907762 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1086/2162] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:46:12 2022] PUT /identity/v3/projects/23d9e8acebf94fc9a65c99ccd5e0e395/users/547f57f63fd740e1b33b8318c27393be/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:12.909528 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a0d09-5469-476b-a054-fbc4a02d444d admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:12.921586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a0d09-5469-476b-a054-fbc4a02d444d admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:13.014693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71250f-bbf6-471d-b6fd-dcb0a9c2c1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:13.015349 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71250f-bbf6-471d-b6fd-dcb0a9c2c1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:13.015632 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71250f-bbf6-471d-b6fd-dcb0a9c2c1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:13.015910 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71250f-bbf6-471d-b6fd-dcb0a9c2c1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:13.016586 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71250f-bbf6-471d-b6fd-dcb0a9c2c1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:13.018440 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71250f-bbf6-471d-b6fd-dcb0a9c2c1e2 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:13.033505 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1077/2163] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:13.037818 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fd399-3a0a-4d46-9d5c-45b722fdc047 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:13.052707 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fd399-3a0a-4d46-9d5c-45b722fdc047 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:13.068929 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c5e42-96eb-4576-a68f-a1950fbe52c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:13.070451 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c5e42-96eb-4576-a68f-a1950fbe52c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:13.070451 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c5e42-96eb-4576-a68f-a1950fbe52c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:13.070451 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c5e42-96eb-4576-a68f-a1950fbe52c6 admin admin] PATH_INFO: `/v3/projects/23d9e8acebf94fc9a65c99ccd5e0e395/users/547f57f63fd740e1b33b8318c27393be/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:13.076640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c5e42-96eb-4576-a68f-a1950fbe52c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d9e8acebf94fc9a65c99ccd5e0e395, user_id=547f57f63fd740e1b33b8318c27393be, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:13.079678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c5e42-96eb-4576-a68f-a1950fbe52c6 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:13.108951 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1087/2164] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:46:13 2022] PUT /identity/v3/projects/23d9e8acebf94fc9a65c99ccd5e0e395/users/547f57f63fd740e1b33b8318c27393be/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:46:13.124843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc30887-095b-4a17-b385-babc32333f06 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:13.125751 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc30887-095b-4a17-b385-babc32333f06 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:13.127498 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc30887-095b-4a17-b385-babc32333f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:13.221253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-9cc30887-095b-4a17-b385-babc32333f06 None None] MFA Rules not processed for user `547f57f63fd740e1b33b8318c27393be`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:13.227974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-9cc30887-095b-4a17-b385-babc32333f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:13.357316 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1078/2165] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:13.374981 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c5e42-96eb-4576-a68f-a1950fbe52c6 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:13.377008 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-d79c5e42-96eb-4576-a68f-a1950fbe52c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:13.502638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:13.529648 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c5e42-96eb-4576-a68f-a1950fbe52c6 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:13.545313 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cd4af-f5ae-42b9-b3fd-7bc01d77e203 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:13.546245 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cd4af-f5ae-42b9-b3fd-7bc01d77e203 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:13.546625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cd4af-f5ae-42b9-b3fd-7bc01d77e203 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:13.546996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cd4af-f5ae-42b9-b3fd-7bc01d77e203 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:13.561171 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cd4af-f5ae-42b9-b3fd-7bc01d77e203 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:13.562690 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6cd4af-f5ae-42b9-b3fd-7bc01d77e203 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:13.575227 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1088/2166] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:46:14.122136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc30887-095b-4a17-b385-babc32333f06 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:14.129805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:14.210413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc30887-095b-4a17-b385-babc32333f06 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:14.216368 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff4c3a-0539-4d73-99ab-4c85f7f87868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:14.217087 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff4c3a-0539-4d73-99ab-4c85f7f87868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:14.217493 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff4c3a-0539-4d73-99ab-4c85f7f87868 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:14.217787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff4c3a-0539-4d73-99ab-4c85f7f87868 admin admin] PATH_INFO: `/v3/users/3033e0c0260d426abadd92f7bbf2fa0c` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:14.218996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff4c3a-0539-4d73-99ab-4c85f7f87868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3033e0c0260d426abadd92f7bbf2fa0c)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:14.221795 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff4c3a-0539-4d73-99ab-4c85f7f87868 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:14.308844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-24ff4c3a-0539-4d73-99ab-4c85f7f87868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3033e0c0260d426abadd92f7bbf2fa0c'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:14.309775 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-24ff4c3a-0539-4d73-99ab-4c85f7f87868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3033e0c0260d426abadd92f7bbf2fa0c'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:14.310717 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-24ff4c3a-0539-4d73-99ab-4c85f7f87868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3033e0c0260d426abadd92f7bbf2fa0c'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:14.325820 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-24ff4c3a-0539-4d73-99ab-4c85f7f87868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3033e0c0260d426abadd92f7bbf2fa0c'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:14.335003 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-24ff4c3a-0539-4d73-99ab-4c85f7f87868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3033e0c0260d426abadd92f7bbf2fa0c'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:14.356920 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1079/2167] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:46:14 2022] DELETE /identity/v3/users/3033e0c0260d426abadd92f7bbf2fa0c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:46:14.358817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb57db6-145b-4acd-9666-ec65c2b344ab None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:14.359326 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb57db6-145b-4acd-9666-ec65c2b344ab None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:14.359423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb57db6-145b-4acd-9666-ec65c2b344ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:14.389916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-edb57db6-145b-4acd-9666-ec65c2b344ab None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:14.391163 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-edb57db6-145b-4acd-9666-ec65c2b344ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:14.485643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1089/2168] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:46:14.486204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff4c3a-0539-4d73-99ab-4c85f7f87868 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:14.487720 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-24ff4c3a-0539-4d73-99ab-4c85f7f87868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:14.596797 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff4c3a-0539-4d73-99ab-4c85f7f87868 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:14.611881 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1ca46-43d3-4d94-9974-36b8202ec522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:14.613192 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1ca46-43d3-4d94-9974-36b8202ec522 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:14.613192 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1ca46-43d3-4d94-9974-36b8202ec522 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:14.613192 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1ca46-43d3-4d94-9974-36b8202ec522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:14.634438 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1ca46-43d3-4d94-9974-36b8202ec522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:14.636911 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1ca46-43d3-4d94-9974-36b8202ec522 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:14.650068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1080/2169] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:46:15.335258 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb57db6-145b-4acd-9666-ec65c2b344ab None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:15.336904 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-edb57db6-145b-4acd-9666-ec65c2b344ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:15.361149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb57db6-145b-4acd-9666-ec65c2b344ab None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:15.366977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3657e0-57ff-4863-a4a9-b9f5e781a737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:15.367760 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3657e0-57ff-4863-a4a9-b9f5e781a737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:15.368096 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3657e0-57ff-4863-a4a9-b9f5e781a737 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:15.368375 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3657e0-57ff-4863-a4a9-b9f5e781a737 admin admin] PATH_INFO: `/v3/projects/7ee4207cf1874fcea483d466d5c7c3a7` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:15.369913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3657e0-57ff-4863-a4a9-b9f5e781a737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ee4207cf1874fcea483d466d5c7c3a7)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:15.373835 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3657e0-57ff-4863-a4a9-b9f5e781a737 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:15.471970 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3c3657e0-57ff-4863-a4a9-b9f5e781a737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ee4207cf1874fcea483d466d5c7c3a7', 'request_id': 'req-3c3657e0-57ff-4863-a4a9-b9f5e781a737'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:15.503587 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3c3657e0-57ff-4863-a4a9-b9f5e781a737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ee4207cf1874fcea483d466d5c7c3a7', 'request_id': 'req-3c3657e0-57ff-4863-a4a9-b9f5e781a737'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:15.537693 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3c3657e0-57ff-4863-a4a9-b9f5e781a737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ee4207cf1874fcea483d466d5c7c3a7', 'request_id': 'req-3c3657e0-57ff-4863-a4a9-b9f5e781a737'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:15.563631 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3c3657e0-57ff-4863-a4a9-b9f5e781a737 admin admin] The token cache is being invalidate because project 7ee4207cf1874fcea483d466d5c7c3a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:46:15.564087 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3c3657e0-57ff-4863-a4a9-b9f5e781a737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:15.566162 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3c3657e0-57ff-4863-a4a9-b9f5e781a737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:15.568615 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1090/2170] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:46:15 2022] DELETE /identity/v3/projects/7ee4207cf1874fcea483d466d5c7c3a7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:15.573141 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1ca46-43d3-4d94-9974-36b8202ec522 service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:15.585560 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1ca46-43d3-4d94-9974-36b8202ec522 service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:15.630034 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:15.688982 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f52673-b01b-4f76-8254-71714ced2394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:15.689660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f52673-b01b-4f76-8254-71714ced2394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:15.689939 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f52673-b01b-4f76-8254-71714ced2394 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:15.690330 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f52673-b01b-4f76-8254-71714ced2394 admin admin] PATH_INFO: `/v3/users/547f57f63fd740e1b33b8318c27393be` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:15.691369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f52673-b01b-4f76-8254-71714ced2394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=547f57f63fd740e1b33b8318c27393be)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:15.694021 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f52673-b01b-4f76-8254-71714ced2394 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:15.779410 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-26f52673-b01b-4f76-8254-71714ced2394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '547f57f63fd740e1b33b8318c27393be'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:15.780251 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-26f52673-b01b-4f76-8254-71714ced2394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '547f57f63fd740e1b33b8318c27393be'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:15.780865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-26f52673-b01b-4f76-8254-71714ced2394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '547f57f63fd740e1b33b8318c27393be'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:15.814703 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-26f52673-b01b-4f76-8254-71714ced2394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '547f57f63fd740e1b33b8318c27393be'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:15.837450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-26f52673-b01b-4f76-8254-71714ced2394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '547f57f63fd740e1b33b8318c27393be'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:15.868574 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1081/2171] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:46:15 2022] DELETE /identity/v3/users/547f57f63fd740e1b33b8318c27393be => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:16.430188 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3657e0-57ff-4863-a4a9-b9f5e781a737 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:16.432156 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-3c3657e0-57ff-4863-a4a9-b9f5e781a737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:16.452738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3657e0-57ff-4863-a4a9-b9f5e781a737 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:16.531035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a613f1-0d45-4874-b3ab-998e9c1c7d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:16.532365 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a613f1-0d45-4874-b3ab-998e9c1c7d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:16.532718 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a613f1-0d45-4874-b3ab-998e9c1c7d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:16.533072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a613f1-0d45-4874-b3ab-998e9c1c7d91 admin admin] PATH_INFO: `/v3/projects/23d9e8acebf94fc9a65c99ccd5e0e395` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:16.534797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a613f1-0d45-4874-b3ab-998e9c1c7d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23d9e8acebf94fc9a65c99ccd5e0e395)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:16.537118 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a613f1-0d45-4874-b3ab-998e9c1c7d91 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:16.604647 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:16.699377 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-a9a613f1-0d45-4874-b3ab-998e9c1c7d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23d9e8acebf94fc9a65c99ccd5e0e395', 'request_id': 'req-a9a613f1-0d45-4874-b3ab-998e9c1c7d91'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:16.711107 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-a9a613f1-0d45-4874-b3ab-998e9c1c7d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23d9e8acebf94fc9a65c99ccd5e0e395', 'request_id': 'req-a9a613f1-0d45-4874-b3ab-998e9c1c7d91'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:16.725141 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-a9a613f1-0d45-4874-b3ab-998e9c1c7d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23d9e8acebf94fc9a65c99ccd5e0e395', 'request_id': 'req-a9a613f1-0d45-4874-b3ab-998e9c1c7d91'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:16.749866 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-a9a613f1-0d45-4874-b3ab-998e9c1c7d91 admin admin] The token cache is being invalidate because project 23d9e8acebf94fc9a65c99ccd5e0e395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:46:16.750281 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-a9a613f1-0d45-4874-b3ab-998e9c1c7d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:16.751064 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-a9a613f1-0d45-4874-b3ab-998e9c1c7d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:16.753390 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1091/2172] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:46:16 2022] DELETE /identity/v3/projects/23d9e8acebf94fc9a65c99ccd5e0e395 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:16.758171 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609fe10-0b12-494d-94b2-848b44b919fc None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:16.758656 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609fe10-0b12-494d-94b2-848b44b919fc None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:16.758656 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609fe10-0b12-494d-94b2-848b44b919fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:16.787050 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-0609fe10-0b12-494d-94b2-848b44b919fc None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:16.790361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-0609fe10-0b12-494d-94b2-848b44b919fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:16.904888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1082/2173] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:16.912929 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb18213-e1da-4eb8-b453-50e109dbbe8f None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:16.913433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb18213-e1da-4eb8-b453-50e109dbbe8f None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:16.913887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb18213-e1da-4eb8-b453-50e109dbbe8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:16.952105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-afb18213-e1da-4eb8-b453-50e109dbbe8f None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:16.955348 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-afb18213-e1da-4eb8-b453-50e109dbbe8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:16.965625 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1092/2174] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:46:16.969996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609fe10-0b12-494d-94b2-848b44b919fc None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:16.984599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609fe10-0b12-494d-94b2-848b44b919fc None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:16.990474 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32646312-e932-4c31-ab9a-7e12a1e61eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:16.991418 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32646312-e932-4c31-ab9a-7e12a1e61eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:16.991768 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32646312-e932-4c31-ab9a-7e12a1e61eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:16.992144 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32646312-e932-4c31-ab9a-7e12a1e61eb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:16.993275 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32646312-e932-4c31-ab9a-7e12a1e61eb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:16.993732 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32646312-e932-4c31-ab9a-7e12a1e61eb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:16.996143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32646312-e932-4c31-ab9a-7e12a1e61eb9 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:17.019813 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1083/2175] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:17.023688 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb18213-e1da-4eb8-b453-50e109dbbe8f None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:17.034669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb18213-e1da-4eb8-b453-50e109dbbe8f None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:17.045905 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4272dd-d9b6-4445-8717-e60098f61785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:17.050938 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4272dd-d9b6-4445-8717-e60098f61785 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:17.051259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4272dd-d9b6-4445-8717-e60098f61785 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:17.051529 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4272dd-d9b6-4445-8717-e60098f61785 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:17.052201 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4272dd-d9b6-4445-8717-e60098f61785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:17.055117 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4272dd-d9b6-4445-8717-e60098f61785 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:17.104114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1093/2176] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:46:17 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:17.108849 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32646312-e932-4c31-ab9a-7e12a1e61eb9 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:17.124273 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32646312-e932-4c31-ab9a-7e12a1e61eb9 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:17.173588 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:17.219945 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d98f6-e30d-431b-bcb7-6691e36dfc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:17.220917 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d98f6-e30d-431b-bcb7-6691e36dfc64 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:17.221262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d98f6-e30d-431b-bcb7-6691e36dfc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:17.222544 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d98f6-e30d-431b-bcb7-6691e36dfc64 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:17.223241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d98f6-e30d-431b-bcb7-6691e36dfc64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:17.226065 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d98f6-e30d-431b-bcb7-6691e36dfc64 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:17.260847 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1084/2177] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:46:17 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:17.265799 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4272dd-d9b6-4445-8717-e60098f61785 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:17.277157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4272dd-d9b6-4445-8717-e60098f61785 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:17.282617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf3396-9e3c-4e8b-83ed-4956c47bb1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:17.283243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf3396-9e3c-4e8b-83ed-4956c47bb1fe admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:17.283520 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf3396-9e3c-4e8b-83ed-4956c47bb1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:17.283793 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf3396-9e3c-4e8b-83ed-4956c47bb1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:17.284497 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf3396-9e3c-4e8b-83ed-4956c47bb1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:17.286205 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf3396-9e3c-4e8b-83ed-4956c47bb1fe admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:17.301518 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1094/2178] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:46:17.302988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d98f6-e30d-431b-bcb7-6691e36dfc64 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:17.320481 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d98f6-e30d-431b-bcb7-6691e36dfc64 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:17.327585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e6104-ae1f-4743-8306-55859a39982b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:17.328743 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e6104-ae1f-4743-8306-55859a39982b admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:17.329362 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e6104-ae1f-4743-8306-55859a39982b admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:17.329924 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e6104-ae1f-4743-8306-55859a39982b admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:17.330806 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e6104-ae1f-4743-8306-55859a39982b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:17.333306 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e6104-ae1f-4743-8306-55859a39982b admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:17.351009 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1085/2179] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:17.351658 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf3396-9e3c-4e8b-83ed-4956c47bb1fe admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:17.364589 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf3396-9e3c-4e8b-83ed-4956c47bb1fe admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:17.371240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afc7fa-ecab-419e-b3e2-808737d90e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:17.372421 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afc7fa-ecab-419e-b3e2-808737d90e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:17.373642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afc7fa-ecab-419e-b3e2-808737d90e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:17.374274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afc7fa-ecab-419e-b3e2-808737d90e7a admin admin] PATH_INFO: `/v3/projects/9f9ea99f6cbc463988ad90012e0b1513/users/1d61b6cefd2c4c50a1a79222bbc8ef22/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:17.396765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afc7fa-ecab-419e-b3e2-808737d90e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f9ea99f6cbc463988ad90012e0b1513, user_id=1d61b6cefd2c4c50a1a79222bbc8ef22, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:17.401787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afc7fa-ecab-419e-b3e2-808737d90e7a admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:17.430109 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1095/2180] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:46:17 2022] PUT /identity/v3/projects/9f9ea99f6cbc463988ad90012e0b1513/users/1d61b6cefd2c4c50a1a79222bbc8ef22/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:46:17.448253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e68c15-439a-4b26-89a3-22321f2a5e20 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:17.449702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e68c15-439a-4b26-89a3-22321f2a5e20 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:17.450301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e68c15-439a-4b26-89a3-22321f2a5e20 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:17.453514 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1086/2181] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 09:46:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:46:17.496733 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1778b-bd4c-468a-9a42-38231b04de81 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:17.497316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1778b-bd4c-468a-9a42-38231b04de81 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:17.499392 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1778b-bd4c-468a-9a42-38231b04de81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:17.511545 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c788e-90c8-4129-94cb-7845f61bf8aa None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:17.511811 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c788e-90c8-4129-94cb-7845f61bf8aa None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:17.512152 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c788e-90c8-4129-94cb-7845f61bf8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:17.600135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-b44c788e-90c8-4129-94cb-7845f61bf8aa None None] MFA Rules not processed for user `6983e364f5564ed7854dff06a80f55d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:17.601780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b44c788e-90c8-4129-94cb-7845f61bf8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:17.623694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-f0a1778b-bd4c-468a-9a42-38231b04de81 None None] MFA Rules not processed for user `1d61b6cefd2c4c50a1a79222bbc8ef22`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:17.625295 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f0a1778b-bd4c-468a-9a42-38231b04de81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:17.803648 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1087/2182] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 09:46:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:17.805227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c788e-90c8-4129-94cb-7845f61bf8aa None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:17.807104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b44c788e-90c8-4129-94cb-7845f61bf8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:17.812728 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1096/2183] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:17.828551 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1778b-bd4c-468a-9a42-38231b04de81 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:17.865762 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:17.939420 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1778b-bd4c-468a-9a42-38231b04de81 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:17.941253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c788e-90c8-4129-94cb-7845f61bf8aa None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:17.945452 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75557228-6143-413c-9b48-ab5bda56afb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:17.946587 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75557228-6143-413c-9b48-ab5bda56afb5 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:17.947093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918232a7-6d49-4576-b915-e08e1f788b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:17.947236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75557228-6143-413c-9b48-ab5bda56afb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:17.947841 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75557228-6143-413c-9b48-ab5bda56afb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:17.948687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75557228-6143-413c-9b48-ab5bda56afb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:17.948897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918232a7-6d49-4576-b915-e08e1f788b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:17.949140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918232a7-6d49-4576-b915-e08e1f788b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:17.951385 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75557228-6143-413c-9b48-ab5bda56afb5 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:17.951897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918232a7-6d49-4576-b915-e08e1f788b3a admin admin] PATH_INFO: `/v3/users/8985c6b6a96a4f8ba785876fb3508302` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:17.953281 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918232a7-6d49-4576-b915-e08e1f788b3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8985c6b6a96a4f8ba785876fb3508302)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:17.955995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918232a7-6d49-4576-b915-e08e1f788b3a admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:18.026185 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1097/2184] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:46:17 2022] POST /identity/v3/projects => generated 385 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:18.031725 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75557228-6143-413c-9b48-ab5bda56afb5 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:18.034248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-75557228-6143-413c-9b48-ab5bda56afb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:18.055090 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-918232a7-6d49-4576-b915-e08e1f788b3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8985c6b6a96a4f8ba785876fb3508302'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:18.055835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-918232a7-6d49-4576-b915-e08e1f788b3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8985c6b6a96a4f8ba785876fb3508302'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:18.056619 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-918232a7-6d49-4576-b915-e08e1f788b3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8985c6b6a96a4f8ba785876fb3508302'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:18.059376 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:18.102850 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-918232a7-6d49-4576-b915-e08e1f788b3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8985c6b6a96a4f8ba785876fb3508302'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:18.122916 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-918232a7-6d49-4576-b915-e08e1f788b3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8985c6b6a96a4f8ba785876fb3508302'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:18.145704 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1088/2185] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:46:17 2022] DELETE /identity/v3/users/8985c6b6a96a4f8ba785876fb3508302 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:18.146674 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918232a7-6d49-4576-b915-e08e1f788b3a admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:18.146944 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75557228-6143-413c-9b48-ab5bda56afb5 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:18.149978 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-918232a7-6d49-4576-b915-e08e1f788b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:18.356495 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8834b03-6fe9-4133-88af-d63e0daa7029 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983e364f5564ed7854dff06a80f55d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:18.357397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8834b03-6fe9-4133-88af-d63e0daa7029 service placement] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:18.357812 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8834b03-6fe9-4133-88af-d63e0daa7029 service placement] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:18.358198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8834b03-6fe9-4133-88af-d63e0daa7029 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:18.364674 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-c8834b03-6fe9-4133-88af-d63e0daa7029 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:18.376958 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918232a7-6d49-4576-b915-e08e1f788b3a admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:18.380622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8834b03-6fe9-4133-88af-d63e0daa7029 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:18.382831 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8834b03-6fe9-4133-88af-d63e0daa7029 service placement] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:18.390496 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87928a58-00d3-4ef1-94dd-0c5132fa03a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:18.391136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87928a58-00d3-4ef1-94dd-0c5132fa03a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:18.391422 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87928a58-00d3-4ef1-94dd-0c5132fa03a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:18.392247 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87928a58-00d3-4ef1-94dd-0c5132fa03a6 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:18.392904 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87928a58-00d3-4ef1-94dd-0c5132fa03a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:18.401294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87928a58-00d3-4ef1-94dd-0c5132fa03a6 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:18.409058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1098/2186] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:46:18.440301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1089/2187] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:46:18 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:18.445836 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8834b03-6fe9-4133-88af-d63e0daa7029 service placement] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:18.469403 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8834b03-6fe9-4133-88af-d63e0daa7029 service placement] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:18.476142 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bd5b8-7277-4c68-8a87-a20811535d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:18.476785 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bd5b8-7277-4c68-8a87-a20811535d1c admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:18.477048 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bd5b8-7277-4c68-8a87-a20811535d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:18.478124 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bd5b8-7277-4c68-8a87-a20811535d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:18.478239 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bd5b8-7277-4c68-8a87-a20811535d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:18.479841 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bd5b8-7277-4c68-8a87-a20811535d1c admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:18.493333 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1099/2188] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:18.501134 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87928a58-00d3-4ef1-94dd-0c5132fa03a6 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:18.522596 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87928a58-00d3-4ef1-94dd-0c5132fa03a6 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:18.530623 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9e78a-5ef5-4c0e-8572-86a031099034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:18.531449 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9e78a-5ef5-4c0e-8572-86a031099034 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:18.531602 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9e78a-5ef5-4c0e-8572-86a031099034 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:18.531895 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9e78a-5ef5-4c0e-8572-86a031099034 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:18.532638 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9e78a-5ef5-4c0e-8572-86a031099034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:18.534546 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9e78a-5ef5-4c0e-8572-86a031099034 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:18.542662 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bd5b8-7277-4c68-8a87-a20811535d1c admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:18.545199 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-4d8bd5b8-7277-4c68-8a87-a20811535d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:18.562449 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1090/2189] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:18.566846 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9e78a-5ef5-4c0e-8572-86a031099034 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:18.570659 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bd5b8-7277-4c68-8a87-a20811535d1c admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:18.582733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9e78a-5ef5-4c0e-8572-86a031099034 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:18.587902 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afddb203-3997-41b7-a323-a717d472713a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:18.588573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddb203-3997-41b7-a323-a717d472713a admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:18.588910 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddb203-3997-41b7-a323-a717d472713a admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:18.589280 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afddb203-3997-41b7-a323-a717d472713a admin admin] PATH_INFO: `/v3/projects/dfa7601c7bc544ce844fc0f40fdaa376/users/53f8d7b2681647df8c7b151096f2f6f6/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:18.606103 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06684cd1-ad61-4b15-a9a7-711e6955da42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:18.608999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06684cd1-ad61-4b15-a9a7-711e6955da42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:18.609736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06684cd1-ad61-4b15-a9a7-711e6955da42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:18.611276 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06684cd1-ad61-4b15-a9a7-711e6955da42 admin admin] PATH_INFO: `/v3/projects/6cca418a0bb54f728c67515702b1086c` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:18.612122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddb203-3997-41b7-a323-a717d472713a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa7601c7bc544ce844fc0f40fdaa376, user_id=53f8d7b2681647df8c7b151096f2f6f6, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:18.616620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06684cd1-ad61-4b15-a9a7-711e6955da42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cca418a0bb54f728c67515702b1086c)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:18.618006 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afddb203-3997-41b7-a323-a717d472713a admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:18.621278 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06684cd1-ad61-4b15-a9a7-711e6955da42 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:18.665122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1091/2190] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:46:18 2022] PUT /identity/v3/projects/dfa7601c7bc544ce844fc0f40fdaa376/users/53f8d7b2681647df8c7b151096f2f6f6/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:46:18.665122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed431d3a-8218-4bb5-878f-2125fdb838e0 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:18.665122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed431d3a-8218-4bb5-878f-2125fdb838e0 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:18.665122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed431d3a-8218-4bb5-878f-2125fdb838e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:18.676880 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:18.703946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-06684cd1-ad61-4b15-a9a7-711e6955da42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cca418a0bb54f728c67515702b1086c', 'request_id': 'req-06684cd1-ad61-4b15-a9a7-711e6955da42'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:18.714326 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-06684cd1-ad61-4b15-a9a7-711e6955da42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cca418a0bb54f728c67515702b1086c', 'request_id': 'req-06684cd1-ad61-4b15-a9a7-711e6955da42'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:18.714723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-ed431d3a-8218-4bb5-878f-2125fdb838e0 None None] MFA Rules not processed for user `448c4e0626c7433b9ca21a13207cace4`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:18.716947 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ed431d3a-8218-4bb5-878f-2125fdb838e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:18.726997 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-06684cd1-ad61-4b15-a9a7-711e6955da42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cca418a0bb54f728c67515702b1086c', 'request_id': 'req-06684cd1-ad61-4b15-a9a7-711e6955da42'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:18.746720 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-06684cd1-ad61-4b15-a9a7-711e6955da42 admin admin] The token cache is being invalidate because project 6cca418a0bb54f728c67515702b1086c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:46:18.747023 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-06684cd1-ad61-4b15-a9a7-711e6955da42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:18.748444 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-06684cd1-ad61-4b15-a9a7-711e6955da42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:18.750598 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1100/2191] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:46:18 2022] DELETE /identity/v3/projects/6cca418a0bb54f728c67515702b1086c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:46:18.751996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee90b6b-5863-4c21-bb30-5627c74478a6 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:18.754229 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee90b6b-5863-4c21-bb30-5627c74478a6 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:18.754229 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee90b6b-5863-4c21-bb30-5627c74478a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:18.789208 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-2ee90b6b-5863-4c21-bb30-5627c74478a6 None None] MFA Rules not processed for user `53f8d7b2681647df8c7b151096f2f6f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:18.791350 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2ee90b6b-5863-4c21-bb30-5627c74478a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:18.799980 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1092/2192] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:18.809702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc0346-b2d8-404b-9650-da27c38099f5 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:18.809702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc0346-b2d8-404b-9650-da27c38099f5 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:18.809702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc0346-b2d8-404b-9650-da27c38099f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:18.842987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-4ecc0346-b2d8-404b-9650-da27c38099f5 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:18.844302 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-4ecc0346-b2d8-404b-9650-da27c38099f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:18.853583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:18.925534 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1101/2193] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:18.928472 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee90b6b-5863-4c21-bb30-5627c74478a6 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:18.931448 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2ee90b6b-5863-4c21-bb30-5627c74478a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:18.942370 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1093/2194] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:18.942370 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc0346-b2d8-404b-9650-da27c38099f5 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:18.942370 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-4ecc0346-b2d8-404b-9650-da27c38099f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:18.961404 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc0346-b2d8-404b-9650-da27c38099f5 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:18.968619 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9022d39-1f1f-4773-b489-0979c2ca3ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:18.969578 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9022d39-1f1f-4773-b489-0979c2ca3ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:18.969971 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9022d39-1f1f-4773-b489-0979c2ca3ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:18.971565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9022d39-1f1f-4773-b489-0979c2ca3ca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:18.972371 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9022d39-1f1f-4773-b489-0979c2ca3ca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:18.974490 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee90b6b-5863-4c21-bb30-5627c74478a6 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:18.975617 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9022d39-1f1f-4773-b489-0979c2ca3ca3 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:18.986712 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fde7aa-7e99-4211-8010-56da402bbe0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:18.987390 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fde7aa-7e99-4211-8010-56da402bbe0e admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:18.987750 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fde7aa-7e99-4211-8010-56da402bbe0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:18.988179 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fde7aa-7e99-4211-8010-56da402bbe0e admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:18.988957 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fde7aa-7e99-4211-8010-56da402bbe0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:18.991214 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fde7aa-7e99-4211-8010-56da402bbe0e admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:19.020406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1094/2195] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:46:18 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:19.020406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e385e16-b7ab-4251-8118-af712318396c None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.020406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e385e16-b7ab-4251-8118-af712318396c None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.020406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e385e16-b7ab-4251-8118-af712318396c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.045262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1102/2196] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:46:18 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:19.048937 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-3e385e16-b7ab-4251-8118-af712318396c None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:19.053300 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fde7aa-7e99-4211-8010-56da402bbe0e admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:19.055230 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-3e385e16-b7ab-4251-8118-af712318396c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:19.160459 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fde7aa-7e99-4211-8010-56da402bbe0e admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:19.177724 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bfdae-e2af-4fe3-b1d2-38f5836ba25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:19.179096 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bfdae-e2af-4fe3-b1d2-38f5836ba25f admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.179390 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bfdae-e2af-4fe3-b1d2-38f5836ba25f admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.179676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bfdae-e2af-4fe3-b1d2-38f5836ba25f admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.180316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bfdae-e2af-4fe3-b1d2-38f5836ba25f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:19.187583 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bfdae-e2af-4fe3-b1d2-38f5836ba25f admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:19.206292 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1095/2197] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:19.228064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e385e16-b7ab-4251-8118-af712318396c None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:19.243775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1103/2198] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:46:19 2022] POST /identity/v3/users => generated 299 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:19.244549 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bfdae-e2af-4fe3-b1d2-38f5836ba25f admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:19.262072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bfdae-e2af-4fe3-b1d2-38f5836ba25f admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:19.266781 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e385e16-b7ab-4251-8118-af712318396c None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:19.268974 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dd224-42b3-4997-8178-580b937e8ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:19.269727 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dd224-42b3-4997-8178-580b937e8ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.270074 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dd224-42b3-4997-8178-580b937e8ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.270420 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dd224-42b3-4997-8178-580b937e8ea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.271167 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6dd224-42b3-4997-8178-580b937e8ea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:19.271619 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6dd224-42b3-4997-8178-580b937e8ea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:19.273344 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6dd224-42b3-4997-8178-580b937e8ea1 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:19.274378 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7382e2-8c13-4f87-880b-b4105b7c7f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:19.275560 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7382e2-8c13-4f87-880b-b4105b7c7f90 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.276032 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7382e2-8c13-4f87-880b-b4105b7c7f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.276496 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7382e2-8c13-4f87-880b-b4105b7c7f90 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.277924 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7382e2-8c13-4f87-880b-b4105b7c7f90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:19.280729 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7382e2-8c13-4f87-880b-b4105b7c7f90 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:19.285424 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:19.297711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1104/2199] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:19.298802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dd224-42b3-4997-8178-580b937e8ea1 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:19.313041 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dd224-42b3-4997-8178-580b937e8ea1 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:19.319201 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe6a54-035a-40a8-97da-521a9a176986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:19.319814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe6a54-035a-40a8-97da-521a9a176986 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.320091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe6a54-035a-40a8-97da-521a9a176986 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.320365 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe6a54-035a-40a8-97da-521a9a176986 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.321042 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe6a54-035a-40a8-97da-521a9a176986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:19.322656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe6a54-035a-40a8-97da-521a9a176986 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:19.339476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1105/2200] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:19.339476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe6a54-035a-40a8-97da-521a9a176986 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:19.339705 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1096/2201] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:46:19 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:19.339705 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7382e2-8c13-4f87-880b-b4105b7c7f90 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:19.353287 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7382e2-8c13-4f87-880b-b4105b7c7f90 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:19.354842 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe6a54-035a-40a8-97da-521a9a176986 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:19.359602 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b4fe4-a600-4630-9b18-2fbf410fbcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:19.360215 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0880c-fc0c-42b0-a7c8-81957cad68e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:19.360342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b4fe4-a600-4630-9b18-2fbf410fbcf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.360513 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b4fe4-a600-4630-9b18-2fbf410fbcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.360779 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b4fe4-a600-4630-9b18-2fbf410fbcf7 admin admin] PATH_INFO: `/v3/projects/e0a7fe42a08d4f1e81f4a25fdc56378b/users/f44147ea71334ac69dada6745ab2a679/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.361105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0880c-fc0c-42b0-a7c8-81957cad68e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.361524 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0880c-fc0c-42b0-a7c8-81957cad68e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.361773 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0880c-fc0c-42b0-a7c8-81957cad68e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.362868 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0880c-fc0c-42b0-a7c8-81957cad68e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:19.364304 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0880c-fc0c-42b0-a7c8-81957cad68e8 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:19.380015 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b4fe4-a600-4630-9b18-2fbf410fbcf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a7fe42a08d4f1e81f4a25fdc56378b, user_id=f44147ea71334ac69dada6745ab2a679, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:19.383030 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b4fe4-a600-4630-9b18-2fbf410fbcf7 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:19.394189 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1106/2202] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:46:19 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:19.395320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0880c-fc0c-42b0-a7c8-81957cad68e8 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:19.407400 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1097/2203] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:46:19 2022] PUT /identity/v3/projects/e0a7fe42a08d4f1e81f4a25fdc56378b/users/f44147ea71334ac69dada6745ab2a679/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:19.408392 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b4fe4-a600-4630-9b18-2fbf410fbcf7 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:19.466914 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0880c-fc0c-42b0-a7c8-81957cad68e8 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:19.473606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:19.492907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b4fe4-a600-4630-9b18-2fbf410fbcf7 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:19.498670 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6a652-d65b-4328-a7ee-9c022b62f42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:19.499294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6a652-d65b-4328-a7ee-9c022b62f42b admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.499574 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6a652-d65b-4328-a7ee-9c022b62f42b admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.499849 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6a652-d65b-4328-a7ee-9c022b62f42b admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.500479 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6a652-d65b-4328-a7ee-9c022b62f42b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:19.502483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6a652-d65b-4328-a7ee-9c022b62f42b admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:19.530093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1098/2204] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:46:19 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:19.530093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6a652-d65b-4328-a7ee-9c022b62f42b admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:19.534463 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db1737-a757-42b8-9019-92d76a088a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:19.535076 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db1737-a757-42b8-9019-92d76a088a0d admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.535367 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db1737-a757-42b8-9019-92d76a088a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.535646 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db1737-a757-42b8-9019-92d76a088a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.536281 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db1737-a757-42b8-9019-92d76a088a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:19.537912 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db1737-a757-42b8-9019-92d76a088a0d admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:19.540145 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6a652-d65b-4328-a7ee-9c022b62f42b admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:19.545436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f198e-8c9e-4a0e-8e0b-b3744731f681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:19.546166 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f198e-8c9e-4a0e-8e0b-b3744731f681 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.546443 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f198e-8c9e-4a0e-8e0b-b3744731f681 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.546715 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f198e-8c9e-4a0e-8e0b-b3744731f681 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.547362 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f198e-8c9e-4a0e-8e0b-b3744731f681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:19.548995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f198e-8c9e-4a0e-8e0b-b3744731f681 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:19.549113 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1107/2205] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:19.550091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db1737-a757-42b8-9019-92d76a088a0d admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:19.562941 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1099/2206] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:19.563134 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db1737-a757-42b8-9019-92d76a088a0d admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:19.563229 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f198e-8c9e-4a0e-8e0b-b3744731f681 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:19.567955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf53bc-f7bc-45e6-a699-40d189da5e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:19.568584 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf53bc-f7bc-45e6-a699-40d189da5e28 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.568912 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf53bc-f7bc-45e6-a699-40d189da5e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.569201 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf53bc-f7bc-45e6-a699-40d189da5e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.569882 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf53bc-f7bc-45e6-a699-40d189da5e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:19.571301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f198e-8c9e-4a0e-8e0b-b3744731f681 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:19.571943 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf53bc-f7bc-45e6-a699-40d189da5e28 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:19.576017 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398cd26-b800-43d6-82b8-3ebb98cc8b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:19.576670 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398cd26-b800-43d6-82b8-3ebb98cc8b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.576999 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398cd26-b800-43d6-82b8-3ebb98cc8b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.577270 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398cd26-b800-43d6-82b8-3ebb98cc8b13 admin admin] PATH_INFO: `/v3/projects/07b69bbf11d648a69a5f520617fee587/users/8ed8205cf1854495af1786d49f042c34/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.582647 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1108/2207] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:19.583659 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf53bc-f7bc-45e6-a699-40d189da5e28 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:19.594368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf53bc-f7bc-45e6-a699-40d189da5e28 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:19.595609 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398cd26-b800-43d6-82b8-3ebb98cc8b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07b69bbf11d648a69a5f520617fee587, user_id=8ed8205cf1854495af1786d49f042c34, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:19.598291 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398cd26-b800-43d6-82b8-3ebb98cc8b13 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:19.599339 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78106065-f8b5-41db-a983-84b08f996494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:19.599971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78106065-f8b5-41db-a983-84b08f996494 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.600250 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78106065-f8b5-41db-a983-84b08f996494 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.600527 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78106065-f8b5-41db-a983-84b08f996494 admin admin] PATH_INFO: `/v3/projects/e0a7fe42a08d4f1e81f4a25fdc56378b/users/f44147ea71334ac69dada6745ab2a679/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.602491 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78106065-f8b5-41db-a983-84b08f996494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a7fe42a08d4f1e81f4a25fdc56378b, user_id=f44147ea71334ac69dada6745ab2a679, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:19.605206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78106065-f8b5-41db-a983-84b08f996494 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:19.612306 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1100/2208] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:46:19 2022] PUT /identity/v3/projects/07b69bbf11d648a69a5f520617fee587/users/8ed8205cf1854495af1786d49f042c34/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:19.613144 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398cd26-b800-43d6-82b8-3ebb98cc8b13 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:19.617621 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1109/2209] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:46:19 2022] PUT /identity/v3/projects/e0a7fe42a08d4f1e81f4a25fdc56378b/users/f44147ea71334ac69dada6745ab2a679/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:19.618423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78106065-f8b5-41db-a983-84b08f996494 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:19.667849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:19.688050 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78106065-f8b5-41db-a983-84b08f996494 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:19.700697 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97614e-e5d4-4795-b032-8e3b9531515b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:19.701441 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97614e-e5d4-4795-b032-8e3b9531515b admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.701773 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97614e-e5d4-4795-b032-8e3b9531515b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.702020 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97614e-e5d4-4795-b032-8e3b9531515b admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.702673 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97614e-e5d4-4795-b032-8e3b9531515b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:19.704428 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97614e-e5d4-4795-b032-8e3b9531515b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:19.706832 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398cd26-b800-43d6-82b8-3ebb98cc8b13 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:19.711696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4fa60-2e5e-4139-b5d2-a43dd103b872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:19.712336 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4fa60-2e5e-4139-b5d2-a43dd103b872 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.712588 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4fa60-2e5e-4139-b5d2-a43dd103b872 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.712864 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4fa60-2e5e-4139-b5d2-a43dd103b872 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.713547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4fa60-2e5e-4139-b5d2-a43dd103b872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:19.715151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4fa60-2e5e-4139-b5d2-a43dd103b872 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:19.718502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1110/2210] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:19.720144 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e3c7a-c967-4d62-bd6c-c24ae90747ae None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.720764 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e3c7a-c967-4d62-bd6c-c24ae90747ae None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.721109 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e3c7a-c967-4d62-bd6c-c24ae90747ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.733661 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1101/2211] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:19.733661 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4fa60-2e5e-4139-b5d2-a43dd103b872 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:19.743329 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4fa60-2e5e-4139-b5d2-a43dd103b872 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:19.748469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1fcb2-2bc2-46a6-9e36-9a57a6bf6e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:19.749137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1fcb2-2bc2-46a6-9e36-9a57a6bf6e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.749421 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1fcb2-2bc2-46a6-9e36-9a57a6bf6e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.749743 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1fcb2-2bc2-46a6-9e36-9a57a6bf6e64 admin admin] PATH_INFO: `/v3/projects/07b69bbf11d648a69a5f520617fee587/users/8ed8205cf1854495af1786d49f042c34/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.752121 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1fcb2-2bc2-46a6-9e36-9a57a6bf6e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07b69bbf11d648a69a5f520617fee587, user_id=8ed8205cf1854495af1786d49f042c34, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:19.757480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1fcb2-2bc2-46a6-9e36-9a57a6bf6e64 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:19.760532 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-691e3c7a-c967-4d62-bd6c-c24ae90747ae None None] MFA Rules not processed for user `f44147ea71334ac69dada6745ab2a679`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:19.762520 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-691e3c7a-c967-4d62-bd6c-c24ae90747ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:19.769019 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1102/2212] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:46:19 2022] PUT /identity/v3/projects/07b69bbf11d648a69a5f520617fee587/users/8ed8205cf1854495af1786d49f042c34/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:19.773369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1fcb2-2bc2-46a6-9e36-9a57a6bf6e64 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:19.866654 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1111/2213] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:19.867094 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1fcb2-2bc2-46a6-9e36-9a57a6bf6e64 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:19.872266 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2940c-fa7c-47b9-8fc8-99ed0f6a1787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:19.873142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2940c-fa7c-47b9-8fc8-99ed0f6a1787 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.873435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2940c-fa7c-47b9-8fc8-99ed0f6a1787 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.873760 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2940c-fa7c-47b9-8fc8-99ed0f6a1787 admin admin] PATH_INFO: `/v3/projects/22802a45150d47bcaa21fbf33b0f07a5/users/773aa069f2b944b0a2f4bfc9f630625c/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.878533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e3c7a-c967-4d62-bd6c-c24ae90747ae None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:19.879954 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-691e3c7a-c967-4d62-bd6c-c24ae90747ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:19.897703 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2940c-fa7c-47b9-8fc8-99ed0f6a1787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22802a45150d47bcaa21fbf33b0f07a5, user_id=773aa069f2b944b0a2f4bfc9f630625c, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:19.902104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2940c-fa7c-47b9-8fc8-99ed0f6a1787 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:19.921969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1103/2214] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:46:19 2022] PUT /identity/v3/projects/22802a45150d47bcaa21fbf33b0f07a5/users/773aa069f2b944b0a2f4bfc9f630625c/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:19.933981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34744cf-fcfd-4db3-82b2-421c5fae65e2 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:19.934269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34744cf-fcfd-4db3-82b2-421c5fae65e2 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:19.934537 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34744cf-fcfd-4db3-82b2-421c5fae65e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:19.950408 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e3c7a-c967-4d62-bd6c-c24ae90747ae None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:19.959750 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:19.973658 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-b34744cf-fcfd-4db3-82b2-421c5fae65e2 None None] MFA Rules not processed for user `773aa069f2b944b0a2f4bfc9f630625c`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:19.975714 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b34744cf-fcfd-4db3-82b2-421c5fae65e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:20.041512 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da860709-cb99-4096-8b75-7ee0319ae8c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:20.043033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da860709-cb99-4096-8b75-7ee0319ae8c4 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:20.043832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da860709-cb99-4096-8b75-7ee0319ae8c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:20.044195 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da860709-cb99-4096-8b75-7ee0319ae8c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:20.049831 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-da860709-cb99-4096-8b75-7ee0319ae8c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:20.087822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1104/2215] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:46:20.092816 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34744cf-fcfd-4db3-82b2-421c5fae65e2 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:20.103443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:20.186474 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da860709-cb99-4096-8b75-7ee0319ae8c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:20.188254 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da860709-cb99-4096-8b75-7ee0319ae8c4 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:20.203588 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1112/2216] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:46:20.234996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34744cf-fcfd-4db3-82b2-421c5fae65e2 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:20.252825 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13b9c1-35fd-4c57-a83a-23d389447e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:20.253487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13b9c1-35fd-4c57-a83a-23d389447e8d admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:20.253758 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13b9c1-35fd-4c57-a83a-23d389447e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:20.256123 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13b9c1-35fd-4c57-a83a-23d389447e8d admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:20.256777 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13b9c1-35fd-4c57-a83a-23d389447e8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:20.263232 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13b9c1-35fd-4c57-a83a-23d389447e8d admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:20.330496 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1105/2217] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:46:20 2022] POST /identity/v3/projects => generated 373 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:20.334630 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da860709-cb99-4096-8b75-7ee0319ae8c4 service cinder] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:20.355660 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da860709-cb99-4096-8b75-7ee0319ae8c4 service cinder] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:20.554479 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca7a08-19ba-42e6-aa45-f304d91fdc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:20.555103 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca7a08-19ba-42e6-aa45-f304d91fdc19 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:20.557983 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca7a08-19ba-42e6-aa45-f304d91fdc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:20.560140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca7a08-19ba-42e6-aa45-f304d91fdc19 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:20.561350 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca7a08-19ba-42e6-aa45-f304d91fdc19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:20.569145 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca7a08-19ba-42e6-aa45-f304d91fdc19 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:20.640256 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1113/2218] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:46:20 2022] POST /identity/v3/users => generated 293 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:20.642855 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13b9c1-35fd-4c57-a83a-23d389447e8d admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:20.660725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13b9c1-35fd-4c57-a83a-23d389447e8d admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:20.675913 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5031b2-493f-455c-a39b-91c1372be409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:20.677031 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5031b2-493f-455c-a39b-91c1372be409 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:20.678611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5031b2-493f-455c-a39b-91c1372be409 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:20.679085 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5031b2-493f-455c-a39b-91c1372be409 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:20.680338 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5031b2-493f-455c-a39b-91c1372be409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:20.686321 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5031b2-493f-455c-a39b-91c1372be409 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:20.714129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1106/2219] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:20.718541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca7a08-19ba-42e6-aa45-f304d91fdc19 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:20.745526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca7a08-19ba-42e6-aa45-f304d91fdc19 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:20.754833 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f38e51-1ad4-4935-ac55-85efe1750eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:20.757528 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f38e51-1ad4-4935-ac55-85efe1750eb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:20.758699 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f38e51-1ad4-4935-ac55-85efe1750eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:20.759372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f38e51-1ad4-4935-ac55-85efe1750eb9 admin admin] PATH_INFO: `/v3/projects/fb3d0ebcca0846bca37570d86f142e01/users/7f4ff6d3e1524e2db4a59d50596236bb/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:20.797031 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f38e51-1ad4-4935-ac55-85efe1750eb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb3d0ebcca0846bca37570d86f142e01, user_id=7f4ff6d3e1524e2db4a59d50596236bb, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:20.804390 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f38e51-1ad4-4935-ac55-85efe1750eb9 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:20.838567 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1114/2220] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:46:20 2022] PUT /identity/v3/projects/fb3d0ebcca0846bca37570d86f142e01/users/7f4ff6d3e1524e2db4a59d50596236bb/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:20.842571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5031b2-493f-455c-a39b-91c1372be409 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:20.859850 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5031b2-493f-455c-a39b-91c1372be409 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:20.972444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae983d-f104-4fa6-96cd-3b0a83f5dc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:20.973042 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae983d-f104-4fa6-96cd-3b0a83f5dc7a admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:20.973330 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae983d-f104-4fa6-96cd-3b0a83f5dc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:20.973656 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae983d-f104-4fa6-96cd-3b0a83f5dc7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:20.974396 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae983d-f104-4fa6-96cd-3b0a83f5dc7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:20.976730 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae983d-f104-4fa6-96cd-3b0a83f5dc7a admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:20.990017 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1107/2221] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:20.994025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f38e51-1ad4-4935-ac55-85efe1750eb9 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:21.018073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f38e51-1ad4-4935-ac55-85efe1750eb9 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:21.023928 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b10c4-7cae-43d8-81f3-b70f420c706a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:21.024857 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b10c4-7cae-43d8-81f3-b70f420c706a admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:21.025333 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b10c4-7cae-43d8-81f3-b70f420c706a admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:21.025825 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b10c4-7cae-43d8-81f3-b70f420c706a admin admin] PATH_INFO: `/v3/projects/fb3d0ebcca0846bca37570d86f142e01/users/7f4ff6d3e1524e2db4a59d50596236bb/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:21.028378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b10c4-7cae-43d8-81f3-b70f420c706a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb3d0ebcca0846bca37570d86f142e01, user_id=7f4ff6d3e1524e2db4a59d50596236bb, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:21.032119 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b10c4-7cae-43d8-81f3-b70f420c706a admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:21.047999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1115/2222] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:46:20 2022] PUT /identity/v3/projects/fb3d0ebcca0846bca37570d86f142e01/users/7f4ff6d3e1524e2db4a59d50596236bb/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:21.062123 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73928a09-4bce-4d79-8b6d-a79e1d789761 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:21.062462 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73928a09-4bce-4d79-8b6d-a79e1d789761 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:21.062683 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73928a09-4bce-4d79-8b6d-a79e1d789761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:21.086161 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:21.099180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-73928a09-4bce-4d79-8b6d-a79e1d789761 None None] MFA Rules not processed for user `7f4ff6d3e1524e2db4a59d50596236bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:21.101101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-73928a09-4bce-4d79-8b6d-a79e1d789761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:21.195113 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1108/2223] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:21.207196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b10c4-7cae-43d8-81f3-b70f420c706a admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:21.309125 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b10c4-7cae-43d8-81f3-b70f420c706a admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:21.314612 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018631bc-39ae-4ced-bfcb-ec4d2cfac5c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:21.315329 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018631bc-39ae-4ced-bfcb-ec4d2cfac5c0 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:21.315687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018631bc-39ae-4ced-bfcb-ec4d2cfac5c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:21.316524 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018631bc-39ae-4ced-bfcb-ec4d2cfac5c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:21.331196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018631bc-39ae-4ced-bfcb-ec4d2cfac5c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:21.334418 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018631bc-39ae-4ced-bfcb-ec4d2cfac5c0 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:21.347308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1116/2224] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:46:21.452066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73928a09-4bce-4d79-8b6d-a79e1d789761 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:21.465155 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73928a09-4bce-4d79-8b6d-a79e1d789761 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:21.473075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d068ff-1605-4d34-acb6-18b1b02e3208 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:21.473787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d068ff-1605-4d34-acb6-18b1b02e3208 service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:21.474246 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d068ff-1605-4d34-acb6-18b1b02e3208 service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:21.474535 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d068ff-1605-4d34-acb6-18b1b02e3208 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:21.576035 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d068ff-1605-4d34-acb6-18b1b02e3208 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:21.578513 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d068ff-1605-4d34-acb6-18b1b02e3208 service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:21.611826 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1109/2225] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:46:22.229799 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018631bc-39ae-4ced-bfcb-ec4d2cfac5c0 service cinder] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:22.250200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018631bc-39ae-4ced-bfcb-ec4d2cfac5c0 service cinder] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:22.254322 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bab12-4a6a-4e3f-b98a-3cf98556e74b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:22.255163 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bab12-4a6a-4e3f-b98a-3cf98556e74b service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:22.257156 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bab12-4a6a-4e3f-b98a-3cf98556e74b service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:22.257652 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bab12-4a6a-4e3f-b98a-3cf98556e74b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:22.309518 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:22.341486 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bab12-4a6a-4e3f-b98a-3cf98556e74b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:22.343101 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bab12-4a6a-4e3f-b98a-3cf98556e74b service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:22.354347 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1117/2226] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:46:23.704476 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d068ff-1605-4d34-acb6-18b1b02e3208 service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:23.705994 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b3d068ff-1605-4d34-acb6-18b1b02e3208 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:23.729207 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d068ff-1605-4d34-acb6-18b1b02e3208 service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:23.760327 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b0a20-0833-454f-b8ed-3091dbf0c25d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:23.761349 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b0a20-0833-454f-b8ed-3091dbf0c25d service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:23.763604 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b0a20-0833-454f-b8ed-3091dbf0c25d service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:23.764049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b0a20-0833-454f-b8ed-3091dbf0c25d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:23.932183 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b0a20-0833-454f-b8ed-3091dbf0c25d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:23.934448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b0a20-0833-454f-b8ed-3091dbf0c25d service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:23.959457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1110/2227] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:46:24.978544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d3adc-d802-4d94-b864-9324c94d9b5f None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:24.979508 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d3adc-d802-4d94-b864-9324c94d9b5f None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:24.979852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d3adc-d802-4d94-b864-9324c94d9b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:25.008134 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-748d3adc-d802-4d94-b864-9324c94d9b5f None None] MFA Rules not processed for user `63cc1f9e479e41c2bc0d5baa2c60b903`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:25.009923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-748d3adc-d802-4d94-b864-9324c94d9b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:25.142005 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1118/2228] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:25.938974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b0a20-0833-454f-b8ed-3091dbf0c25d service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:25.951595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-259b0a20-0833-454f-b8ed-3091dbf0c25d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:26.024587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:26.103288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b0a20-0833-454f-b8ed-3091dbf0c25d service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:26.112659 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606dd737-69b0-4196-af58-05367b915430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:26.113320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dd737-69b0-4196-af58-05367b915430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:26.114978 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dd737-69b0-4196-af58-05367b915430 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:26.114978 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dd737-69b0-4196-af58-05367b915430 admin admin] PATH_INFO: `/v3/users/89ca0a6e5ac847be948e0efba9b2d412` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:26.115156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606dd737-69b0-4196-af58-05367b915430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ca0a6e5ac847be948e0efba9b2d412)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:26.117121 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606dd737-69b0-4196-af58-05367b915430 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:26.218607 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-606dd737-69b0-4196-af58-05367b915430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ca0a6e5ac847be948e0efba9b2d412'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:26.219379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-606dd737-69b0-4196-af58-05367b915430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ca0a6e5ac847be948e0efba9b2d412'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:26.220061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-606dd737-69b0-4196-af58-05367b915430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ca0a6e5ac847be948e0efba9b2d412'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:26.265817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-606dd737-69b0-4196-af58-05367b915430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ca0a6e5ac847be948e0efba9b2d412'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:26.287710 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-606dd737-69b0-4196-af58-05367b915430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ca0a6e5ac847be948e0efba9b2d412'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:26.327055 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1111/2229] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:46:25 2022] DELETE /identity/v3/users/89ca0a6e5ac847be948e0efba9b2d412 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:26.331767 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fdb64-7a51-46d1-9021-ea4c2399891d None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:26.332637 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fdb64-7a51-46d1-9021-ea4c2399891d None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:26.333152 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fdb64-7a51-46d1-9021-ea4c2399891d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:26.359487 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-f20fdb64-7a51-46d1-9021-ea4c2399891d None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:26.361801 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f20fdb64-7a51-46d1-9021-ea4c2399891d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:26.422762 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a1df1-900b-4e46-88bd-fb70c1bc4687 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:26.423227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a1df1-900b-4e46-88bd-fb70c1bc4687 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:26.423686 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a1df1-900b-4e46-88bd-fb70c1bc4687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:26.481379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-e64a1df1-900b-4e46-88bd-fb70c1bc4687 None None] MFA Rules not processed for user `8ed8205cf1854495af1786d49f042c34`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:26.484706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e64a1df1-900b-4e46-88bd-fb70c1bc4687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:26.500092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1119/2230] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:26.509998 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fdb64-7a51-46d1-9021-ea4c2399891d None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:26.512197 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f20fdb64-7a51-46d1-9021-ea4c2399891d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:26.678553 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1112/2231] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:26.680993 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fdb64-7a51-46d1-9021-ea4c2399891d None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:26.686577 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013512c-d358-4a0c-afb0-0bcbbbc622f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:26.687452 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013512c-d358-4a0c-afb0-0bcbbbc622f0 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:26.687730 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013512c-d358-4a0c-afb0-0bcbbbc622f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:26.688036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013512c-d358-4a0c-afb0-0bcbbbc622f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:26.693502 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a1df1-900b-4e46-88bd-fb70c1bc4687 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:26.696817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e64a1df1-900b-4e46-88bd-fb70c1bc4687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:26.727050 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013512c-d358-4a0c-afb0-0bcbbbc622f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:26.728885 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013512c-d358-4a0c-afb0-0bcbbbc622f0 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:26.758346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1120/2232] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:46:26.761863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:26.868100 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a1df1-900b-4e46-88bd-fb70c1bc4687 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:26.875938 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a7218-d5ff-45d7-9075-6d18a7fc6960 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:26.876558 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a7218-d5ff-45d7-9075-6d18a7fc6960 service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:26.877311 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a7218-d5ff-45d7-9075-6d18a7fc6960 service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:26.877311 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a7218-d5ff-45d7-9075-6d18a7fc6960 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:26.880342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b22a7218-d5ff-45d7-9075-6d18a7fc6960 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:27.011807 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a7218-d5ff-45d7-9075-6d18a7fc6960 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:27.013883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a7218-d5ff-45d7-9075-6d18a7fc6960 service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:27.026770 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1113/2233] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:46:27.409281 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013512c-d358-4a0c-afb0-0bcbbbc622f0 service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:27.412328 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-c013512c-d358-4a0c-afb0-0bcbbbc622f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:27.488270 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013512c-d358-4a0c-afb0-0bcbbbc622f0 service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:27.507534 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df78a81-b17e-4384-a716-5d5d200b353d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:27.534725 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df78a81-b17e-4384-a716-5d5d200b353d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:27.535129 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df78a81-b17e-4384-a716-5d5d200b353d admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:27.535770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df78a81-b17e-4384-a716-5d5d200b353d admin admin] PATH_INFO: `/v3/projects/7f5567da4a34484d9974755d675a8889` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:27.541431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df78a81-b17e-4384-a716-5d5d200b353d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f5567da4a34484d9974755d675a8889)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:27.553994 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df78a81-b17e-4384-a716-5d5d200b353d admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:27.593106 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:27.778226 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0df78a81-b17e-4384-a716-5d5d200b353d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f5567da4a34484d9974755d675a8889', 'request_id': 'req-0df78a81-b17e-4384-a716-5d5d200b353d'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:27.818454 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0df78a81-b17e-4384-a716-5d5d200b353d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f5567da4a34484d9974755d675a8889', 'request_id': 'req-0df78a81-b17e-4384-a716-5d5d200b353d'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:27.846483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0df78a81-b17e-4384-a716-5d5d200b353d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f5567da4a34484d9974755d675a8889', 'request_id': 'req-0df78a81-b17e-4384-a716-5d5d200b353d'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:27.864708 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0df78a81-b17e-4384-a716-5d5d200b353d admin admin] The token cache is being invalidate because project 7f5567da4a34484d9974755d675a8889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:46:27.864998 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0df78a81-b17e-4384-a716-5d5d200b353d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:27.866052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0df78a81-b17e-4384-a716-5d5d200b353d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:27.868768 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1121/2234] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:46:27 2022] DELETE /identity/v3/projects/7f5567da4a34484d9974755d675a8889 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:27.874254 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfa1a3-ce48-4e5b-8ad7-c1efd6630584 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:27.874832 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfa1a3-ce48-4e5b-8ad7-c1efd6630584 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:27.875334 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfa1a3-ce48-4e5b-8ad7-c1efd6630584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:27.923877 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-95cfa1a3-ce48-4e5b-8ad7-c1efd6630584 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:27.928129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-95cfa1a3-ce48-4e5b-8ad7-c1efd6630584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:28.073385 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1114/2235] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:46:28.082718 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4f638-8c57-4d09-9960-de4b8370e258 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:28.083175 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4f638-8c57-4d09-9960-de4b8370e258 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:28.083523 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4f638-8c57-4d09-9960-de4b8370e258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:28.117511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-fad4f638-8c57-4d09-9960-de4b8370e258 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:28.120431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-fad4f638-8c57-4d09-9960-de4b8370e258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:28.132393 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1122/2236] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:28.142099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfa1a3-ce48-4e5b-8ad7-c1efd6630584 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:28.160499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfa1a3-ce48-4e5b-8ad7-c1efd6630584 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:28.168033 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fd3a2-3a22-4e56-b42d-6a4b5274d75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:28.168669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fd3a2-3a22-4e56-b42d-6a4b5274d75d admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:28.168981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fd3a2-3a22-4e56-b42d-6a4b5274d75d admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:28.169255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fd3a2-3a22-4e56-b42d-6a4b5274d75d admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:28.169967 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08fd3a2-3a22-4e56-b42d-6a4b5274d75d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:28.170629 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08fd3a2-3a22-4e56-b42d-6a4b5274d75d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:28.172235 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08fd3a2-3a22-4e56-b42d-6a4b5274d75d admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:28.190274 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1115/2237] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:28.191753 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4f638-8c57-4d09-9960-de4b8370e258 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:28.217866 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4f638-8c57-4d09-9960-de4b8370e258 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:28.234437 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab0b8a-0427-4041-82f0-d00b13813841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:28.235068 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab0b8a-0427-4041-82f0-d00b13813841 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:28.235352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab0b8a-0427-4041-82f0-d00b13813841 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:28.235628 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab0b8a-0427-4041-82f0-d00b13813841 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:28.236275 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab0b8a-0427-4041-82f0-d00b13813841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:28.238228 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab0b8a-0427-4041-82f0-d00b13813841 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:28.300201 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1123/2238] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:46:28 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:46:28.304944 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fd3a2-3a22-4e56-b42d-6a4b5274d75d admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:28.318872 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fd3a2-3a22-4e56-b42d-6a4b5274d75d admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:28.425753 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:28.436466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88876b65-ed3f-4eeb-8110-5e10f650ddb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:28.437621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88876b65-ed3f-4eeb-8110-5e10f650ddb9 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:28.438010 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88876b65-ed3f-4eeb-8110-5e10f650ddb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:28.438388 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88876b65-ed3f-4eeb-8110-5e10f650ddb9 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:28.439679 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88876b65-ed3f-4eeb-8110-5e10f650ddb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:28.442182 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88876b65-ed3f-4eeb-8110-5e10f650ddb9 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:28.475506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1116/2239] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:46:28 2022] POST /identity/v3/users => generated 283 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:46:28.479859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab0b8a-0427-4041-82f0-d00b13813841 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:28.494738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab0b8a-0427-4041-82f0-d00b13813841 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:28.502449 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c3f0c-bec9-4be6-9bac-b994b5f25cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:28.503155 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c3f0c-bec9-4be6-9bac-b994b5f25cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:28.503486 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c3f0c-bec9-4be6-9bac-b994b5f25cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:28.503948 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c3f0c-bec9-4be6-9bac-b994b5f25cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:28.504831 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c3f0c-bec9-4be6-9bac-b994b5f25cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:28.507321 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c3f0c-bec9-4be6-9bac-b994b5f25cc4 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:28.521358 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1124/2240] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:46:28.525147 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88876b65-ed3f-4eeb-8110-5e10f650ddb9 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:28.539392 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88876b65-ed3f-4eeb-8110-5e10f650ddb9 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:28.548945 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6d5ff-19ac-4c62-9c80-d1f7d1a3b309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:28.550066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6d5ff-19ac-4c62-9c80-d1f7d1a3b309 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:28.550549 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6d5ff-19ac-4c62-9c80-d1f7d1a3b309 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:28.551508 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6d5ff-19ac-4c62-9c80-d1f7d1a3b309 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:28.552349 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6d5ff-19ac-4c62-9c80-d1f7d1a3b309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:28.554874 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6d5ff-19ac-4c62-9c80-d1f7d1a3b309 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:28.572450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1117/2241] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:28.577291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c3f0c-bec9-4be6-9bac-b994b5f25cc4 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:28.588138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c3f0c-bec9-4be6-9bac-b994b5f25cc4 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:28.593841 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b03c75-1a19-492c-bc57-c80d2ef3e61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:28.595608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b03c75-1a19-492c-bc57-c80d2ef3e61b admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:28.596456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b03c75-1a19-492c-bc57-c80d2ef3e61b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:28.596948 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b03c75-1a19-492c-bc57-c80d2ef3e61b admin admin] PATH_INFO: `/v3/projects/d85a626811f148a7ae86f0fa44b38acf/users/4697b8e243244fb5864e28123b0d33b2/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:28.634450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b03c75-1a19-492c-bc57-c80d2ef3e61b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85a626811f148a7ae86f0fa44b38acf, user_id=4697b8e243244fb5864e28123b0d33b2, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:28.640755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b03c75-1a19-492c-bc57-c80d2ef3e61b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:28.676129 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1125/2242] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:46:28 2022] PUT /identity/v3/projects/d85a626811f148a7ae86f0fa44b38acf/users/4697b8e243244fb5864e28123b0d33b2/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:28.689965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1072219-f740-4aed-b9e6-328b864003c9 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:28.690333 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1072219-f740-4aed-b9e6-328b864003c9 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:28.690709 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1072219-f740-4aed-b9e6-328b864003c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:28.737233 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b03c75-1a19-492c-bc57-c80d2ef3e61b admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:28.739110 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f8b03c75-1a19-492c-bc57-c80d2ef3e61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:28.749541 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-c1072219-f740-4aed-b9e6-328b864003c9 None None] MFA Rules not processed for user `4697b8e243244fb5864e28123b0d33b2`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:28.750986 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-c1072219-f740-4aed-b9e6-328b864003c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:28.820674 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b03c75-1a19-492c-bc57-c80d2ef3e61b admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:28.837767 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9eb8d4-2024-4ce6-9167-a0b515482c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:28.838687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9eb8d4-2024-4ce6-9167-a0b515482c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:28.839155 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9eb8d4-2024-4ce6-9167-a0b515482c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:28.839601 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9eb8d4-2024-4ce6-9167-a0b515482c45 admin admin] PATH_INFO: `/v3/users/1d61b6cefd2c4c50a1a79222bbc8ef22` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:28.841171 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9eb8d4-2024-4ce6-9167-a0b515482c45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d61b6cefd2c4c50a1a79222bbc8ef22)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:28.842581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1118/2243] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:28.848143 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9eb8d4-2024-4ce6-9167-a0b515482c45 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:28.873497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1072219-f740-4aed-b9e6-328b864003c9 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:28.876557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-c1072219-f740-4aed-b9e6-328b864003c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:28.949283 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:28.966494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-ed9eb8d4-2024-4ce6-9167-a0b515482c45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d61b6cefd2c4c50a1a79222bbc8ef22'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:28.968391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-ed9eb8d4-2024-4ce6-9167-a0b515482c45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d61b6cefd2c4c50a1a79222bbc8ef22'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:28.999067 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-ed9eb8d4-2024-4ce6-9167-a0b515482c45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d61b6cefd2c4c50a1a79222bbc8ef22'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:29.008636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1072219-f740-4aed-b9e6-328b864003c9 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:29.013946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-ed9eb8d4-2024-4ce6-9167-a0b515482c45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d61b6cefd2c4c50a1a79222bbc8ef22'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:29.018280 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60ad5c-af5f-46f8-9520-871cd2d3b41b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:29.019580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60ad5c-af5f-46f8-9520-871cd2d3b41b service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:29.020079 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60ad5c-af5f-46f8-9520-871cd2d3b41b service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:29.020752 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60ad5c-af5f-46f8-9520-871cd2d3b41b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:29.024738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-ed9eb8d4-2024-4ce6-9167-a0b515482c45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d61b6cefd2c4c50a1a79222bbc8ef22'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:29.031815 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1126/2244] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:46:28 2022] DELETE /identity/v3/users/1d61b6cefd2c4c50a1a79222bbc8ef22 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:46:29.034382 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60ad5c-af5f-46f8-9520-871cd2d3b41b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:29.036313 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdfcd3-6985-40ea-8eaa-51ba463e3b3d None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:29.036603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdfcd3-6985-40ea-8eaa-51ba463e3b3d None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:29.036883 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdfcd3-6985-40ea-8eaa-51ba463e3b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:29.038743 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60ad5c-af5f-46f8-9520-871cd2d3b41b service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:29.050748 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1119/2245] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:46:29.061759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-30cdfcd3-6985-40ea-8eaa-51ba463e3b3d None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:29.062998 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-30cdfcd3-6985-40ea-8eaa-51ba463e3b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:29.148951 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1127/2246] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:46:29.160017 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60ad5c-af5f-46f8-9520-871cd2d3b41b service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:29.162290 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-cd60ad5c-af5f-46f8-9520-871cd2d3b41b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:29.195467 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8411af-d960-46dd-a74e-80a49256956e None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:29.196174 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8411af-d960-46dd-a74e-80a49256956e None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:29.196174 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8411af-d960-46dd-a74e-80a49256956e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:29.237731 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-4e8411af-d960-46dd-a74e-80a49256956e None None] MFA Rules not processed for user `448c4e0626c7433b9ca21a13207cace4`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:29.242837 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-4e8411af-d960-46dd-a74e-80a49256956e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:29.299075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60ad5c-af5f-46f8-9520-871cd2d3b41b service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:29.346845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:29.390593 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1128/2247] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:46:29.425532 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71de0b3-b28b-434f-909c-fb819dea91c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:29.426391 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71de0b3-b28b-434f-909c-fb819dea91c0 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:29.426851 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71de0b3-b28b-434f-909c-fb819dea91c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:29.428643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71de0b3-b28b-434f-909c-fb819dea91c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:29.443678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71de0b3-b28b-434f-909c-fb819dea91c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:29.453855 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71de0b3-b28b-434f-909c-fb819dea91c0 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:29.476342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1120/2248] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:46:30.203315 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8411af-d960-46dd-a74e-80a49256956e None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:30.205031 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-4e8411af-d960-46dd-a74e-80a49256956e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:30.253177 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8411af-d960-46dd-a74e-80a49256956e None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:30.259523 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263fdd5-ff1b-45e7-93c8-faa45ebb704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:30.260289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263fdd5-ff1b-45e7-93c8-faa45ebb704a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:30.260659 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263fdd5-ff1b-45e7-93c8-faa45ebb704a admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:30.261148 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263fdd5-ff1b-45e7-93c8-faa45ebb704a admin admin] PATH_INFO: `/v3/projects/9f9ea99f6cbc463988ad90012e0b1513` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:30.262511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d263fdd5-ff1b-45e7-93c8-faa45ebb704a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f9ea99f6cbc463988ad90012e0b1513)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:30.265187 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d263fdd5-ff1b-45e7-93c8-faa45ebb704a admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:30.317853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-d263fdd5-ff1b-45e7-93c8-faa45ebb704a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f9ea99f6cbc463988ad90012e0b1513', 'request_id': 'req-d263fdd5-ff1b-45e7-93c8-faa45ebb704a'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:30.326954 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-d263fdd5-ff1b-45e7-93c8-faa45ebb704a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f9ea99f6cbc463988ad90012e0b1513', 'request_id': 'req-d263fdd5-ff1b-45e7-93c8-faa45ebb704a'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:30.328601 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:30.335853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-d263fdd5-ff1b-45e7-93c8-faa45ebb704a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f9ea99f6cbc463988ad90012e0b1513', 'request_id': 'req-d263fdd5-ff1b-45e7-93c8-faa45ebb704a'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:30.350639 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-d263fdd5-ff1b-45e7-93c8-faa45ebb704a admin admin] The token cache is being invalidate because project 9f9ea99f6cbc463988ad90012e0b1513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:46:30.350955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-d263fdd5-ff1b-45e7-93c8-faa45ebb704a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:30.351611 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-d263fdd5-ff1b-45e7-93c8-faa45ebb704a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:30.353377 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1129/2249] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:46:30 2022] DELETE /identity/v3/projects/9f9ea99f6cbc463988ad90012e0b1513 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:30.358164 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71de0b3-b28b-434f-909c-fb819dea91c0 service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:30.368791 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71de0b3-b28b-434f-909c-fb819dea91c0 service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:30.446157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce2ca1-4cf1-4da5-97f2-897900087665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:30.446805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce2ca1-4cf1-4da5-97f2-897900087665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:30.447086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce2ca1-4cf1-4da5-97f2-897900087665 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:30.447365 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce2ca1-4cf1-4da5-97f2-897900087665 admin admin] PATH_INFO: `/v3/users/53f8d7b2681647df8c7b151096f2f6f6` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:30.453041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce2ca1-4cf1-4da5-97f2-897900087665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53f8d7b2681647df8c7b151096f2f6f6)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:30.456074 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce2ca1-4cf1-4da5-97f2-897900087665 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:30.539900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cdce2ca1-4cf1-4da5-97f2-897900087665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53f8d7b2681647df8c7b151096f2f6f6'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:30.541502 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cdce2ca1-4cf1-4da5-97f2-897900087665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53f8d7b2681647df8c7b151096f2f6f6'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:30.542293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cdce2ca1-4cf1-4da5-97f2-897900087665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53f8d7b2681647df8c7b151096f2f6f6'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:30.566044 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cdce2ca1-4cf1-4da5-97f2-897900087665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53f8d7b2681647df8c7b151096f2f6f6'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:30.579063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cdce2ca1-4cf1-4da5-97f2-897900087665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53f8d7b2681647df8c7b151096f2f6f6'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:30.607903 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1121/2250] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:46:30 2022] DELETE /identity/v3/users/53f8d7b2681647df8c7b151096f2f6f6 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:31.226882 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263fdd5-ff1b-45e7-93c8-faa45ebb704a admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:31.229324 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-d263fdd5-ff1b-45e7-93c8-faa45ebb704a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:31.247800 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263fdd5-ff1b-45e7-93c8-faa45ebb704a admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:31.319336 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3d26f-1424-47f0-a75a-444f537b1ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:31.320299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3d26f-1424-47f0-a75a-444f537b1ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:31.320559 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3d26f-1424-47f0-a75a-444f537b1ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:31.320841 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3d26f-1424-47f0-a75a-444f537b1ae7 admin admin] PATH_INFO: `/v3/projects/dfa7601c7bc544ce844fc0f40fdaa376` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:31.322274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3d26f-1424-47f0-a75a-444f537b1ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfa7601c7bc544ce844fc0f40fdaa376)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:31.324217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3d26f-1424-47f0-a75a-444f537b1ae7 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:31.380975 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-89c3d26f-1424-47f0-a75a-444f537b1ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfa7601c7bc544ce844fc0f40fdaa376', 'request_id': 'req-89c3d26f-1424-47f0-a75a-444f537b1ae7'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:31.391478 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-89c3d26f-1424-47f0-a75a-444f537b1ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfa7601c7bc544ce844fc0f40fdaa376', 'request_id': 'req-89c3d26f-1424-47f0-a75a-444f537b1ae7'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:31.400465 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-89c3d26f-1424-47f0-a75a-444f537b1ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfa7601c7bc544ce844fc0f40fdaa376', 'request_id': 'req-89c3d26f-1424-47f0-a75a-444f537b1ae7'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:31.421862 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-89c3d26f-1424-47f0-a75a-444f537b1ae7 admin admin] The token cache is being invalidate because project dfa7601c7bc544ce844fc0f40fdaa376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:46:31.422209 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-89c3d26f-1424-47f0-a75a-444f537b1ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:31.423198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-89c3d26f-1424-47f0-a75a-444f537b1ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:31.424713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1130/2251] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:46:31 2022] DELETE /identity/v3/projects/dfa7601c7bc544ce844fc0f40fdaa376 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:31.428780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce2ca1-4cf1-4da5-97f2-897900087665 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:31.430231 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-cdce2ca1-4cf1-4da5-97f2-897900087665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:31.443750 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce2ca1-4cf1-4da5-97f2-897900087665 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:31.522013 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:31.553811 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578831e-52aa-4aa9-bb60-9282b9355095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:31.554541 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578831e-52aa-4aa9-bb60-9282b9355095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:31.555719 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578831e-52aa-4aa9-bb60-9282b9355095 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:31.558485 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578831e-52aa-4aa9-bb60-9282b9355095 admin admin] PATH_INFO: `/v3/users/f44147ea71334ac69dada6745ab2a679` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:31.560824 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578831e-52aa-4aa9-bb60-9282b9355095 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f44147ea71334ac69dada6745ab2a679)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:31.562714 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578831e-52aa-4aa9-bb60-9282b9355095 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:31.645947 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-9578831e-52aa-4aa9-bb60-9282b9355095 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f44147ea71334ac69dada6745ab2a679'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:31.646613 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-9578831e-52aa-4aa9-bb60-9282b9355095 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f44147ea71334ac69dada6745ab2a679'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:31.647360 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-9578831e-52aa-4aa9-bb60-9282b9355095 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f44147ea71334ac69dada6745ab2a679'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:31.660395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-9578831e-52aa-4aa9-bb60-9282b9355095 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f44147ea71334ac69dada6745ab2a679'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:31.667679 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-9578831e-52aa-4aa9-bb60-9282b9355095 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f44147ea71334ac69dada6745ab2a679'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:31.685696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1122/2252] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:46:31 2022] DELETE /identity/v3/users/f44147ea71334ac69dada6745ab2a679 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:32.007362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3d26f-1424-47f0-a75a-444f537b1ae7 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:32.009165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-89c3d26f-1424-47f0-a75a-444f537b1ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:32.031468 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3d26f-1424-47f0-a75a-444f537b1ae7 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:32.120631 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5a5a7-8c77-4908-8cdd-bdc9ebd14157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:32.122847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5a5a7-8c77-4908-8cdd-bdc9ebd14157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:32.123280 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5a5a7-8c77-4908-8cdd-bdc9ebd14157 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:32.123769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5a5a7-8c77-4908-8cdd-bdc9ebd14157 admin admin] PATH_INFO: `/v3/projects/e0a7fe42a08d4f1e81f4a25fdc56378b` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:32.125087 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5a5a7-8c77-4908-8cdd-bdc9ebd14157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0a7fe42a08d4f1e81f4a25fdc56378b)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:32.129429 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5a5a7-8c77-4908-8cdd-bdc9ebd14157 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:32.158924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:32.203516 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3ea5a5a7-8c77-4908-8cdd-bdc9ebd14157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0a7fe42a08d4f1e81f4a25fdc56378b', 'request_id': 'req-3ea5a5a7-8c77-4908-8cdd-bdc9ebd14157'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:32.212451 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3ea5a5a7-8c77-4908-8cdd-bdc9ebd14157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0a7fe42a08d4f1e81f4a25fdc56378b', 'request_id': 'req-3ea5a5a7-8c77-4908-8cdd-bdc9ebd14157'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:32.237515 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3ea5a5a7-8c77-4908-8cdd-bdc9ebd14157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0a7fe42a08d4f1e81f4a25fdc56378b', 'request_id': 'req-3ea5a5a7-8c77-4908-8cdd-bdc9ebd14157'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:32.254892 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3ea5a5a7-8c77-4908-8cdd-bdc9ebd14157 admin admin] The token cache is being invalidate because project e0a7fe42a08d4f1e81f4a25fdc56378b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:46:32.255187 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3ea5a5a7-8c77-4908-8cdd-bdc9ebd14157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:32.255880 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3ea5a5a7-8c77-4908-8cdd-bdc9ebd14157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:32.257790 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1131/2253] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:46:32 2022] DELETE /identity/v3/projects/e0a7fe42a08d4f1e81f4a25fdc56378b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:41.680140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=33,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:42.251577 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=17,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:49.733361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23fefd-9160-4ed6-aacf-836a1ff23b19 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:49.733872 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23fefd-9160-4ed6-aacf-836a1ff23b19 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:49.734052 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23fefd-9160-4ed6-aacf-836a1ff23b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:49.754554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-ff23fefd-9160-4ed6-aacf-836a1ff23b19 None None] MFA Rules not processed for user `3ae62427d5914e67b5b4d0237ecccd06`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:49.755822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ff23fefd-9160-4ed6-aacf-836a1ff23b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:49.815573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1123/2254] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 09:46:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:49.873849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5a5a7-8c77-4908-8cdd-bdc9ebd14157 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:49.873849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-3ea5a5a7-8c77-4908-8cdd-bdc9ebd14157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:49.946039 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5a5a7-8c77-4908-8cdd-bdc9ebd14157 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:49.953096 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cf546-5f20-41d1-8361-edb48539829f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2db35b94c84ec7bba96117d23baf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:49.953759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cf546-5f20-41d1-8361-edb48539829f service swift] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:49.954274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cf546-5f20-41d1-8361-edb48539829f service swift] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:49.954495 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cf546-5f20-41d1-8361-edb48539829f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:49.964120 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cf546-5f20-41d1-8361-edb48539829f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:49.965838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421cf546-5f20-41d1-8361-edb48539829f service swift] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:49.974646 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1132/2255] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 09:46:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:46:55.930055 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23fefd-9160-4ed6-aacf-836a1ff23b19 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:55.931907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ff23fefd-9160-4ed6-aacf-836a1ff23b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:56.023279 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23fefd-9160-4ed6-aacf-836a1ff23b19 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:56.029149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff268822-609b-440e-bf1d-1807f9d4778f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:56.030027 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff268822-609b-440e-bf1d-1807f9d4778f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:56.030480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff268822-609b-440e-bf1d-1807f9d4778f admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:56.030714 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff268822-609b-440e-bf1d-1807f9d4778f admin admin] PATH_INFO: `/v3/users/773aa069f2b944b0a2f4bfc9f630625c` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:56.032105 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff268822-609b-440e-bf1d-1807f9d4778f admin admin] RBAC: Authorizing `identity:delete_user(user_id=773aa069f2b944b0a2f4bfc9f630625c)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:56.034064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff268822-609b-440e-bf1d-1807f9d4778f admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:56.114131 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-ff268822-609b-440e-bf1d-1807f9d4778f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '773aa069f2b944b0a2f4bfc9f630625c'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:56.114830 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-ff268822-609b-440e-bf1d-1807f9d4778f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '773aa069f2b944b0a2f4bfc9f630625c'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:56.115504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-ff268822-609b-440e-bf1d-1807f9d4778f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '773aa069f2b944b0a2f4bfc9f630625c'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:56.134085 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-ff268822-609b-440e-bf1d-1807f9d4778f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '773aa069f2b944b0a2f4bfc9f630625c'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:56.149168 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-ff268822-609b-440e-bf1d-1807f9d4778f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '773aa069f2b944b0a2f4bfc9f630625c'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:56.179103 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1124/2256] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:46:55 2022] DELETE /identity/v3/users/773aa069f2b944b0a2f4bfc9f630625c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:56.183746 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4430e7-9887-4f2b-86a6-08aba0b7d81a None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:56.184480 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4430e7-9887-4f2b-86a6-08aba0b7d81a None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:56.184480 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4430e7-9887-4f2b-86a6-08aba0b7d81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:56.215211 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-fd4430e7-9887-4f2b-86a6-08aba0b7d81a None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:56.216724 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-fd4430e7-9887-4f2b-86a6-08aba0b7d81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:56.312746 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1133/2257] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:56.327963 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff268822-609b-440e-bf1d-1807f9d4778f admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:56.329575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ff268822-609b-440e-bf1d-1807f9d4778f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:56.359813 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:56.395930 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff268822-609b-440e-bf1d-1807f9d4778f admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:56.399461 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3c862-3da0-429d-aa3b-0acf4c049994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:56.400068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3c862-3da0-429d-aa3b-0acf4c049994 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:56.400517 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3c862-3da0-429d-aa3b-0acf4c049994 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:56.400633 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3c862-3da0-429d-aa3b-0acf4c049994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:56.412754 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3c862-3da0-429d-aa3b-0acf4c049994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:56.414956 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3c862-3da0-429d-aa3b-0acf4c049994 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:56.427927 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1125/2258] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:46:56.755331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4430e7-9887-4f2b-86a6-08aba0b7d81a None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:56.757151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-fd4430e7-9887-4f2b-86a6-08aba0b7d81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:56.772134 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4430e7-9887-4f2b-86a6-08aba0b7d81a None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:56.781624 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a85dc3-0e5d-4771-9c09-d430ce696dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:56.783142 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a85dc3-0e5d-4771-9c09-d430ce696dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:56.784276 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a85dc3-0e5d-4771-9c09-d430ce696dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:56.785055 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a85dc3-0e5d-4771-9c09-d430ce696dd3 admin admin] PATH_INFO: `/v3/projects/22802a45150d47bcaa21fbf33b0f07a5` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:56.792166 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a85dc3-0e5d-4771-9c09-d430ce696dd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22802a45150d47bcaa21fbf33b0f07a5)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:56.794568 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a85dc3-0e5d-4771-9c09-d430ce696dd3 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:56.891099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-73a85dc3-0e5d-4771-9c09-d430ce696dd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22802a45150d47bcaa21fbf33b0f07a5', 'request_id': 'req-73a85dc3-0e5d-4771-9c09-d430ce696dd3'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:56.900196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-73a85dc3-0e5d-4771-9c09-d430ce696dd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22802a45150d47bcaa21fbf33b0f07a5', 'request_id': 'req-73a85dc3-0e5d-4771-9c09-d430ce696dd3'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:56.908300 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-73a85dc3-0e5d-4771-9c09-d430ce696dd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22802a45150d47bcaa21fbf33b0f07a5', 'request_id': 'req-73a85dc3-0e5d-4771-9c09-d430ce696dd3'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:56.923866 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-73a85dc3-0e5d-4771-9c09-d430ce696dd3 admin admin] The token cache is being invalidate because project 22802a45150d47bcaa21fbf33b0f07a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:46:56.924705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-73a85dc3-0e5d-4771-9c09-d430ce696dd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:56.925383 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-73a85dc3-0e5d-4771-9c09-d430ce696dd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:56.926918 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1134/2259] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:46:56 2022] DELETE /identity/v3/projects/22802a45150d47bcaa21fbf33b0f07a5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:46:56.931070 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3c862-3da0-429d-aa3b-0acf4c049994 service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:56.943970 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3c862-3da0-429d-aa3b-0acf4c049994 service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:57.014147 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158090e-6592-458c-978d-69f6a109dfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:57.014898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158090e-6592-458c-978d-69f6a109dfed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:57.015184 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158090e-6592-458c-978d-69f6a109dfed admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:57.015557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158090e-6592-458c-978d-69f6a109dfed admin admin] PATH_INFO: `/v3/users/7f4ff6d3e1524e2db4a59d50596236bb` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:57.016879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158090e-6592-458c-978d-69f6a109dfed admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f4ff6d3e1524e2db4a59d50596236bb)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:57.019323 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158090e-6592-458c-978d-69f6a109dfed admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:57.079674 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f158090e-6592-458c-978d-69f6a109dfed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f4ff6d3e1524e2db4a59d50596236bb'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:57.080458 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f158090e-6592-458c-978d-69f6a109dfed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f4ff6d3e1524e2db4a59d50596236bb'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:57.081088 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f158090e-6592-458c-978d-69f6a109dfed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f4ff6d3e1524e2db4a59d50596236bb'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:57.095689 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f158090e-6592-458c-978d-69f6a109dfed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f4ff6d3e1524e2db4a59d50596236bb'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:57.104759 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f158090e-6592-458c-978d-69f6a109dfed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f4ff6d3e1524e2db4a59d50596236bb'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:57.122418 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1126/2260] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:46:56 2022] DELETE /identity/v3/users/7f4ff6d3e1524e2db4a59d50596236bb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:46:57.475405 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a85dc3-0e5d-4771-9c09-d430ce696dd3 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:57.477074 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-73a85dc3-0e5d-4771-9c09-d430ce696dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:57.494059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a85dc3-0e5d-4771-9c09-d430ce696dd3 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:57.513392 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:57.575535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66feaa-589e-40c5-a862-e6faafe538e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:57.576213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66feaa-589e-40c5-a862-e6faafe538e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:57.576497 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66feaa-589e-40c5-a862-e6faafe538e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:57.576771 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66feaa-589e-40c5-a862-e6faafe538e2 admin admin] PATH_INFO: `/v3/projects/fb3d0ebcca0846bca37570d86f142e01` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:57.577934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66feaa-589e-40c5-a862-e6faafe538e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb3d0ebcca0846bca37570d86f142e01)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:57.579890 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66feaa-589e-40c5-a862-e6faafe538e2 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:57.640169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-8e66feaa-589e-40c5-a862-e6faafe538e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb3d0ebcca0846bca37570d86f142e01', 'request_id': 'req-8e66feaa-589e-40c5-a862-e6faafe538e2'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:57.650681 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-8e66feaa-589e-40c5-a862-e6faafe538e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb3d0ebcca0846bca37570d86f142e01', 'request_id': 'req-8e66feaa-589e-40c5-a862-e6faafe538e2'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:57.659371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-8e66feaa-589e-40c5-a862-e6faafe538e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb3d0ebcca0846bca37570d86f142e01', 'request_id': 'req-8e66feaa-589e-40c5-a862-e6faafe538e2'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:57.671859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-8e66feaa-589e-40c5-a862-e6faafe538e2 admin admin] The token cache is being invalidate because project fb3d0ebcca0846bca37570d86f142e01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:46:57.672150 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-8e66feaa-589e-40c5-a862-e6faafe538e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:57.672825 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-8e66feaa-589e-40c5-a862-e6faafe538e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:57.674427 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1135/2261] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:46:57 2022] DELETE /identity/v3/projects/fb3d0ebcca0846bca37570d86f142e01 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:57.679801 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d1dd9-c8f6-4644-b62b-a5f4868a9f46 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:57.679963 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d1dd9-c8f6-4644-b62b-a5f4868a9f46 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:57.680147 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d1dd9-c8f6-4644-b62b-a5f4868a9f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:57.705257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-206d1dd9-c8f6-4644-b62b-a5f4868a9f46 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:57.706509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-206d1dd9-c8f6-4644-b62b-a5f4868a9f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:57.769501 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:57.805514 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1127/2262] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:46:57.811252 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32505c82-b0ec-48d8-9387-f8dd1a992c57 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:57.811535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32505c82-b0ec-48d8-9387-f8dd1a992c57 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:57.811811 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32505c82-b0ec-48d8-9387-f8dd1a992c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:57.838101 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-32505c82-b0ec-48d8-9387-f8dd1a992c57 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:57.840866 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-32505c82-b0ec-48d8-9387-f8dd1a992c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:57.854583 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1136/2263] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:57.859312 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d1dd9-c8f6-4644-b62b-a5f4868a9f46 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:57.870024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d1dd9-c8f6-4644-b62b-a5f4868a9f46 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:57.875240 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf1447-07b7-4a7f-9fdb-698da45f7eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:57.875861 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf1447-07b7-4a7f-9fdb-698da45f7eae admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:57.876263 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf1447-07b7-4a7f-9fdb-698da45f7eae admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:57.876556 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf1447-07b7-4a7f-9fdb-698da45f7eae admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:57.877227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf1447-07b7-4a7f-9fdb-698da45f7eae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:46:57.877570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf1447-07b7-4a7f-9fdb-698da45f7eae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:57.879203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf1447-07b7-4a7f-9fdb-698da45f7eae admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:57.897415 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1128/2264] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:46:57.898479 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32505c82-b0ec-48d8-9387-f8dd1a992c57 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:57.909418 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32505c82-b0ec-48d8-9387-f8dd1a992c57 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:57.916486 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174e1d8-f04b-4b7a-95dc-7f1a2be54c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:57.917112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174e1d8-f04b-4b7a-95dc-7f1a2be54c00 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:57.917396 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174e1d8-f04b-4b7a-95dc-7f1a2be54c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:57.917760 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174e1d8-f04b-4b7a-95dc-7f1a2be54c00 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:57.918411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174e1d8-f04b-4b7a-95dc-7f1a2be54c00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:57.920547 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174e1d8-f04b-4b7a-95dc-7f1a2be54c00 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:57.972619 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1137/2265] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:46:57 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:46:57.976568 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf1447-07b7-4a7f-9fdb-698da45f7eae admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:57.988815 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf1447-07b7-4a7f-9fdb-698da45f7eae admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:58.052937 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bd23e-d37f-4e2a-82e4-a1163d56bde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:58.053588 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bd23e-d37f-4e2a-82e4-a1163d56bde6 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:58.053878 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bd23e-d37f-4e2a-82e4-a1163d56bde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:58.054152 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bd23e-d37f-4e2a-82e4-a1163d56bde6 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:58.054780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0bd23e-d37f-4e2a-82e4-a1163d56bde6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:58.056704 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0bd23e-d37f-4e2a-82e4-a1163d56bde6 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:58.080860 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1129/2266] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:46:57 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:58.084953 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174e1d8-f04b-4b7a-95dc-7f1a2be54c00 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:58.096368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174e1d8-f04b-4b7a-95dc-7f1a2be54c00 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:58.101672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14f7e1-7cf8-42ac-96d9-3b3d912028e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:58.102274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14f7e1-7cf8-42ac-96d9-3b3d912028e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:58.102554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14f7e1-7cf8-42ac-96d9-3b3d912028e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:58.102832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14f7e1-7cf8-42ac-96d9-3b3d912028e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:58.103478 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14f7e1-7cf8-42ac-96d9-3b3d912028e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:58.105169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14f7e1-7cf8-42ac-96d9-3b3d912028e5 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:58.116071 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1138/2267] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:58.120124 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bd23e-d37f-4e2a-82e4-a1163d56bde6 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:58.131156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bd23e-d37f-4e2a-82e4-a1163d56bde6 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:58.136991 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a374f3-a5b8-4472-9cb5-68749a5ef3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:58.138067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a374f3-a5b8-4472-9cb5-68749a5ef3ab admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:58.138342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a374f3-a5b8-4472-9cb5-68749a5ef3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:58.138619 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a374f3-a5b8-4472-9cb5-68749a5ef3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:58.139271 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a374f3-a5b8-4472-9cb5-68749a5ef3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:58.140858 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a374f3-a5b8-4472-9cb5-68749a5ef3ab admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:58.153723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1130/2268] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:58.158042 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14f7e1-7cf8-42ac-96d9-3b3d912028e5 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:58.169926 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14f7e1-7cf8-42ac-96d9-3b3d912028e5 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:58.174953 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf521560-a933-4eac-8d9d-84843c6b37f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:58.175698 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf521560-a933-4eac-8d9d-84843c6b37f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:58.176174 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf521560-a933-4eac-8d9d-84843c6b37f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:58.176363 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf521560-a933-4eac-8d9d-84843c6b37f4 admin admin] PATH_INFO: `/v3/projects/1f7ad3547cbf455f8feed70f8df9ab6a/users/4e7dc6bb32b0409198a076b446fa82ba/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:58.195535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf521560-a933-4eac-8d9d-84843c6b37f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f7ad3547cbf455f8feed70f8df9ab6a, user_id=4e7dc6bb32b0409198a076b446fa82ba, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:58.198393 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf521560-a933-4eac-8d9d-84843c6b37f4 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:58.214650 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1139/2269] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:46:58 2022] PUT /identity/v3/projects/1f7ad3547cbf455f8feed70f8df9ab6a/users/4e7dc6bb32b0409198a076b446fa82ba/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:58.227706 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347a9ef-d276-4ebd-b1ad-0b604310b5ca None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:58.227972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347a9ef-d276-4ebd-b1ad-0b604310b5ca None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:58.228293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347a9ef-d276-4ebd-b1ad-0b604310b5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:58.259036 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-6347a9ef-d276-4ebd-b1ad-0b604310b5ca None None] MFA Rules not processed for user `4e7dc6bb32b0409198a076b446fa82ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:58.262355 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-6347a9ef-d276-4ebd-b1ad-0b604310b5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:58.346666 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1131/2270] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:58.351189 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf521560-a933-4eac-8d9d-84843c6b37f4 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:58.404905 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:58.429712 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf521560-a933-4eac-8d9d-84843c6b37f4 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:58.435444 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc6e88-55a9-41fd-a164-b918be05a309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:58.436266 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc6e88-55a9-41fd-a164-b918be05a309 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:58.436544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc6e88-55a9-41fd-a164-b918be05a309 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:58.436816 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc6e88-55a9-41fd-a164-b918be05a309 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:58.437481 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc6e88-55a9-41fd-a164-b918be05a309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:58.439385 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc6e88-55a9-41fd-a164-b918be05a309 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:58.472218 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1140/2271] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:46:58 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:58.476900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347a9ef-d276-4ebd-b1ad-0b604310b5ca None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:58.494527 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347a9ef-d276-4ebd-b1ad-0b604310b5ca None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:58.552099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:58.577639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59ace0-e9eb-4f72-9b22-fdc8a28d1c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:58.578383 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59ace0-e9eb-4f72-9b22-fdc8a28d1c0d admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:58.582854 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59ace0-e9eb-4f72-9b22-fdc8a28d1c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:58.583252 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59ace0-e9eb-4f72-9b22-fdc8a28d1c0d admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:58.584008 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59ace0-e9eb-4f72-9b22-fdc8a28d1c0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:58.586115 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59ace0-e9eb-4f72-9b22-fdc8a28d1c0d admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:58.614999 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1132/2272] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:46:58 2022] POST /identity/v3/users => generated 300 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:46:58.620308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc6e88-55a9-41fd-a164-b918be05a309 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:58.634883 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc6e88-55a9-41fd-a164-b918be05a309 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:58.649238 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c36ec-3e8a-484a-a743-9a917124849b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:58.649928 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c36ec-3e8a-484a-a743-9a917124849b admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:58.650882 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c36ec-3e8a-484a-a743-9a917124849b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:58.651171 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c36ec-3e8a-484a-a743-9a917124849b admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:58.652466 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c36ec-3e8a-484a-a743-9a917124849b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:58.654999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c36ec-3e8a-484a-a743-9a917124849b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:58.672419 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1141/2273] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:58.673576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59ace0-e9eb-4f72-9b22-fdc8a28d1c0d admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:58.700213 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59ace0-e9eb-4f72-9b22-fdc8a28d1c0d admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:58.705282 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6a090-a778-4bc2-8f54-ca6bbb327a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:58.705805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6a090-a778-4bc2-8f54-ca6bbb327a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:58.706059 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6a090-a778-4bc2-8f54-ca6bbb327a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:58.706337 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6a090-a778-4bc2-8f54-ca6bbb327a58 admin admin] PATH_INFO: `/v3/projects/0e59849adbbb496a9c00f9ff603ca9c7/users/04ada1c8908f44af89104693f82cc738/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:58.723402 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6a090-a778-4bc2-8f54-ca6bbb327a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e59849adbbb496a9c00f9ff603ca9c7, user_id=04ada1c8908f44af89104693f82cc738, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:58.726098 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6a090-a778-4bc2-8f54-ca6bbb327a58 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:58.741836 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1133/2274] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:46:58 2022] PUT /identity/v3/projects/0e59849adbbb496a9c00f9ff603ca9c7/users/04ada1c8908f44af89104693f82cc738/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:46:58.745581 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c36ec-3e8a-484a-a743-9a917124849b admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:58.757946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c36ec-3e8a-484a-a743-9a917124849b admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:58.847272 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b49cc2-2e87-41cf-ab3f-f282eaf49553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:58.847991 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b49cc2-2e87-41cf-ab3f-f282eaf49553 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:58.848338 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b49cc2-2e87-41cf-ab3f-f282eaf49553 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:58.848681 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b49cc2-2e87-41cf-ab3f-f282eaf49553 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:58.849402 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b49cc2-2e87-41cf-ab3f-f282eaf49553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:58.851143 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b49cc2-2e87-41cf-ab3f-f282eaf49553 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:58.862320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1142/2275] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:46:58.867945 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6a090-a778-4bc2-8f54-ca6bbb327a58 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:58.884679 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6a090-a778-4bc2-8f54-ca6bbb327a58 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:58.891058 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00cfe6-53b1-4784-a01d-4c418ec7a78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:58.891729 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00cfe6-53b1-4784-a01d-4c418ec7a78b admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:58.892009 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00cfe6-53b1-4784-a01d-4c418ec7a78b admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:58.892288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00cfe6-53b1-4784-a01d-4c418ec7a78b admin admin] PATH_INFO: `/v3/projects/0e59849adbbb496a9c00f9ff603ca9c7/users/04ada1c8908f44af89104693f82cc738/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:58.894296 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00cfe6-53b1-4784-a01d-4c418ec7a78b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e59849adbbb496a9c00f9ff603ca9c7, user_id=04ada1c8908f44af89104693f82cc738, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:58.896913 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00cfe6-53b1-4784-a01d-4c418ec7a78b admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:58.908280 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1134/2276] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:46:58 2022] PUT /identity/v3/projects/0e59849adbbb496a9c00f9ff603ca9c7/users/04ada1c8908f44af89104693f82cc738/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:58.919681 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214fecb-0fc4-4670-a2e9-40623f85c409 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:58.920107 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214fecb-0fc4-4670-a2e9-40623f85c409 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:58.920392 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214fecb-0fc4-4670-a2e9-40623f85c409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:58.955592 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-7214fecb-0fc4-4670-a2e9-40623f85c409 None None] MFA Rules not processed for user `04ada1c8908f44af89104693f82cc738`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:58.956829 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-7214fecb-0fc4-4670-a2e9-40623f85c409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:59.038545 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1143/2277] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:58 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:46:59.050811 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00cfe6-53b1-4784-a01d-4c418ec7a78b admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:59.052789 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7e00cfe6-53b1-4784-a01d-4c418ec7a78b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:59.122558 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00cfe6-53b1-4784-a01d-4c418ec7a78b admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:59.126448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e2233-a80b-4826-a851-0a76b3a0fadb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:59.127059 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e2233-a80b-4826-a851-0a76b3a0fadb service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:59.127339 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e2233-a80b-4826-a851-0a76b3a0fadb service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:59.127613 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e2233-a80b-4826-a851-0a76b3a0fadb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:59.140406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e2233-a80b-4826-a851-0a76b3a0fadb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:59.141885 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e2233-a80b-4826-a851-0a76b3a0fadb service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:59.154972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1135/2278] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:46:59.231829 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214fecb-0fc4-4670-a2e9-40623f85c409 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:59.281073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:59.309969 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214fecb-0fc4-4670-a2e9-40623f85c409 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:59.314679 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e63f0-5881-444f-90aa-5f5f03cea192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:59.315328 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e63f0-5881-444f-90aa-5f5f03cea192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:59.315602 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e63f0-5881-444f-90aa-5f5f03cea192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:59.315878 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e63f0-5881-444f-90aa-5f5f03cea192 admin admin] PATH_INFO: `/v3/users/4e7dc6bb32b0409198a076b446fa82ba` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:59.317034 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e63f0-5881-444f-90aa-5f5f03cea192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e7dc6bb32b0409198a076b446fa82ba)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:59.318979 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e63f0-5881-444f-90aa-5f5f03cea192 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:59.380551 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-224e63f0-5881-444f-90aa-5f5f03cea192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e7dc6bb32b0409198a076b446fa82ba'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:59.381752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-224e63f0-5881-444f-90aa-5f5f03cea192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e7dc6bb32b0409198a076b446fa82ba'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:59.403872 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-224e63f0-5881-444f-90aa-5f5f03cea192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e7dc6bb32b0409198a076b446fa82ba'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:59.414187 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-224e63f0-5881-444f-90aa-5f5f03cea192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e7dc6bb32b0409198a076b446fa82ba'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:59.422861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-224e63f0-5881-444f-90aa-5f5f03cea192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e7dc6bb32b0409198a076b446fa82ba'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:46:59.430688 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1144/2279] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:46:59 2022] DELETE /identity/v3/users/4e7dc6bb32b0409198a076b446fa82ba => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:46:59.436014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6e090-af8f-4ce6-b4f2-632ab2ccba0d None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:59.436319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6e090-af8f-4ce6-b4f2-632ab2ccba0d None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:59.436908 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6e090-af8f-4ce6-b4f2-632ab2ccba0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:59.457391 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-46e6e090-af8f-4ce6-b4f2-632ab2ccba0d None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:46:59.458752 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-46e6e090-af8f-4ce6-b4f2-632ab2ccba0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:59.531331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1136/2280] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:46:59.541486 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e63f0-5881-444f-90aa-5f5f03cea192 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:46:59.543584 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-224e63f0-5881-444f-90aa-5f5f03cea192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:46:59.611535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e63f0-5881-444f-90aa-5f5f03cea192 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:46:59.615744 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378ce23-c2ac-477c-bac3-29eb3848aa0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:46:59.616352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378ce23-c2ac-477c-bac3-29eb3848aa0a service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:46:59.616639 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378ce23-c2ac-477c-bac3-29eb3848aa0a service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:46:59.616916 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378ce23-c2ac-477c-bac3-29eb3848aa0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:46:59.627768 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378ce23-c2ac-477c-bac3-29eb3848aa0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:46:59.629910 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378ce23-c2ac-477c-bac3-29eb3848aa0a service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:46:59.642170 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1145/2281] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:46:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:47:00.098506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6e090-af8f-4ce6-b4f2-632ab2ccba0d None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:00.099976 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-46e6e090-af8f-4ce6-b4f2-632ab2ccba0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:00.113331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6e090-af8f-4ce6-b4f2-632ab2ccba0d None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:00.118784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed28e4e-cdac-4dc0-a53a-b0fed15cce77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:00.119712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed28e4e-cdac-4dc0-a53a-b0fed15cce77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:00.120081 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed28e4e-cdac-4dc0-a53a-b0fed15cce77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:00.120439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed28e4e-cdac-4dc0-a53a-b0fed15cce77 admin admin] PATH_INFO: `/v3/projects/1f7ad3547cbf455f8feed70f8df9ab6a` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:00.125781 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed28e4e-cdac-4dc0-a53a-b0fed15cce77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f7ad3547cbf455f8feed70f8df9ab6a)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:00.128082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed28e4e-cdac-4dc0-a53a-b0fed15cce77 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:00.174100 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:00.189386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2ed28e4e-cdac-4dc0-a53a-b0fed15cce77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f7ad3547cbf455f8feed70f8df9ab6a', 'request_id': 'req-2ed28e4e-cdac-4dc0-a53a-b0fed15cce77'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:00.201294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2ed28e4e-cdac-4dc0-a53a-b0fed15cce77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f7ad3547cbf455f8feed70f8df9ab6a', 'request_id': 'req-2ed28e4e-cdac-4dc0-a53a-b0fed15cce77'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:00.212816 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2ed28e4e-cdac-4dc0-a53a-b0fed15cce77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f7ad3547cbf455f8feed70f8df9ab6a', 'request_id': 'req-2ed28e4e-cdac-4dc0-a53a-b0fed15cce77'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:00.233602 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2ed28e4e-cdac-4dc0-a53a-b0fed15cce77 admin admin] The token cache is being invalidate because project 1f7ad3547cbf455f8feed70f8df9ab6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:47:00.233975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2ed28e4e-cdac-4dc0-a53a-b0fed15cce77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:00.234702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2ed28e4e-cdac-4dc0-a53a-b0fed15cce77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:00.241518 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1137/2282] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:47:00 2022] DELETE /identity/v3/projects/1f7ad3547cbf455f8feed70f8df9ab6a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:00.246913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378ce23-c2ac-477c-bac3-29eb3848aa0a service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:00.261059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378ce23-c2ac-477c-bac3-29eb3848aa0a service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:00.329208 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:00.340262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245097d-697c-4cef-a719-ffd90f82d2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:00.340910 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245097d-697c-4cef-a719-ffd90f82d2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:00.341191 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245097d-697c-4cef-a719-ffd90f82d2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:00.341489 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245097d-697c-4cef-a719-ffd90f82d2e4 admin admin] PATH_INFO: `/v3/users/04ada1c8908f44af89104693f82cc738` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:00.345072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245097d-697c-4cef-a719-ffd90f82d2e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04ada1c8908f44af89104693f82cc738)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:00.349662 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245097d-697c-4cef-a719-ffd90f82d2e4 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:00.416443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3245097d-697c-4cef-a719-ffd90f82d2e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04ada1c8908f44af89104693f82cc738'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:00.418013 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3245097d-697c-4cef-a719-ffd90f82d2e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04ada1c8908f44af89104693f82cc738'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:00.439277 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3245097d-697c-4cef-a719-ffd90f82d2e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04ada1c8908f44af89104693f82cc738'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:00.453194 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3245097d-697c-4cef-a719-ffd90f82d2e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04ada1c8908f44af89104693f82cc738'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:00.465977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3245097d-697c-4cef-a719-ffd90f82d2e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04ada1c8908f44af89104693f82cc738'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:00.481318 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1146/2283] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:47:00 2022] DELETE /identity/v3/users/04ada1c8908f44af89104693f82cc738 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:00.803034 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed28e4e-cdac-4dc0-a53a-b0fed15cce77 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:00.804702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-2ed28e4e-cdac-4dc0-a53a-b0fed15cce77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:00.826779 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed28e4e-cdac-4dc0-a53a-b0fed15cce77 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:00.900903 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13428e4-47c2-4c93-a89a-642e57f4209f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:00.901631 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13428e4-47c2-4c93-a89a-642e57f4209f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:00.902658 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13428e4-47c2-4c93-a89a-642e57f4209f admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:00.902939 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13428e4-47c2-4c93-a89a-642e57f4209f admin admin] PATH_INFO: `/v3/projects/0e59849adbbb496a9c00f9ff603ca9c7` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:00.904291 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13428e4-47c2-4c93-a89a-642e57f4209f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e59849adbbb496a9c00f9ff603ca9c7)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:00.906804 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13428e4-47c2-4c93-a89a-642e57f4209f admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:00.968239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-e13428e4-47c2-4c93-a89a-642e57f4209f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e59849adbbb496a9c00f9ff603ca9c7', 'request_id': 'req-e13428e4-47c2-4c93-a89a-642e57f4209f'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:00.989486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-e13428e4-47c2-4c93-a89a-642e57f4209f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e59849adbbb496a9c00f9ff603ca9c7', 'request_id': 'req-e13428e4-47c2-4c93-a89a-642e57f4209f'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:00.997354 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-e13428e4-47c2-4c93-a89a-642e57f4209f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e59849adbbb496a9c00f9ff603ca9c7', 'request_id': 'req-e13428e4-47c2-4c93-a89a-642e57f4209f'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:01.009533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-e13428e4-47c2-4c93-a89a-642e57f4209f admin admin] The token cache is being invalidate because project 0e59849adbbb496a9c00f9ff603ca9c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:47:01.009935 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-e13428e4-47c2-4c93-a89a-642e57f4209f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:01.010607 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-e13428e4-47c2-4c93-a89a-642e57f4209f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:01.012815 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1138/2284] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:47:00 2022] DELETE /identity/v3/projects/0e59849adbbb496a9c00f9ff603ca9c7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:47:01.017965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53dc1-0538-418e-bde2-da5f1a348303 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:01.018510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53dc1-0538-418e-bde2-da5f1a348303 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:01.018510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53dc1-0538-418e-bde2-da5f1a348303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:01.056717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-1cf53dc1-0538-418e-bde2-da5f1a348303 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:01.059106 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-1cf53dc1-0538-418e-bde2-da5f1a348303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:01.144123 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1147/2285] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:47:01.154678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758cec8-45b3-46f7-b3b2-65bb6f0522cf None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:01.155243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758cec8-45b3-46f7-b3b2-65bb6f0522cf None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:01.155335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758cec8-45b3-46f7-b3b2-65bb6f0522cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:01.185436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-c758cec8-45b3-46f7-b3b2-65bb6f0522cf None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:01.186669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-c758cec8-45b3-46f7-b3b2-65bb6f0522cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:01.196253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1139/2286] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:01.202051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf53dc1-0538-418e-bde2-da5f1a348303 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:01.217347 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf53dc1-0538-418e-bde2-da5f1a348303 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:01.226348 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5adf6-f1cb-4ff9-8e7b-3c9840b8ac92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:01.226984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5adf6-f1cb-4ff9-8e7b-3c9840b8ac92 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:01.227338 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5adf6-f1cb-4ff9-8e7b-3c9840b8ac92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:01.227705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5adf6-f1cb-4ff9-8e7b-3c9840b8ac92 admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:01.228413 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5adf6-f1cb-4ff9-8e7b-3c9840b8ac92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:01.228789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5adf6-f1cb-4ff9-8e7b-3c9840b8ac92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:01.231221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5adf6-f1cb-4ff9-8e7b-3c9840b8ac92 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:01.247843 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1148/2287] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:01.252279 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758cec8-45b3-46f7-b3b2-65bb6f0522cf None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:01.263173 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758cec8-45b3-46f7-b3b2-65bb6f0522cf None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:01.268011 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95955c72-bb6f-442f-a8e9-708d0f662715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:01.268619 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95955c72-bb6f-442f-a8e9-708d0f662715 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:01.268897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95955c72-bb6f-442f-a8e9-708d0f662715 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:01.269174 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95955c72-bb6f-442f-a8e9-708d0f662715 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:01.269852 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95955c72-bb6f-442f-a8e9-708d0f662715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:01.271890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95955c72-bb6f-442f-a8e9-708d0f662715 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:01.305681 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1140/2288] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:47:01 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:47:01.310532 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5adf6-f1cb-4ff9-8e7b-3c9840b8ac92 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:01.325175 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5adf6-f1cb-4ff9-8e7b-3c9840b8ac92 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:01.395336 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d8abc-5938-4156-bd1b-df4a004e1219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:01.395947 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d8abc-5938-4156-bd1b-df4a004e1219 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:01.396229 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d8abc-5938-4156-bd1b-df4a004e1219 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:01.396501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d8abc-5938-4156-bd1b-df4a004e1219 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:01.397134 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d8abc-5938-4156-bd1b-df4a004e1219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:01.399087 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d8abc-5938-4156-bd1b-df4a004e1219 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:01.408957 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:01.420899 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1149/2289] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:47:01 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:01.425057 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95955c72-bb6f-442f-a8e9-708d0f662715 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:01.436447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95955c72-bb6f-442f-a8e9-708d0f662715 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:01.441086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda8187-2819-4314-8789-00607ec5b8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:01.441756 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda8187-2819-4314-8789-00607ec5b8ae admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:01.442038 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda8187-2819-4314-8789-00607ec5b8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:01.442313 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda8187-2819-4314-8789-00607ec5b8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:01.442959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda8187-2819-4314-8789-00607ec5b8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:01.444551 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda8187-2819-4314-8789-00607ec5b8ae admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:01.455200 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1141/2290] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:47:01.459254 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d8abc-5938-4156-bd1b-df4a004e1219 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:01.470221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d8abc-5938-4156-bd1b-df4a004e1219 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:01.476771 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b97b59-b92b-4964-b07a-58823d70590f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:01.476963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b97b59-b92b-4964-b07a-58823d70590f admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:01.477200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b97b59-b92b-4964-b07a-58823d70590f admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:01.477495 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b97b59-b92b-4964-b07a-58823d70590f admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:01.478159 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b97b59-b92b-4964-b07a-58823d70590f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:01.479733 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b97b59-b92b-4964-b07a-58823d70590f admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:01.491750 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1150/2291] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:47:01.496527 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda8187-2819-4314-8789-00607ec5b8ae admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:01.507281 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda8187-2819-4314-8789-00607ec5b8ae admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:01.512693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca8d91-011c-4991-a5e6-13f04d172cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:01.513360 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca8d91-011c-4991-a5e6-13f04d172cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:01.513684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca8d91-011c-4991-a5e6-13f04d172cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:01.513966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca8d91-011c-4991-a5e6-13f04d172cb8 admin admin] PATH_INFO: `/v3/projects/f23d682773924267850150a31c961c0b/users/c117a7bc4b62471c9bd2321a2bc01d79/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:01.522642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:01.531331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca8d91-011c-4991-a5e6-13f04d172cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f23d682773924267850150a31c961c0b, user_id=c117a7bc4b62471c9bd2321a2bc01d79, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:01.534221 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca8d91-011c-4991-a5e6-13f04d172cb8 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:01.549326 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1142/2292] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:47:01 2022] PUT /identity/v3/projects/f23d682773924267850150a31c961c0b/users/c117a7bc4b62471c9bd2321a2bc01d79/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:01.554884 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f4c6c-ce4b-4875-a31c-9a76705e83d3 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:01.555170 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f4c6c-ce4b-4875-a31c-9a76705e83d3 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:01.555442 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f4c6c-ce4b-4875-a31c-9a76705e83d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:01.574861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-3c2f4c6c-ce4b-4875-a31c-9a76705e83d3 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:01.576090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-3c2f4c6c-ce4b-4875-a31c-9a76705e83d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:01.640578 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1151/2293] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:01.650269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca8d91-011c-4991-a5e6-13f04d172cb8 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:01.652504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b7ca8d91-011c-4991-a5e6-13f04d172cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:01.715946 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca8d91-011c-4991-a5e6-13f04d172cb8 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:01.719504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898f678-6bc2-474c-9611-9c9ccee1a3e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:01.720366 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898f678-6bc2-474c-9611-9c9ccee1a3e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:01.720648 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898f678-6bc2-474c-9611-9c9ccee1a3e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:01.720923 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898f678-6bc2-474c-9611-9c9ccee1a3e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:01.729813 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898f678-6bc2-474c-9611-9c9ccee1a3e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:01.731810 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898f678-6bc2-474c-9611-9c9ccee1a3e8 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:01.741114 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1143/2294] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:47:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:47:02.511324 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba5ef7-35d0-49f7-974a-db3b38293840 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:02.511875 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba5ef7-35d0-49f7-974a-db3b38293840 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:02.512266 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba5ef7-35d0-49f7-974a-db3b38293840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:02.548142 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-36ba5ef7-35d0-49f7-974a-db3b38293840 None None] MFA Rules not processed for user `c117a7bc4b62471c9bd2321a2bc01d79`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:02.549977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-36ba5ef7-35d0-49f7-974a-db3b38293840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:02.663274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1152/2295] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:47:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:02.667998 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898f678-6bc2-474c-9611-9c9ccee1a3e8 service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:02.678366 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898f678-6bc2-474c-9611-9c9ccee1a3e8 service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:02.683228 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d86254-8466-41cd-bcdc-a0e5b60d0081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:02.683840 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d86254-8466-41cd-bcdc-a0e5b60d0081 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:02.684118 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d86254-8466-41cd-bcdc-a0e5b60d0081 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:02.684393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d86254-8466-41cd-bcdc-a0e5b60d0081 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:02.685036 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d86254-8466-41cd-bcdc-a0e5b60d0081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:02.687111 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d86254-8466-41cd-bcdc-a0e5b60d0081 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:02.733084 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1144/2296] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:47:02 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:02.736913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba5ef7-35d0-49f7-974a-db3b38293840 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:02.748718 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba5ef7-35d0-49f7-974a-db3b38293840 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:02.827335 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35c3cd-ed23-43b3-9c38-572bdcf7c75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:02.828183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35c3cd-ed23-43b3-9c38-572bdcf7c75a admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:02.828482 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35c3cd-ed23-43b3-9c38-572bdcf7c75a admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:02.828954 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35c3cd-ed23-43b3-9c38-572bdcf7c75a admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:02.829888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35c3cd-ed23-43b3-9c38-572bdcf7c75a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:02.832389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35c3cd-ed23-43b3-9c38-572bdcf7c75a admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:02.857069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1153/2297] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:47:02 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:47:02.860958 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d86254-8466-41cd-bcdc-a0e5b60d0081 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:02.871432 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d86254-8466-41cd-bcdc-a0e5b60d0081 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:02.876118 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839fca4-15c8-4818-91e8-88fcf6222be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:02.876711 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839fca4-15c8-4818-91e8-88fcf6222be7 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:02.876988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839fca4-15c8-4818-91e8-88fcf6222be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:02.877258 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839fca4-15c8-4818-91e8-88fcf6222be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:02.877937 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839fca4-15c8-4818-91e8-88fcf6222be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:02.879578 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839fca4-15c8-4818-91e8-88fcf6222be7 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:02.891872 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1145/2298] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:47:02.895856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35c3cd-ed23-43b3-9c38-572bdcf7c75a admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:02.901266 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:02.908535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35c3cd-ed23-43b3-9c38-572bdcf7c75a admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:02.913710 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4c1a0-689c-4cd1-b206-b974e0a870d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:02.914435 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4c1a0-689c-4cd1-b206-b974e0a870d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:02.914811 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4c1a0-689c-4cd1-b206-b974e0a870d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:02.915157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4c1a0-689c-4cd1-b206-b974e0a870d9 admin admin] PATH_INFO: `/v3/projects/e87756b4eb3844edb5007426315a6820/users/88be75cebba444158c74acbce7b577ea/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:02.932236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4c1a0-689c-4cd1-b206-b974e0a870d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e87756b4eb3844edb5007426315a6820, user_id=88be75cebba444158c74acbce7b577ea, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:02.935988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4c1a0-689c-4cd1-b206-b974e0a870d9 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:02.974446 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1154/2299] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:47:02 2022] PUT /identity/v3/projects/e87756b4eb3844edb5007426315a6820/users/88be75cebba444158c74acbce7b577ea/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:02.978481 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839fca4-15c8-4818-91e8-88fcf6222be7 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:02.989426 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839fca4-15c8-4818-91e8-88fcf6222be7 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:03.046645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bd74d-5d72-4803-98ad-721977737957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:03.047255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bd74d-5d72-4803-98ad-721977737957 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:03.047532 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bd74d-5d72-4803-98ad-721977737957 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:03.047802 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bd74d-5d72-4803-98ad-721977737957 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:03.048444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bd74d-5d72-4803-98ad-721977737957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:03.050062 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bd74d-5d72-4803-98ad-721977737957 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:03.060994 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1146/2300] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:47:03.065171 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4c1a0-689c-4cd1-b206-b974e0a870d9 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:03.078181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4c1a0-689c-4cd1-b206-b974e0a870d9 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:03.083605 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5276255-c882-4341-adfb-90717360fe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:03.084274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5276255-c882-4341-adfb-90717360fe6d admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:03.084556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5276255-c882-4341-adfb-90717360fe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:03.085008 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5276255-c882-4341-adfb-90717360fe6d admin admin] PATH_INFO: `/v3/projects/e87756b4eb3844edb5007426315a6820/users/88be75cebba444158c74acbce7b577ea/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:03.086840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5276255-c882-4341-adfb-90717360fe6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e87756b4eb3844edb5007426315a6820, user_id=88be75cebba444158c74acbce7b577ea, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:03.090755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5276255-c882-4341-adfb-90717360fe6d admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:03.132969 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1155/2301] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:47:03 2022] PUT /identity/v3/projects/e87756b4eb3844edb5007426315a6820/users/88be75cebba444158c74acbce7b577ea/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:03.951181 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe0816-28ab-4cf2-890e-88c61442a02b None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:03.952214 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe0816-28ab-4cf2-890e-88c61442a02b None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:03.952713 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe0816-28ab-4cf2-890e-88c61442a02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:03.991461 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-15fe0816-28ab-4cf2-890e-88c61442a02b None None] MFA Rules not processed for user `88be75cebba444158c74acbce7b577ea`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:03.993010 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-15fe0816-28ab-4cf2-890e-88c61442a02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:04.056743 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:04.110098 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1147/2302] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:47:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:04.120956 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea629006-9851-4be0-ba99-92070a7a56ba None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:04.121813 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea629006-9851-4be0-ba99-92070a7a56ba None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:04.121813 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea629006-9851-4be0-ba99-92070a7a56ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:04.142292 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-ea629006-9851-4be0-ba99-92070a7a56ba None None] MFA Rules not processed for user `c117a7bc4b62471c9bd2321a2bc01d79`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:04.143610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-ea629006-9851-4be0-ba99-92070a7a56ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:04.217528 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1156/2303] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:47:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:04.225204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe0816-28ab-4cf2-890e-88c61442a02b None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:04.226833 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-15fe0816-28ab-4cf2-890e-88c61442a02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:04.305229 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe0816-28ab-4cf2-890e-88c61442a02b None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:04.311507 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e3465-e9c4-4b2e-9957-50ea982970ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:04.312112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e3465-e9c4-4b2e-9957-50ea982970ac service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:04.312385 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e3465-e9c4-4b2e-9957-50ea982970ac service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:04.312654 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e3465-e9c4-4b2e-9957-50ea982970ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:04.320303 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e3465-e9c4-4b2e-9957-50ea982970ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:04.321905 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e3465-e9c4-4b2e-9957-50ea982970ac service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:04.330756 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1148/2304] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:47:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:47:13.782268 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ae98b-fe8d-48a7-a099-248808e611fd None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:13.783094 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ae98b-fe8d-48a7-a099-248808e611fd None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:13.783569 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ae98b-fe8d-48a7-a099-248808e611fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:13.812388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-5d4ae98b-fe8d-48a7-a099-248808e611fd None None] MFA Rules not processed for user `3ae62427d5914e67b5b4d0237ecccd06`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:13.814014 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-5d4ae98b-fe8d-48a7-a099-248808e611fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:13.942421 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1157/2305] 10.222.0.58 () {58 vars in 967 bytes} [Wed Aug 24 09:47:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:13.971189 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e3465-e9c4-4b2e-9957-50ea982970ac service nova] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:13.972780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-d72e3465-e9c4-4b2e-9957-50ea982970ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:14.058708 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e3465-e9c4-4b2e-9957-50ea982970ac service nova] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:14.064284 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db176a1-77d7-4fbf-bef6-5e1c1cd9fabe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2db35b94c84ec7bba96117d23baf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:14.064974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db176a1-77d7-4fbf-bef6-5e1c1cd9fabe service swift] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:14.065254 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db176a1-77d7-4fbf-bef6-5e1c1cd9fabe service swift] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:14.065601 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db176a1-77d7-4fbf-bef6-5e1c1cd9fabe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:14.076032 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db176a1-77d7-4fbf-bef6-5e1c1cd9fabe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:14.078276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db176a1-77d7-4fbf-bef6-5e1c1cd9fabe service swift] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:14.090477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1149/2306] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 09:47:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:47:16.019759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cd75a-bb13-49e1-ab39-6611530d42bd None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:16.020308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cd75a-bb13-49e1-ab39-6611530d42bd None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:16.020470 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cd75a-bb13-49e1-ab39-6611530d42bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:16.040431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-e96cd75a-bb13-49e1-ab39-6611530d42bd None None] MFA Rules not processed for user `f197b03d644e4176bf6a0800aae31b4d`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:16.041686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-e96cd75a-bb13-49e1-ab39-6611530d42bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:16.079990 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bbf92-f582-48c0-8c65-c7e8b9314b34 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:16.080848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bbf92-f582-48c0-8c65-c7e8b9314b34 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:16.081304 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bbf92-f582-48c0-8c65-c7e8b9314b34 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:16.082821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1150/2307] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 09:47:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 09:47:16.094690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840f6e6-1440-4105-92cc-2ef8dcc10570 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:16.095254 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840f6e6-1440-4105-92cc-2ef8dcc10570 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:16.095540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840f6e6-1440-4105-92cc-2ef8dcc10570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:16.101443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1158/2308] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:47:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:16.115650 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-b840f6e6-1440-4105-92cc-2ef8dcc10570 None None] MFA Rules not processed for user `6983e364f5564ed7854dff06a80f55d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:16.116964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b840f6e6-1440-4105-92cc-2ef8dcc10570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:16.162852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cd75a-bb13-49e1-ab39-6611530d42bd None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:16.165635 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-e96cd75a-bb13-49e1-ab39-6611530d42bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:16.203451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:16.206846 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:16.244530 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1151/2309] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 09:47:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:47:16.268801 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840f6e6-1440-4105-92cc-2ef8dcc10570 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:16.272596 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b840f6e6-1440-4105-92cc-2ef8dcc10570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:16.294518 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cd75a-bb13-49e1-ab39-6611530d42bd None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:16.298674 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840f6e6-1440-4105-92cc-2ef8dcc10570 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:16.308137 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57235fa9-540e-4fcf-b31f-29dad34d3d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:16.309230 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57235fa9-540e-4fcf-b31f-29dad34d3d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:16.309959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57235fa9-540e-4fcf-b31f-29dad34d3d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:16.310787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57235fa9-540e-4fcf-b31f-29dad34d3d9a admin admin] PATH_INFO: `/v3/users/63cc1f9e479e41c2bc0d5baa2c60b903` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:16.312786 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57235fa9-540e-4fcf-b31f-29dad34d3d9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=63cc1f9e479e41c2bc0d5baa2c60b903)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:16.314811 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fef0d7-405f-434b-ab2f-4a78122e7e8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983e364f5564ed7854dff06a80f55d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:16.315433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fef0d7-405f-434b-ab2f-4a78122e7e8a service placement] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:16.315712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fef0d7-405f-434b-ab2f-4a78122e7e8a service placement] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:16.315983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fef0d7-405f-434b-ab2f-4a78122e7e8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:16.317051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57235fa9-540e-4fcf-b31f-29dad34d3d9a admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:16.346897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fef0d7-405f-434b-ab2f-4a78122e7e8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:16.348728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fef0d7-405f-434b-ab2f-4a78122e7e8a service placement] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:16.365910 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1152/2310] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:47:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:47:16.419723 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-57235fa9-540e-4fcf-b31f-29dad34d3d9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63cc1f9e479e41c2bc0d5baa2c60b903'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:16.420482 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-57235fa9-540e-4fcf-b31f-29dad34d3d9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63cc1f9e479e41c2bc0d5baa2c60b903'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:16.468109 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-57235fa9-540e-4fcf-b31f-29dad34d3d9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63cc1f9e479e41c2bc0d5baa2c60b903'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:16.492519 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-57235fa9-540e-4fcf-b31f-29dad34d3d9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63cc1f9e479e41c2bc0d5baa2c60b903'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:16.509605 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-57235fa9-540e-4fcf-b31f-29dad34d3d9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63cc1f9e479e41c2bc0d5baa2c60b903'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:16.520449 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1159/2311] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:47:16 2022] DELETE /identity/v3/users/63cc1f9e479e41c2bc0d5baa2c60b903 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:16.805187 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fef0d7-405f-434b-ab2f-4a78122e7e8a service placement] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:16.827579 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fef0d7-405f-434b-ab2f-4a78122e7e8a service placement] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:16.898303 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8fdf6d-e2d7-4cc4-8230-0c3d5e88ff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:16.899103 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fdf6d-e2d7-4cc4-8230-0c3d5e88ff4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:16.899486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fdf6d-e2d7-4cc4-8230-0c3d5e88ff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:16.899772 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8fdf6d-e2d7-4cc4-8230-0c3d5e88ff4a admin admin] PATH_INFO: `/v3/projects/55d499da45534e539f1cf3fb6bad7efc` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:16.900918 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fdf6d-e2d7-4cc4-8230-0c3d5e88ff4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=55d499da45534e539f1cf3fb6bad7efc)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:16.902898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8fdf6d-e2d7-4cc4-8230-0c3d5e88ff4a admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:16.953192 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cc8fdf6d-e2d7-4cc4-8230-0c3d5e88ff4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d499da45534e539f1cf3fb6bad7efc', 'request_id': 'req-cc8fdf6d-e2d7-4cc4-8230-0c3d5e88ff4a'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:16.961954 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cc8fdf6d-e2d7-4cc4-8230-0c3d5e88ff4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d499da45534e539f1cf3fb6bad7efc', 'request_id': 'req-cc8fdf6d-e2d7-4cc4-8230-0c3d5e88ff4a'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:16.968990 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cc8fdf6d-e2d7-4cc4-8230-0c3d5e88ff4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d499da45534e539f1cf3fb6bad7efc', 'request_id': 'req-cc8fdf6d-e2d7-4cc4-8230-0c3d5e88ff4a'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:16.981529 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cc8fdf6d-e2d7-4cc4-8230-0c3d5e88ff4a admin admin] The token cache is being invalidate because project 55d499da45534e539f1cf3fb6bad7efc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:47:16.981825 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cc8fdf6d-e2d7-4cc4-8230-0c3d5e88ff4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:16.982489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cc8fdf6d-e2d7-4cc4-8230-0c3d5e88ff4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:16.983990 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1153/2312] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:47:16 2022] DELETE /identity/v3/projects/55d499da45534e539f1cf3fb6bad7efc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:16.988973 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be0b8d-a753-4617-b571-c0f253780bda None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:16.989246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be0b8d-a753-4617-b571-c0f253780bda None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:16.989704 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be0b8d-a753-4617-b571-c0f253780bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.009216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-19be0b8d-a753-4617-b571-c0f253780bda None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:17.011002 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-19be0b8d-a753-4617-b571-c0f253780bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:17.087880 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1160/2313] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:17.097362 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3220d-0731-4819-bc6d-75f654d245f3 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.097957 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3220d-0731-4819-bc6d-75f654d245f3 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.098337 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3220d-0731-4819-bc6d-75f654d245f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.124161 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-e6a3220d-0731-4819-bc6d-75f654d245f3 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:17.126136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e6a3220d-0731-4819-bc6d-75f654d245f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:17.136417 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1154/2314] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:17.140780 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be0b8d-a753-4617-b571-c0f253780bda None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:17.153509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be0b8d-a753-4617-b571-c0f253780bda None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:17.159987 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9f0b8-6a5c-4e22-a399-6371df8678bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:17.162200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9f0b8-6a5c-4e22-a399-6371df8678bd admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.162200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9f0b8-6a5c-4e22-a399-6371df8678bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.162518 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9f0b8-6a5c-4e22-a399-6371df8678bd admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.163326 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9f0b8-6a5c-4e22-a399-6371df8678bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:17.163631 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9f0b8-6a5c-4e22-a399-6371df8678bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:17.165357 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9f0b8-6a5c-4e22-a399-6371df8678bd admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:17.180508 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1161/2315] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:17.184839 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3220d-0731-4819-bc6d-75f654d245f3 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:17.195011 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3220d-0731-4819-bc6d-75f654d245f3 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:17.204065 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948044c-58b3-472b-8fc8-29fe69ad575d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:17.204756 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948044c-58b3-472b-8fc8-29fe69ad575d admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.205214 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948044c-58b3-472b-8fc8-29fe69ad575d admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.205707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948044c-58b3-472b-8fc8-29fe69ad575d admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.206402 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948044c-58b3-472b-8fc8-29fe69ad575d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:17.208399 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948044c-58b3-472b-8fc8-29fe69ad575d admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:17.251403 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1155/2316] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:47:17 2022] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:17.255383 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9f0b8-6a5c-4e22-a399-6371df8678bd admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:17.271243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9f0b8-6a5c-4e22-a399-6371df8678bd admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:17.308056 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:17.381698 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb9879-3334-4f14-a1c4-5666fb7c2341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:17.382288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb9879-3334-4f14-a1c4-5666fb7c2341 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.382572 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb9879-3334-4f14-a1c4-5666fb7c2341 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.382943 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb9879-3334-4f14-a1c4-5666fb7c2341 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.383504 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb9879-3334-4f14-a1c4-5666fb7c2341 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:17.386219 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb9879-3334-4f14-a1c4-5666fb7c2341 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:17.408405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948044c-58b3-472b-8fc8-29fe69ad575d admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:17.410685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-3948044c-58b3-472b-8fc8-29fe69ad575d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:17.419085 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1162/2317] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:47:17 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:17.423189 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb9879-3334-4f14-a1c4-5666fb7c2341 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:17.431662 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948044c-58b3-472b-8fc8-29fe69ad575d admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:17.436815 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb9879-3334-4f14-a1c4-5666fb7c2341 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:17.438858 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a25f5c-68bc-4961-90e4-8d2ef8d51fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:17.439940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a25f5c-68bc-4961-90e4-8d2ef8d51fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.440446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a25f5c-68bc-4961-90e4-8d2ef8d51fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.441142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a25f5c-68bc-4961-90e4-8d2ef8d51fc5 admin admin] PATH_INFO: `/v3/users/4697b8e243244fb5864e28123b0d33b2` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.442945 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a25f5c-68bc-4961-90e4-8d2ef8d51fc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4697b8e243244fb5864e28123b0d33b2)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:17.445815 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a25f5c-68bc-4961-90e4-8d2ef8d51fc5 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:17.455474 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2dce53-95c5-41c4-ae8e-df63886b3107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:17.456559 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dce53-95c5-41c4-ae8e-df63886b3107 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.457154 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dce53-95c5-41c4-ae8e-df63886b3107 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.457738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dce53-95c5-41c4-ae8e-df63886b3107 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.458615 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2dce53-95c5-41c4-ae8e-df63886b3107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:17.463219 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2dce53-95c5-41c4-ae8e-df63886b3107 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:17.481383 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1163/2318] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:47:17.483136 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2dce53-95c5-41c4-ae8e-df63886b3107 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:17.496761 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2dce53-95c5-41c4-ae8e-df63886b3107 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:17.503609 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617d327-d07b-4be2-a28e-14b8cee29c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:17.505496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617d327-d07b-4be2-a28e-14b8cee29c88 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.505785 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617d327-d07b-4be2-a28e-14b8cee29c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.506103 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617d327-d07b-4be2-a28e-14b8cee29c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.508944 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617d327-d07b-4be2-a28e-14b8cee29c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:17.510104 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617d327-d07b-4be2-a28e-14b8cee29c88 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:17.527092 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:17.544740 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1164/2319] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:47:17.545673 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617d327-d07b-4be2-a28e-14b8cee29c88 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:17.560217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c4a25f5c-68bc-4961-90e4-8d2ef8d51fc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4697b8e243244fb5864e28123b0d33b2'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:17.560388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617d327-d07b-4be2-a28e-14b8cee29c88 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:17.561005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c4a25f5c-68bc-4961-90e4-8d2ef8d51fc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4697b8e243244fb5864e28123b0d33b2'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:17.561759 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c4a25f5c-68bc-4961-90e4-8d2ef8d51fc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4697b8e243244fb5864e28123b0d33b2'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:17.567143 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d576c-5e37-4bca-9ea1-c0817a0b45cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:17.567819 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d576c-5e37-4bca-9ea1-c0817a0b45cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.568053 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d576c-5e37-4bca-9ea1-c0817a0b45cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.568329 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d576c-5e37-4bca-9ea1-c0817a0b45cd admin admin] PATH_INFO: `/v3/projects/464467be13564cfa829e71145e9e69db/users/61703e393902420fa093b3e9e57a39fc/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.591113 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c4a25f5c-68bc-4961-90e4-8d2ef8d51fc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4697b8e243244fb5864e28123b0d33b2'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:17.600935 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c4a25f5c-68bc-4961-90e4-8d2ef8d51fc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4697b8e243244fb5864e28123b0d33b2'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:17.618256 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d576c-5e37-4bca-9ea1-c0817a0b45cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=464467be13564cfa829e71145e9e69db, user_id=61703e393902420fa093b3e9e57a39fc, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:17.618768 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1156/2320] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:47:17 2022] DELETE /identity/v3/users/4697b8e243244fb5864e28123b0d33b2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:47:17.623573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcf839-8a99-4cd5-a142-e4c4fb328981 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.623935 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcf839-8a99-4cd5-a142-e4c4fb328981 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.624229 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcf839-8a99-4cd5-a142-e4c4fb328981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.627318 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d576c-5e37-4bca-9ea1-c0817a0b45cd admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:17.650009 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-42fcf839-8a99-4cd5-a142-e4c4fb328981 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:17.651894 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1165/2321] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:47:17 2022] PUT /identity/v3/projects/464467be13564cfa829e71145e9e69db/users/61703e393902420fa093b3e9e57a39fc/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:17.661250 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-42fcf839-8a99-4cd5-a142-e4c4fb328981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:17.662232 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b09ff-0932-4218-bd9f-6f1d90a67315 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.662591 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b09ff-0932-4218-bd9f-6f1d90a67315 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.662981 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b09ff-0932-4218-bd9f-6f1d90a67315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.700360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-097b09ff-0932-4218-bd9f-6f1d90a67315 None None] MFA Rules not processed for user `61703e393902420fa093b3e9e57a39fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:17.701802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-097b09ff-0932-4218-bd9f-6f1d90a67315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:17.755795 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1157/2322] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:17.766768 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcf839-8a99-4cd5-a142-e4c4fb328981 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:17.770781 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-42fcf839-8a99-4cd5-a142-e4c4fb328981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:17.825615 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1166/2323] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:47:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:47:17.834223 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b09ff-0932-4218-bd9f-6f1d90a67315 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:17.836485 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-097b09ff-0932-4218-bd9f-6f1d90a67315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:17.889848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcf839-8a99-4cd5-a142-e4c4fb328981 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:17.895153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ec6e6-581f-41da-b6fb-92f81adfb77e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:17.896065 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ec6e6-581f-41da-b6fb-92f81adfb77e service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.897631 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ec6e6-581f-41da-b6fb-92f81adfb77e service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.898226 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ec6e6-581f-41da-b6fb-92f81adfb77e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.912523 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ec6e6-581f-41da-b6fb-92f81adfb77e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:17.914728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ec6e6-581f-41da-b6fb-92f81adfb77e service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:17.942013 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1158/2324] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:47:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:47:17.977235 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b09ff-0932-4218-bd9f-6f1d90a67315 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:17.984395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640d577-914a-4498-a290-242720db8776 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51fe6dfa43d04cdeb0421d2613c8c2ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:17.984829 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640d577-914a-4498-a290-242720db8776 service glance] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:17.985632 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640d577-914a-4498-a290-242720db8776 service glance] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:17.986848 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640d577-914a-4498-a290-242720db8776 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:17.999495 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640d577-914a-4498-a290-242720db8776 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:18.001803 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640d577-914a-4498-a290-242720db8776 service glance] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:18.023486 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1167/2325] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:47:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:47:18.320058 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ec6e6-581f-41da-b6fb-92f81adfb77e service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:18.321676 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-de2ec6e6-581f-41da-b6fb-92f81adfb77e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:18.339508 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ec6e6-581f-41da-b6fb-92f81adfb77e service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:18.374187 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e29b5-b2c9-4055-b0bd-7cc104f1422f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:18.374924 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e29b5-b2c9-4055-b0bd-7cc104f1422f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:18.375274 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e29b5-b2c9-4055-b0bd-7cc104f1422f admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:18.375625 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e29b5-b2c9-4055-b0bd-7cc104f1422f admin admin] PATH_INFO: `/v3/projects/d85a626811f148a7ae86f0fa44b38acf` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:18.377109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e29b5-b2c9-4055-b0bd-7cc104f1422f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85a626811f148a7ae86f0fa44b38acf)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:18.379636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e29b5-b2c9-4055-b0bd-7cc104f1422f admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:18.436657 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:18.438321 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-007e29b5-b2c9-4055-b0bd-7cc104f1422f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85a626811f148a7ae86f0fa44b38acf', 'request_id': 'req-007e29b5-b2c9-4055-b0bd-7cc104f1422f'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:18.446977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-007e29b5-b2c9-4055-b0bd-7cc104f1422f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85a626811f148a7ae86f0fa44b38acf', 'request_id': 'req-007e29b5-b2c9-4055-b0bd-7cc104f1422f'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:18.455486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-007e29b5-b2c9-4055-b0bd-7cc104f1422f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85a626811f148a7ae86f0fa44b38acf', 'request_id': 'req-007e29b5-b2c9-4055-b0bd-7cc104f1422f'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:18.468628 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-007e29b5-b2c9-4055-b0bd-7cc104f1422f admin admin] The token cache is being invalidate because project d85a626811f148a7ae86f0fa44b38acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:47:18.469025 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-007e29b5-b2c9-4055-b0bd-7cc104f1422f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:18.469969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-007e29b5-b2c9-4055-b0bd-7cc104f1422f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:18.472885 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1159/2326] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:47:18 2022] DELETE /identity/v3/projects/d85a626811f148a7ae86f0fa44b38acf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:28.007495 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=95,keystone:INSERT=4 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:28.465035 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=7,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:30.244858 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640d577-914a-4498-a290-242720db8776 service glance] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:30.247036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-6640d577-914a-4498-a290-242720db8776 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:30.305094 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640d577-914a-4498-a290-242720db8776 service glance] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:30.355866 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d343d0-656a-4158-8eef-e223c022f9ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:30.356477 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d343d0-656a-4158-8eef-e223c022f9ff service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:30.356755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d343d0-656a-4158-8eef-e223c022f9ff service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:30.357030 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d343d0-656a-4158-8eef-e223c022f9ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:30.358832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f5d343d0-656a-4158-8eef-e223c022f9ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:30.423919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d343d0-656a-4158-8eef-e223c022f9ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:30.425353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d343d0-656a-4158-8eef-e223c022f9ff service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:30.436059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1168/2327] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:47:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:47:31.498784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e29b5-b2c9-4055-b0bd-7cc104f1422f admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:31.500472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-007e29b5-b2c9-4055-b0bd-7cc104f1422f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:31.561271 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e29b5-b2c9-4055-b0bd-7cc104f1422f admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:31.565088 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c4f7c-16f7-445e-b553-fc6dd570415e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:31.565738 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c4f7c-16f7-445e-b553-fc6dd570415e service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:31.566022 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c4f7c-16f7-445e-b553-fc6dd570415e service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:31.566296 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c4f7c-16f7-445e-b553-fc6dd570415e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:31.568029 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-685c4f7c-16f7-445e-b553-fc6dd570415e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:31.634131 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c4f7c-16f7-445e-b553-fc6dd570415e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:31.635780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c4f7c-16f7-445e-b553-fc6dd570415e service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:31.645136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1160/2328] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:47:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:47:40.430837 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=70 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:41.640922 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=50 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:51.566238 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d343d0-656a-4158-8eef-e223c022f9ff service cinder] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:51.567675 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f5d343d0-656a-4158-8eef-e223c022f9ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:51.630362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d343d0-656a-4158-8eef-e223c022f9ff service cinder] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:51.634875 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37716174-11c7-45ad-9058-1d701419b065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:51.635485 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37716174-11c7-45ad-9058-1d701419b065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:51.635759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37716174-11c7-45ad-9058-1d701419b065 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:51.636028 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37716174-11c7-45ad-9058-1d701419b065 admin admin] PATH_INFO: `/v3/users/61703e393902420fa093b3e9e57a39fc` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:51.637186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37716174-11c7-45ad-9058-1d701419b065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61703e393902420fa093b3e9e57a39fc)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:51.639127 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37716174-11c7-45ad-9058-1d701419b065 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:51.688465 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-37716174-11c7-45ad-9058-1d701419b065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61703e393902420fa093b3e9e57a39fc'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:51.689120 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-37716174-11c7-45ad-9058-1d701419b065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61703e393902420fa093b3e9e57a39fc'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:51.702489 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-37716174-11c7-45ad-9058-1d701419b065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61703e393902420fa093b3e9e57a39fc'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:51.709806 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-37716174-11c7-45ad-9058-1d701419b065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61703e393902420fa093b3e9e57a39fc'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:51.717437 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-37716174-11c7-45ad-9058-1d701419b065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61703e393902420fa093b3e9e57a39fc'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:51.723732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1169/2329] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:47:51 2022] DELETE /identity/v3/users/61703e393902420fa093b3e9e57a39fc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:51.728345 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d941907-ec8f-418c-a446-a066667151d6 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:51.728832 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d941907-ec8f-418c-a446-a066667151d6 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:51.728926 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d941907-ec8f-418c-a446-a066667151d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:51.748280 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-3d941907-ec8f-418c-a446-a066667151d6 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:51.749521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-3d941907-ec8f-418c-a446-a066667151d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:51.808266 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1161/2330] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:51.818103 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37716174-11c7-45ad-9058-1d701419b065 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:51.819559 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-37716174-11c7-45ad-9058-1d701419b065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:51.881000 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37716174-11c7-45ad-9058-1d701419b065 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:51.884717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75804da-47fd-40cf-82ef-f89919569a3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:51.885325 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75804da-47fd-40cf-82ef-f89919569a3f service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:51.885640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75804da-47fd-40cf-82ef-f89919569a3f service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:51.885918 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75804da-47fd-40cf-82ef-f89919569a3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:51.895480 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75804da-47fd-40cf-82ef-f89919569a3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:51.896900 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75804da-47fd-40cf-82ef-f89919569a3f service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:51.906515 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1170/2331] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:47:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:47:52.336994 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d941907-ec8f-418c-a446-a066667151d6 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:52.338739 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-3d941907-ec8f-418c-a446-a066667151d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:52.363093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d941907-ec8f-418c-a446-a066667151d6 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:52.369557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee26d2e-a61e-4bd6-a53e-b4b83e1327ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:52.370312 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee26d2e-a61e-4bd6-a53e-b4b83e1327ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:52.370705 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee26d2e-a61e-4bd6-a53e-b4b83e1327ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:52.371597 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee26d2e-a61e-4bd6-a53e-b4b83e1327ee admin admin] PATH_INFO: `/v3/projects/464467be13564cfa829e71145e9e69db` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:52.373053 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee26d2e-a61e-4bd6-a53e-b4b83e1327ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=464467be13564cfa829e71145e9e69db)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:52.375110 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee26d2e-a61e-4bd6-a53e-b4b83e1327ee admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:52.428028 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-1ee26d2e-a61e-4bd6-a53e-b4b83e1327ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '464467be13564cfa829e71145e9e69db', 'request_id': 'req-1ee26d2e-a61e-4bd6-a53e-b4b83e1327ee'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:52.436227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-1ee26d2e-a61e-4bd6-a53e-b4b83e1327ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '464467be13564cfa829e71145e9e69db', 'request_id': 'req-1ee26d2e-a61e-4bd6-a53e-b4b83e1327ee'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:52.443251 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-1ee26d2e-a61e-4bd6-a53e-b4b83e1327ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '464467be13564cfa829e71145e9e69db', 'request_id': 'req-1ee26d2e-a61e-4bd6-a53e-b4b83e1327ee'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:52.454853 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-1ee26d2e-a61e-4bd6-a53e-b4b83e1327ee admin admin] The token cache is being invalidate because project 464467be13564cfa829e71145e9e69db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:47:52.455145 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-1ee26d2e-a61e-4bd6-a53e-b4b83e1327ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:52.455803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-1ee26d2e-a61e-4bd6-a53e-b4b83e1327ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:52.457393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1162/2332] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:47:52 2022] DELETE /identity/v3/projects/464467be13564cfa829e71145e9e69db => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:52.462289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c3b22-d50a-4021-aa51-81287a5cc974 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:52.462749 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c3b22-d50a-4021-aa51-81287a5cc974 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:52.463026 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c3b22-d50a-4021-aa51-81287a5cc974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:52.486864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-8e9c3b22-d50a-4021-aa51-81287a5cc974 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:52.488166 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-8e9c3b22-d50a-4021-aa51-81287a5cc974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:52.506537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:52.558126 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1171/2333] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:52.566551 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4749c9-4ad0-4786-9bf5-16975e3faa1b None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:52.566928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4749c9-4ad0-4786-9bf5-16975e3faa1b None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:52.567280 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4749c9-4ad0-4786-9bf5-16975e3faa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:52.587399 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-3c4749c9-4ad0-4786-9bf5-16975e3faa1b None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:52.588697 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-3c4749c9-4ad0-4786-9bf5-16975e3faa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:52.597149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1163/2334] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:47:52.601402 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c3b22-d50a-4021-aa51-81287a5cc974 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:52.611802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c3b22-d50a-4021-aa51-81287a5cc974 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:52.616537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bb63d-a340-4c1d-a121-e0e7ac70d99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:52.617147 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bb63d-a340-4c1d-a121-e0e7ac70d99c admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:52.617430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bb63d-a340-4c1d-a121-e0e7ac70d99c admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:52.617738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bb63d-a340-4c1d-a121-e0e7ac70d99c admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:52.618396 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bb63d-a340-4c1d-a121-e0e7ac70d99c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:52.618698 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bb63d-a340-4c1d-a121-e0e7ac70d99c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:52.620343 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bb63d-a340-4c1d-a121-e0e7ac70d99c admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:52.632528 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1172/2335] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:52.637128 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4749c9-4ad0-4786-9bf5-16975e3faa1b None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:52.646599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4749c9-4ad0-4786-9bf5-16975e3faa1b None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:52.651297 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ac327-9cbc-41f1-a622-b53456adba5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:52.651894 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ac327-9cbc-41f1-a622-b53456adba5e admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:52.652174 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ac327-9cbc-41f1-a622-b53456adba5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:52.652562 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ac327-9cbc-41f1-a622-b53456adba5e admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:52.653187 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ac327-9cbc-41f1-a622-b53456adba5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:52.655126 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ac327-9cbc-41f1-a622-b53456adba5e admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:52.683412 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1164/2336] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:47:52 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:47:52.688489 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bb63d-a340-4c1d-a121-e0e7ac70d99c admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:52.698748 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bb63d-a340-4c1d-a121-e0e7ac70d99c admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:52.764677 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c0324-99b7-4445-83b9-79a84f739a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:52.765297 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c0324-99b7-4445-83b9-79a84f739a40 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:52.765606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c0324-99b7-4445-83b9-79a84f739a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:52.765879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c0324-99b7-4445-83b9-79a84f739a40 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:52.766501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c0324-99b7-4445-83b9-79a84f739a40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:52.768399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c0324-99b7-4445-83b9-79a84f739a40 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:52.789986 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1173/2337] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:47:52 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:52.795349 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ac327-9cbc-41f1-a622-b53456adba5e admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:52.805886 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ac327-9cbc-41f1-a622-b53456adba5e admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:52.810992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d84fd-6cf8-4a0f-8989-edd83ef8aba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:52.811594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d84fd-6cf8-4a0f-8989-edd83ef8aba6 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:52.811874 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d84fd-6cf8-4a0f-8989-edd83ef8aba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:52.812148 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d84fd-6cf8-4a0f-8989-edd83ef8aba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:52.812793 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d84fd-6cf8-4a0f-8989-edd83ef8aba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:52.814416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d84fd-6cf8-4a0f-8989-edd83ef8aba6 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:52.828411 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1165/2338] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:47:52.829663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c0324-99b7-4445-83b9-79a84f739a40 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:52.840819 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c0324-99b7-4445-83b9-79a84f739a40 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:52.847249 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83519ba-f84f-49b3-ace2-4127001a8945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:52.847861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83519ba-f84f-49b3-ace2-4127001a8945 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:52.848144 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83519ba-f84f-49b3-ace2-4127001a8945 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:52.848423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83519ba-f84f-49b3-ace2-4127001a8945 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:52.849069 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83519ba-f84f-49b3-ace2-4127001a8945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:52.850709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83519ba-f84f-49b3-ace2-4127001a8945 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:52.860966 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1174/2339] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:47:52.865028 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d84fd-6cf8-4a0f-8989-edd83ef8aba6 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:52.876004 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d84fd-6cf8-4a0f-8989-edd83ef8aba6 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:52.880701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fad9e-2770-44de-a86e-dff68089757d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:52.881363 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fad9e-2770-44de-a86e-dff68089757d admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:52.881710 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fad9e-2770-44de-a86e-dff68089757d admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:52.881964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fad9e-2770-44de-a86e-dff68089757d admin admin] PATH_INFO: `/v3/projects/c1fe0878ef554c52af0b1870b68b80cd/users/76e0d311d58e4897885876574c217dc2/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:52.897747 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fad9e-2770-44de-a86e-dff68089757d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1fe0878ef554c52af0b1870b68b80cd, user_id=76e0d311d58e4897885876574c217dc2, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:52.900385 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fad9e-2770-44de-a86e-dff68089757d admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:52.916145 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1166/2340] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:47:52 2022] PUT /identity/v3/projects/c1fe0878ef554c52af0b1870b68b80cd/users/76e0d311d58e4897885876574c217dc2/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:52.927785 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e79fb-600e-4029-96e5-fcfec99157fb None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:52.928070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e79fb-600e-4029-96e5-fcfec99157fb None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:52.928347 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e79fb-600e-4029-96e5-fcfec99157fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:52.957251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-591e79fb-600e-4029-96e5-fcfec99157fb None None] MFA Rules not processed for user `76e0d311d58e4897885876574c217dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:52.958507 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-591e79fb-600e-4029-96e5-fcfec99157fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:53.033220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1175/2341] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:47:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:53.044075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fad9e-2770-44de-a86e-dff68089757d admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:53.045842 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-905fad9e-2770-44de-a86e-dff68089757d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:53.069144 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e79fb-600e-4029-96e5-fcfec99157fb None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:53.070751 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-591e79fb-600e-4029-96e5-fcfec99157fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:53.073784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:53.100500 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:53.128564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fad9e-2770-44de-a86e-dff68089757d admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:53.133790 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f99a0-5b7a-43da-a4ca-b15a8e1bf7a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:53.134592 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f99a0-5b7a-43da-a4ca-b15a8e1bf7a3 service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:53.135005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f99a0-5b7a-43da-a4ca-b15a8e1bf7a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:53.135790 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f99a0-5b7a-43da-a4ca-b15a8e1bf7a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:53.149896 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f99a0-5b7a-43da-a4ca-b15a8e1bf7a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:53.151430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f99a0-5b7a-43da-a4ca-b15a8e1bf7a3 service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:53.161755 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1167/2342] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:47:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:47:53.164100 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e79fb-600e-4029-96e5-fcfec99157fb None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:53.168898 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246580db-0314-4b26-98c2-69427ee1cc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:53.169562 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246580db-0314-4b26-98c2-69427ee1cc01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:53.169987 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246580db-0314-4b26-98c2-69427ee1cc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:53.170309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246580db-0314-4b26-98c2-69427ee1cc01 admin admin] PATH_INFO: `/v3/users/c117a7bc4b62471c9bd2321a2bc01d79` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:53.171432 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246580db-0314-4b26-98c2-69427ee1cc01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c117a7bc4b62471c9bd2321a2bc01d79)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:53.173310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246580db-0314-4b26-98c2-69427ee1cc01 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:53.236481 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-246580db-0314-4b26-98c2-69427ee1cc01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c117a7bc4b62471c9bd2321a2bc01d79'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:53.237148 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-246580db-0314-4b26-98c2-69427ee1cc01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c117a7bc4b62471c9bd2321a2bc01d79'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:53.250883 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-246580db-0314-4b26-98c2-69427ee1cc01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c117a7bc4b62471c9bd2321a2bc01d79'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:53.258980 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-246580db-0314-4b26-98c2-69427ee1cc01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c117a7bc4b62471c9bd2321a2bc01d79'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:53.269338 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-246580db-0314-4b26-98c2-69427ee1cc01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c117a7bc4b62471c9bd2321a2bc01d79'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:53.277901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1176/2343] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:47:53 2022] DELETE /identity/v3/users/c117a7bc4b62471c9bd2321a2bc01d79 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:47:53.522807 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f99a0-5b7a-43da-a4ca-b15a8e1bf7a3 service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:53.538855 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f99a0-5b7a-43da-a4ca-b15a8e1bf7a3 service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:53.619761 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f36f3-5471-449b-9d67-0c2fd3fb4567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:53.620393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f36f3-5471-449b-9d67-0c2fd3fb4567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:53.620668 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f36f3-5471-449b-9d67-0c2fd3fb4567 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:53.620969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f36f3-5471-449b-9d67-0c2fd3fb4567 admin admin] PATH_INFO: `/v3/projects/f23d682773924267850150a31c961c0b` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:53.622658 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f36f3-5471-449b-9d67-0c2fd3fb4567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f23d682773924267850150a31c961c0b)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:53.624570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f36f3-5471-449b-9d67-0c2fd3fb4567 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:53.673159 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-bd1f36f3-5471-449b-9d67-0c2fd3fb4567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f23d682773924267850150a31c961c0b', 'request_id': 'req-bd1f36f3-5471-449b-9d67-0c2fd3fb4567'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:53.680298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-bd1f36f3-5471-449b-9d67-0c2fd3fb4567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f23d682773924267850150a31c961c0b', 'request_id': 'req-bd1f36f3-5471-449b-9d67-0c2fd3fb4567'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:53.689025 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-bd1f36f3-5471-449b-9d67-0c2fd3fb4567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f23d682773924267850150a31c961c0b', 'request_id': 'req-bd1f36f3-5471-449b-9d67-0c2fd3fb4567'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:53.701179 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-bd1f36f3-5471-449b-9d67-0c2fd3fb4567 admin admin] The token cache is being invalidate because project f23d682773924267850150a31c961c0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:47:53.701645 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-bd1f36f3-5471-449b-9d67-0c2fd3fb4567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:53.702314 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-bd1f36f3-5471-449b-9d67-0c2fd3fb4567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:53.703826 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1168/2344] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:47:53 2022] DELETE /identity/v3/projects/f23d682773924267850150a31c961c0b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:53.708055 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246580db-0314-4b26-98c2-69427ee1cc01 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:53.709646 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-246580db-0314-4b26-98c2-69427ee1cc01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:53.723810 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246580db-0314-4b26-98c2-69427ee1cc01 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:53.781120 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae85390-feff-4fcf-8e2a-114e1cad4fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:53.781795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae85390-feff-4fcf-8e2a-114e1cad4fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:53.782076 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae85390-feff-4fcf-8e2a-114e1cad4fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:53.782359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae85390-feff-4fcf-8e2a-114e1cad4fc6 admin admin] PATH_INFO: `/v3/users/88be75cebba444158c74acbce7b577ea` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:53.783618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae85390-feff-4fcf-8e2a-114e1cad4fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88be75cebba444158c74acbce7b577ea)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:53.785692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae85390-feff-4fcf-8e2a-114e1cad4fc6 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:53.827978 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:53.836492 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2ae85390-feff-4fcf-8e2a-114e1cad4fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88be75cebba444158c74acbce7b577ea'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:53.837455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2ae85390-feff-4fcf-8e2a-114e1cad4fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88be75cebba444158c74acbce7b577ea'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:53.852168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2ae85390-feff-4fcf-8e2a-114e1cad4fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88be75cebba444158c74acbce7b577ea'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:53.860051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2ae85390-feff-4fcf-8e2a-114e1cad4fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88be75cebba444158c74acbce7b577ea'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:53.867551 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2ae85390-feff-4fcf-8e2a-114e1cad4fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88be75cebba444158c74acbce7b577ea'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:53.873687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1177/2345] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:47:53 2022] DELETE /identity/v3/users/88be75cebba444158c74acbce7b577ea => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:54.045973 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f36f3-5471-449b-9d67-0c2fd3fb4567 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:54.047466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-bd1f36f3-5471-449b-9d67-0c2fd3fb4567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:54.061580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f36f3-5471-449b-9d67-0c2fd3fb4567 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:54.111772 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:54.122713 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbf3cd-a6c3-4004-b109-d724462943db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:54.123345 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbf3cd-a6c3-4004-b109-d724462943db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.123621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbf3cd-a6c3-4004-b109-d724462943db admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.123893 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbf3cd-a6c3-4004-b109-d724462943db admin admin] PATH_INFO: `/v3/projects/e87756b4eb3844edb5007426315a6820` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:54.125029 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbf3cd-a6c3-4004-b109-d724462943db admin admin] RBAC: Authorizing `identity:delete_project(project_id=e87756b4eb3844edb5007426315a6820)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:54.126967 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbf3cd-a6c3-4004-b109-d724462943db admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:54.174022 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-39fbf3cd-a6c3-4004-b109-d724462943db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e87756b4eb3844edb5007426315a6820', 'request_id': 'req-39fbf3cd-a6c3-4004-b109-d724462943db'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:54.181702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-39fbf3cd-a6c3-4004-b109-d724462943db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e87756b4eb3844edb5007426315a6820', 'request_id': 'req-39fbf3cd-a6c3-4004-b109-d724462943db'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:54.188172 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-39fbf3cd-a6c3-4004-b109-d724462943db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e87756b4eb3844edb5007426315a6820', 'request_id': 'req-39fbf3cd-a6c3-4004-b109-d724462943db'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:54.198741 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-39fbf3cd-a6c3-4004-b109-d724462943db admin admin] The token cache is being invalidate because project e87756b4eb3844edb5007426315a6820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:47:54.199753 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-39fbf3cd-a6c3-4004-b109-d724462943db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:54.200438 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-39fbf3cd-a6c3-4004-b109-d724462943db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:54.201957 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1169/2346] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:47:54 2022] DELETE /identity/v3/projects/e87756b4eb3844edb5007426315a6820 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:54.206932 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0bda3-0dd2-4d00-976a-04d2a4c8636b None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.207218 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0bda3-0dd2-4d00-976a-04d2a4c8636b None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.207491 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0bda3-0dd2-4d00-976a-04d2a4c8636b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:54.227768 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-faa0bda3-0dd2-4d00-976a-04d2a4c8636b None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:54.228951 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-faa0bda3-0dd2-4d00-976a-04d2a4c8636b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:54.300918 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1178/2347] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:47:54.309717 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3cff7-e66d-425f-886d-b2195014c387 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.310036 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3cff7-e66d-425f-886d-b2195014c387 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.310316 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3cff7-e66d-425f-886d-b2195014c387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:54.331302 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-fcd3cff7-e66d-425f-886d-b2195014c387 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:54.332607 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-fcd3cff7-e66d-425f-886d-b2195014c387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:54.342533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1170/2348] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:54.348015 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0bda3-0dd2-4d00-976a-04d2a4c8636b None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:54.358371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0bda3-0dd2-4d00-976a-04d2a4c8636b None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:54.363291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263b0fc-2b91-466c-8022-203e9118d102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:54.363901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263b0fc-2b91-466c-8022-203e9118d102 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.364185 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263b0fc-2b91-466c-8022-203e9118d102 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.364455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263b0fc-2b91-466c-8022-203e9118d102 admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:54.365103 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263b0fc-2b91-466c-8022-203e9118d102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:54.365404 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263b0fc-2b91-466c-8022-203e9118d102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:54.367027 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263b0fc-2b91-466c-8022-203e9118d102 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:54.380139 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1179/2349] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:54.384404 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3cff7-e66d-425f-886d-b2195014c387 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:54.394497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3cff7-e66d-425f-886d-b2195014c387 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:54.399179 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66c75a-91af-49c5-8885-4ab9d5db2ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:54.399772 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66c75a-91af-49c5-8885-4ab9d5db2ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.400049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66c75a-91af-49c5-8885-4ab9d5db2ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.400323 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66c75a-91af-49c5-8885-4ab9d5db2ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:54.400953 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66c75a-91af-49c5-8885-4ab9d5db2ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:54.403107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66c75a-91af-49c5-8885-4ab9d5db2ca4 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:54.435155 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1171/2350] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:47:54 2022] POST /identity/v3/projects => generated 361 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:47:54.436274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263b0fc-2b91-466c-8022-203e9118d102 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:54.446496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263b0fc-2b91-466c-8022-203e9118d102 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:54.503035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65deee30-d927-4b4b-973f-a5fd2281778a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:54.503639 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65deee30-d927-4b4b-973f-a5fd2281778a admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.503914 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65deee30-d927-4b4b-973f-a5fd2281778a admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.504187 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65deee30-d927-4b4b-973f-a5fd2281778a admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:54.504872 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65deee30-d927-4b4b-973f-a5fd2281778a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:54.506815 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65deee30-d927-4b4b-973f-a5fd2281778a admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:54.538020 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1180/2351] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:47:54 2022] POST /identity/v3/users => generated 281 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:47:54.539780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66c75a-91af-49c5-8885-4ab9d5db2ca4 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:54.550064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66c75a-91af-49c5-8885-4ab9d5db2ca4 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:54.554951 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db7157-ea40-491c-ae73-c63f1729895b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:54.555556 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db7157-ea40-491c-ae73-c63f1729895b admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.555837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db7157-ea40-491c-ae73-c63f1729895b admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.556114 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db7157-ea40-491c-ae73-c63f1729895b admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:54.556761 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db7157-ea40-491c-ae73-c63f1729895b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:54.558978 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db7157-ea40-491c-ae73-c63f1729895b admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:54.569967 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1172/2352] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:47:54.577415 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65deee30-d927-4b4b-973f-a5fd2281778a admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:54.588559 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65deee30-d927-4b4b-973f-a5fd2281778a admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:54.593969 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5109c-07ac-4bf1-8e16-2d994790e4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:54.594585 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5109c-07ac-4bf1-8e16-2d994790e4af admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.594870 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5109c-07ac-4bf1-8e16-2d994790e4af admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.595258 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5109c-07ac-4bf1-8e16-2d994790e4af admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:54.595973 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5109c-07ac-4bf1-8e16-2d994790e4af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:54.597651 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5109c-07ac-4bf1-8e16-2d994790e4af admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:54.612122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1181/2353] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:47:54.613364 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db7157-ea40-491c-ae73-c63f1729895b admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:54.624576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db7157-ea40-491c-ae73-c63f1729895b admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:54.629960 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431e17c-530f-42b1-96e3-81a477d0633b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:54.630881 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431e17c-530f-42b1-96e3-81a477d0633b admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.631146 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431e17c-530f-42b1-96e3-81a477d0633b admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.631551 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431e17c-530f-42b1-96e3-81a477d0633b admin admin] PATH_INFO: `/v3/projects/9398c4ed20584593b68e99de8f6e8694/users/03e74e984d034e4fa6e88fea750e8b9a/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:54.649264 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431e17c-530f-42b1-96e3-81a477d0633b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9398c4ed20584593b68e99de8f6e8694, user_id=03e74e984d034e4fa6e88fea750e8b9a, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:54.652283 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431e17c-530f-42b1-96e3-81a477d0633b admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:54.666276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1173/2354] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:47:54 2022] PUT /identity/v3/projects/9398c4ed20584593b68e99de8f6e8694/users/03e74e984d034e4fa6e88fea750e8b9a/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:54.678320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bde094-2522-4df1-b41a-e57193a4b435 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.678698 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bde094-2522-4df1-b41a-e57193a4b435 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.679040 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bde094-2522-4df1-b41a-e57193a4b435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:54.709995 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-c7bde094-2522-4df1-b41a-e57193a4b435 None None] MFA Rules not processed for user `03e74e984d034e4fa6e88fea750e8b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:54.711224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-c7bde094-2522-4df1-b41a-e57193a4b435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:54.721371 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:54.791650 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1182/2355] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:47:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:54.829901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431e17c-530f-42b1-96e3-81a477d0633b admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:54.831606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-c431e17c-530f-42b1-96e3-81a477d0633b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:54.890669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431e17c-530f-42b1-96e3-81a477d0633b admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:54.894418 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d452f-5e78-4114-a322-f561d60c5bf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:54.895026 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d452f-5e78-4114-a322-f561d60c5bf3 service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.895311 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d452f-5e78-4114-a322-f561d60c5bf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.895621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d452f-5e78-4114-a322-f561d60c5bf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:54.904601 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d452f-5e78-4114-a322-f561d60c5bf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:54.906090 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d452f-5e78-4114-a322-f561d60c5bf3 service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:54.914880 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1174/2356] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:47:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:47:54.931336 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bde094-2522-4df1-b41a-e57193a4b435 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:54.993576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bde094-2522-4df1-b41a-e57193a4b435 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:54.998683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29229b21-916a-4746-99ec-4b09dcaa8ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:54.999315 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29229b21-916a-4746-99ec-4b09dcaa8ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:54.999600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29229b21-916a-4746-99ec-4b09dcaa8ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:54.999877 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29229b21-916a-4746-99ec-4b09dcaa8ae2 admin admin] PATH_INFO: `/v3/users/03e74e984d034e4fa6e88fea750e8b9a` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.001008 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29229b21-916a-4746-99ec-4b09dcaa8ae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03e74e984d034e4fa6e88fea750e8b9a)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:55.002965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29229b21-916a-4746-99ec-4b09dcaa8ae2 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:55.050238 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-29229b21-916a-4746-99ec-4b09dcaa8ae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03e74e984d034e4fa6e88fea750e8b9a'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:55.050853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-29229b21-916a-4746-99ec-4b09dcaa8ae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03e74e984d034e4fa6e88fea750e8b9a'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:55.063459 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-29229b21-916a-4746-99ec-4b09dcaa8ae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03e74e984d034e4fa6e88fea750e8b9a'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:55.071359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-29229b21-916a-4746-99ec-4b09dcaa8ae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03e74e984d034e4fa6e88fea750e8b9a'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:55.078613 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-29229b21-916a-4746-99ec-4b09dcaa8ae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03e74e984d034e4fa6e88fea750e8b9a'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:55.084444 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1183/2357] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:47:54 2022] DELETE /identity/v3/users/03e74e984d034e4fa6e88fea750e8b9a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:55.089050 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db332ce-6533-42f3-b803-f94d17b4abd5 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.089589 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db332ce-6533-42f3-b803-f94d17b4abd5 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.089765 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db332ce-6533-42f3-b803-f94d17b4abd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.109259 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-0db332ce-6533-42f3-b803-f94d17b4abd5 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:55.110494 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-0db332ce-6533-42f3-b803-f94d17b4abd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:55.127160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:55.172038 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1175/2358] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:55.182028 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29229b21-916a-4746-99ec-4b09dcaa8ae2 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:55.183503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-29229b21-916a-4746-99ec-4b09dcaa8ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:55.219418 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:55.244651 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29229b21-916a-4746-99ec-4b09dcaa8ae2 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:55.248835 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7dab94-d18d-4145-a274-fefec5e08059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:55.249501 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dab94-d18d-4145-a274-fefec5e08059 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.249771 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dab94-d18d-4145-a274-fefec5e08059 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.250038 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dab94-d18d-4145-a274-fefec5e08059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.258997 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7dab94-d18d-4145-a274-fefec5e08059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:55.260399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7dab94-d18d-4145-a274-fefec5e08059 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:55.270470 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1184/2359] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:47:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:47:55.543743 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db332ce-6533-42f3-b803-f94d17b4abd5 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:55.545330 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-0db332ce-6533-42f3-b803-f94d17b4abd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:55.561215 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db332ce-6533-42f3-b803-f94d17b4abd5 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:55.565910 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07cfaad-f209-485e-8ed2-bd435dd68cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:55.566433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cfaad-f209-485e-8ed2-bd435dd68cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.566712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cfaad-f209-485e-8ed2-bd435dd68cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.566994 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07cfaad-f209-485e-8ed2-bd435dd68cb5 admin admin] PATH_INFO: `/v3/projects/9398c4ed20584593b68e99de8f6e8694` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.568199 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07cfaad-f209-485e-8ed2-bd435dd68cb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9398c4ed20584593b68e99de8f6e8694)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:55.570043 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07cfaad-f209-485e-8ed2-bd435dd68cb5 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:55.617481 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a07cfaad-f209-485e-8ed2-bd435dd68cb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9398c4ed20584593b68e99de8f6e8694', 'request_id': 'req-a07cfaad-f209-485e-8ed2-bd435dd68cb5'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:55.624574 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a07cfaad-f209-485e-8ed2-bd435dd68cb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9398c4ed20584593b68e99de8f6e8694', 'request_id': 'req-a07cfaad-f209-485e-8ed2-bd435dd68cb5'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:55.630979 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a07cfaad-f209-485e-8ed2-bd435dd68cb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9398c4ed20584593b68e99de8f6e8694', 'request_id': 'req-a07cfaad-f209-485e-8ed2-bd435dd68cb5'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:55.641895 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a07cfaad-f209-485e-8ed2-bd435dd68cb5 admin admin] The token cache is being invalidate because project 9398c4ed20584593b68e99de8f6e8694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:47:55.642181 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a07cfaad-f209-485e-8ed2-bd435dd68cb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:55.642809 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a07cfaad-f209-485e-8ed2-bd435dd68cb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:47:55.644276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1176/2360] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:47:55 2022] DELETE /identity/v3/projects/9398c4ed20584593b68e99de8f6e8694 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:55.649015 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dba8f6-a952-46c8-9c77-adbf919e67b5 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.649297 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dba8f6-a952-46c8-9c77-adbf919e67b5 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.649604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dba8f6-a952-46c8-9c77-adbf919e67b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.669243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-d7dba8f6-a952-46c8-9c77-adbf919e67b5 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:55.670517 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-d7dba8f6-a952-46c8-9c77-adbf919e67b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:55.728006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1185/2361] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:55.735560 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93a8bf-2723-4c27-8033-5a49278a28b1 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.735849 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93a8bf-2723-4c27-8033-5a49278a28b1 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.736133 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93a8bf-2723-4c27-8033-5a49278a28b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.756665 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-ed93a8bf-2723-4c27-8033-5a49278a28b1 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:55.757917 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ed93a8bf-2723-4c27-8033-5a49278a28b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:55.766385 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1177/2362] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:55.770458 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dba8f6-a952-46c8-9c77-adbf919e67b5 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:55.780804 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dba8f6-a952-46c8-9c77-adbf919e67b5 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:55.785388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29334b-7641-49f4-806f-ff4606caf6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:55.786027 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29334b-7641-49f4-806f-ff4606caf6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.786307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29334b-7641-49f4-806f-ff4606caf6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.786582 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29334b-7641-49f4-806f-ff4606caf6b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.787224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29334b-7641-49f4-806f-ff4606caf6b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:47:55.787531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29334b-7641-49f4-806f-ff4606caf6b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:55.789112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29334b-7641-49f4-806f-ff4606caf6b4 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:55.802432 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1186/2363] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:47:55.805669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93a8bf-2723-4c27-8033-5a49278a28b1 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:55.820021 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93a8bf-2723-4c27-8033-5a49278a28b1 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:55.825286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c17a1-c5b6-4241-bfe2-8173fb1caf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:55.825998 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c17a1-c5b6-4241-bfe2-8173fb1caf37 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.826302 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c17a1-c5b6-4241-bfe2-8173fb1caf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.826573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c17a1-c5b6-4241-bfe2-8173fb1caf37 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.827199 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c17a1-c5b6-4241-bfe2-8173fb1caf37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:55.829066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c17a1-c5b6-4241-bfe2-8173fb1caf37 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:55.861763 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1178/2364] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:47:55 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:47:55.862855 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29334b-7641-49f4-806f-ff4606caf6b4 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:55.873847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29334b-7641-49f4-806f-ff4606caf6b4 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:55.934651 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c155def-7767-4057-ab1f-0fce5ea1227b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:55.935212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c155def-7767-4057-ab1f-0fce5ea1227b admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.935633 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c155def-7767-4057-ab1f-0fce5ea1227b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.935907 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c155def-7767-4057-ab1f-0fce5ea1227b admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:55.936573 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c155def-7767-4057-ab1f-0fce5ea1227b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:55.938669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c155def-7767-4057-ab1f-0fce5ea1227b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:55.977658 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1187/2365] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:47:55 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:47:55.984716 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c17a1-c5b6-4241-bfe2-8173fb1caf37 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:55.992850 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c17a1-c5b6-4241-bfe2-8173fb1caf37 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:55.998152 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69280d5-44ba-4178-a0ae-03d9f4cc4740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:55.998908 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69280d5-44ba-4178-a0ae-03d9f4cc4740 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:55.999184 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69280d5-44ba-4178-a0ae-03d9f4cc4740 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:55.999593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69280d5-44ba-4178-a0ae-03d9f4cc4740 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:56.000302 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69280d5-44ba-4178-a0ae-03d9f4cc4740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:56.002050 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69280d5-44ba-4178-a0ae-03d9f4cc4740 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:56.012485 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1179/2366] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:47:56.016456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c155def-7767-4057-ab1f-0fce5ea1227b admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:56.026271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c155def-7767-4057-ab1f-0fce5ea1227b admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:56.031553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783477a-8471-4f5e-93ee-9b21624e3aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:56.032139 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783477a-8471-4f5e-93ee-9b21624e3aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:56.032413 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783477a-8471-4f5e-93ee-9b21624e3aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:56.032685 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783477a-8471-4f5e-93ee-9b21624e3aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:56.033308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783477a-8471-4f5e-93ee-9b21624e3aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:56.034942 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783477a-8471-4f5e-93ee-9b21624e3aa6 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:56.045831 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1188/2367] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:47:56.049806 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69280d5-44ba-4178-a0ae-03d9f4cc4740 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:56.059903 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69280d5-44ba-4178-a0ae-03d9f4cc4740 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:56.064439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1235c2-406f-40a2-8eb7-ee2d9c8052f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:56.065074 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1235c2-406f-40a2-8eb7-ee2d9c8052f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:56.065348 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1235c2-406f-40a2-8eb7-ee2d9c8052f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:56.065659 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1235c2-406f-40a2-8eb7-ee2d9c8052f6 admin admin] PATH_INFO: `/v3/projects/e198198be0e24fc9945654b05b88b1be/users/e936455baaf048a1b6011cf2fa86655d/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:56.080451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1235c2-406f-40a2-8eb7-ee2d9c8052f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e198198be0e24fc9945654b05b88b1be, user_id=e936455baaf048a1b6011cf2fa86655d, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:56.083175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1235c2-406f-40a2-8eb7-ee2d9c8052f6 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:56.096737 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1180/2368] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:47:56 2022] PUT /identity/v3/projects/e198198be0e24fc9945654b05b88b1be/users/e936455baaf048a1b6011cf2fa86655d/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:47:56.107874 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc35bb-b4f9-4086-bd11-937204850938 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:56.108153 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc35bb-b4f9-4086-bd11-937204850938 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:56.108424 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc35bb-b4f9-4086-bd11-937204850938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:56.137149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-16dc35bb-b4f9-4086-bd11-937204850938 None None] MFA Rules not processed for user `e936455baaf048a1b6011cf2fa86655d`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:47:56.138993 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-16dc35bb-b4f9-4086-bd11-937204850938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:56.169250 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:56.205039 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1189/2369] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:47:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:47:56.216896 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1235c2-406f-40a2-8eb7-ee2d9c8052f6 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:47:56.218636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-3f1235c2-406f-40a2-8eb7-ee2d9c8052f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:47:56.272103 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:56.286135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1235c2-406f-40a2-8eb7-ee2d9c8052f6 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:47:56.290006 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6da24-137d-4ee0-a2a2-facb61ff3f96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:47:56.290610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6da24-137d-4ee0-a2a2-facb61ff3f96 service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:47:56.290891 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6da24-137d-4ee0-a2a2-facb61ff3f96 service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:47:56.291164 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6da24-137d-4ee0-a2a2-facb61ff3f96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:47:56.299684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6da24-137d-4ee0-a2a2-facb61ff3f96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:47:56.301155 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6da24-137d-4ee0-a2a2-facb61ff3f96 service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:47:56.309900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1181/2370] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:47:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:48:03.521368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc35bb-b4f9-4086-bd11-937204850938 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:03.522882 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-16dc35bb-b4f9-4086-bd11-937204850938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:03.587197 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc35bb-b4f9-4086-bd11-937204850938 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:03.592346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84c1a9-9d64-4088-a198-4039549be6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:03.592970 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84c1a9-9d64-4088-a198-4039549be6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:03.593252 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84c1a9-9d64-4088-a198-4039549be6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:03.593802 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84c1a9-9d64-4088-a198-4039549be6f8 admin admin] PATH_INFO: `/v3/users/76e0d311d58e4897885876574c217dc2` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:03.594930 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84c1a9-9d64-4088-a198-4039549be6f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76e0d311d58e4897885876574c217dc2)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:03.596832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84c1a9-9d64-4088-a198-4039549be6f8 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:03.642115 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0c84c1a9-9d64-4088-a198-4039549be6f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76e0d311d58e4897885876574c217dc2'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:03.643720 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0c84c1a9-9d64-4088-a198-4039549be6f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76e0d311d58e4897885876574c217dc2'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:03.655928 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0c84c1a9-9d64-4088-a198-4039549be6f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76e0d311d58e4897885876574c217dc2'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:03.663624 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0c84c1a9-9d64-4088-a198-4039549be6f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76e0d311d58e4897885876574c217dc2'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:03.672386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0c84c1a9-9d64-4088-a198-4039549be6f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76e0d311d58e4897885876574c217dc2'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:03.678544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1190/2371] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:48:03 2022] DELETE /identity/v3/users/76e0d311d58e4897885876574c217dc2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:48:03.683215 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995312b8-19a6-4ac6-8d74-fd1cd0833624 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:03.683679 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995312b8-19a6-4ac6-8d74-fd1cd0833624 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:03.683810 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995312b8-19a6-4ac6-8d74-fd1cd0833624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:03.702639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-995312b8-19a6-4ac6-8d74-fd1cd0833624 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:03.703846 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-995312b8-19a6-4ac6-8d74-fd1cd0833624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:03.762884 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1182/2372] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:48:03.772659 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84c1a9-9d64-4088-a198-4039549be6f8 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:03.774121 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-0c84c1a9-9d64-4088-a198-4039549be6f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:03.827423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:03.831455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84c1a9-9d64-4088-a198-4039549be6f8 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:03.836573 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2eae90-9ac9-4734-9999-5a26f9eb020c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:03.837387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eae90-9ac9-4734-9999-5a26f9eb020c service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:03.837696 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eae90-9ac9-4734-9999-5a26f9eb020c service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:03.838181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2eae90-9ac9-4734-9999-5a26f9eb020c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:03.848754 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2eae90-9ac9-4734-9999-5a26f9eb020c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:03.850218 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2eae90-9ac9-4734-9999-5a26f9eb020c service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:03.860599 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1191/2373] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:48:04.126670 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995312b8-19a6-4ac6-8d74-fd1cd0833624 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:04.128209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-995312b8-19a6-4ac6-8d74-fd1cd0833624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:04.146938 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995312b8-19a6-4ac6-8d74-fd1cd0833624 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:04.156145 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda9503-535a-4958-8768-bd2af8e6fb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:04.156906 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda9503-535a-4958-8768-bd2af8e6fb8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:04.157130 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda9503-535a-4958-8768-bd2af8e6fb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:04.157436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda9503-535a-4958-8768-bd2af8e6fb8f admin admin] PATH_INFO: `/v3/projects/c1fe0878ef554c52af0b1870b68b80cd` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:04.164101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda9503-535a-4958-8768-bd2af8e6fb8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1fe0878ef554c52af0b1870b68b80cd)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:04.166042 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda9503-535a-4958-8768-bd2af8e6fb8f admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:04.237544 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-6fda9503-535a-4958-8768-bd2af8e6fb8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1fe0878ef554c52af0b1870b68b80cd', 'request_id': 'req-6fda9503-535a-4958-8768-bd2af8e6fb8f'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:04.249761 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-6fda9503-535a-4958-8768-bd2af8e6fb8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1fe0878ef554c52af0b1870b68b80cd', 'request_id': 'req-6fda9503-535a-4958-8768-bd2af8e6fb8f'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:04.257660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-6fda9503-535a-4958-8768-bd2af8e6fb8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1fe0878ef554c52af0b1870b68b80cd', 'request_id': 'req-6fda9503-535a-4958-8768-bd2af8e6fb8f'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:04.270325 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-6fda9503-535a-4958-8768-bd2af8e6fb8f admin admin] The token cache is being invalidate because project c1fe0878ef554c52af0b1870b68b80cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:48:04.270794 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-6fda9503-535a-4958-8768-bd2af8e6fb8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:04.272094 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-6fda9503-535a-4958-8768-bd2af8e6fb8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:04.273973 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1183/2374] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:48:04 2022] DELETE /identity/v3/projects/c1fe0878ef554c52af0b1870b68b80cd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:48:06.442648 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2eae90-9ac9-4734-9999-5a26f9eb020c service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:06.444085 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-4c2eae90-9ac9-4734-9999-5a26f9eb020c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:06.457721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2eae90-9ac9-4734-9999-5a26f9eb020c service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:06.516090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7665d5-c12b-4c88-b5e8-dee7121d60bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:06.516731 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7665d5-c12b-4c88-b5e8-dee7121d60bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:06.517011 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7665d5-c12b-4c88-b5e8-dee7121d60bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:06.517286 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7665d5-c12b-4c88-b5e8-dee7121d60bf admin admin] PATH_INFO: `/v3/users/e936455baaf048a1b6011cf2fa86655d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:06.518451 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7665d5-c12b-4c88-b5e8-dee7121d60bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e936455baaf048a1b6011cf2fa86655d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:06.520360 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7665d5-c12b-4c88-b5e8-dee7121d60bf admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:06.573966 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3b7665d5-c12b-4c88-b5e8-dee7121d60bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e936455baaf048a1b6011cf2fa86655d'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:06.575253 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3b7665d5-c12b-4c88-b5e8-dee7121d60bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e936455baaf048a1b6011cf2fa86655d'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:06.590258 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3b7665d5-c12b-4c88-b5e8-dee7121d60bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e936455baaf048a1b6011cf2fa86655d'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:06.598739 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3b7665d5-c12b-4c88-b5e8-dee7121d60bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e936455baaf048a1b6011cf2fa86655d'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:06.605984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3b7665d5-c12b-4c88-b5e8-dee7121d60bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e936455baaf048a1b6011cf2fa86655d'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:06.611917 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1192/2375] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:48:06 2022] DELETE /identity/v3/users/e936455baaf048a1b6011cf2fa86655d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:48:06.616371 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ef784-d473-40d8-bef3-bc0749e851b3 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:06.616844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ef784-d473-40d8-bef3-bc0749e851b3 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:06.616937 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ef784-d473-40d8-bef3-bc0749e851b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:06.636641 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-ec9ef784-d473-40d8-bef3-bc0749e851b3 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:06.638709 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ec9ef784-d473-40d8-bef3-bc0749e851b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:06.699139 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1184/2376] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:48:06.709505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7665d5-c12b-4c88-b5e8-dee7121d60bf admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:06.710940 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-3b7665d5-c12b-4c88-b5e8-dee7121d60bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:06.770151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7665d5-c12b-4c88-b5e8-dee7121d60bf admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:06.773864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54de5a-1a83-4125-8d6f-518876638f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:06.774463 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54de5a-1a83-4125-8d6f-518876638f58 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:06.774742 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54de5a-1a83-4125-8d6f-518876638f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:06.775015 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54de5a-1a83-4125-8d6f-518876638f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:06.784122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54de5a-1a83-4125-8d6f-518876638f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:06.785590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54de5a-1a83-4125-8d6f-518876638f58 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:06.795421 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1193/2377] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:48:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:48:07.062975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ef784-d473-40d8-bef3-bc0749e851b3 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:07.064431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ec9ef784-d473-40d8-bef3-bc0749e851b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:07.078569 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ef784-d473-40d8-bef3-bc0749e851b3 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:07.083529 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a6f55-a817-4203-89b4-1d204786b7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:07.084206 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a6f55-a817-4203-89b4-1d204786b7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:07.084505 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a6f55-a817-4203-89b4-1d204786b7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:07.084778 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a6f55-a817-4203-89b4-1d204786b7d3 admin admin] PATH_INFO: `/v3/projects/e198198be0e24fc9945654b05b88b1be` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:07.085960 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a6f55-a817-4203-89b4-1d204786b7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e198198be0e24fc9945654b05b88b1be)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:07.087905 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a6f55-a817-4203-89b4-1d204786b7d3 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:07.091230 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:07.141640 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-622a6f55-a817-4203-89b4-1d204786b7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e198198be0e24fc9945654b05b88b1be', 'request_id': 'req-622a6f55-a817-4203-89b4-1d204786b7d3'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:07.150270 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-622a6f55-a817-4203-89b4-1d204786b7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e198198be0e24fc9945654b05b88b1be', 'request_id': 'req-622a6f55-a817-4203-89b4-1d204786b7d3'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:07.162330 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-622a6f55-a817-4203-89b4-1d204786b7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e198198be0e24fc9945654b05b88b1be', 'request_id': 'req-622a6f55-a817-4203-89b4-1d204786b7d3'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:07.173451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-622a6f55-a817-4203-89b4-1d204786b7d3 admin admin] The token cache is being invalidate because project e198198be0e24fc9945654b05b88b1be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:48:07.173799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-622a6f55-a817-4203-89b4-1d204786b7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:07.174451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-622a6f55-a817-4203-89b4-1d204786b7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:07.175946 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1185/2378] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:48:07 2022] DELETE /identity/v3/projects/e198198be0e24fc9945654b05b88b1be => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:48:07.180749 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697a01e-7a53-4f59-93a2-611acced0717 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:07.181039 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697a01e-7a53-4f59-93a2-611acced0717 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:07.181319 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697a01e-7a53-4f59-93a2-611acced0717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:07.201532 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-4697a01e-7a53-4f59-93a2-611acced0717 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:07.202756 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-4697a01e-7a53-4f59-93a2-611acced0717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:07.211149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:07.265524 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1194/2379] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:48:07.274151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc33d5-dc5d-4ad4-9d21-e2b49c7bbe3a None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:07.274439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc33d5-dc5d-4ad4-9d21-e2b49c7bbe3a None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:07.274719 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc33d5-dc5d-4ad4-9d21-e2b49c7bbe3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:07.295395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-65bc33d5-dc5d-4ad4-9d21-e2b49c7bbe3a None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:07.296596 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-65bc33d5-dc5d-4ad4-9d21-e2b49c7bbe3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:07.304485 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1186/2380] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:48:07.308555 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697a01e-7a53-4f59-93a2-611acced0717 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:07.318404 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697a01e-7a53-4f59-93a2-611acced0717 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:07.323117 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bb86f-1415-4545-8dbe-8897a011cc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:07.323708 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bb86f-1415-4545-8dbe-8897a011cc9c admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:07.323989 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bb86f-1415-4545-8dbe-8897a011cc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:07.324316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bb86f-1415-4545-8dbe-8897a011cc9c admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:07.325449 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092bb86f-1415-4545-8dbe-8897a011cc9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:48:07.326034 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092bb86f-1415-4545-8dbe-8897a011cc9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:07.327788 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092bb86f-1415-4545-8dbe-8897a011cc9c admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:07.339187 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1195/2381] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:48:07.344149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc33d5-dc5d-4ad4-9d21-e2b49c7bbe3a None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:07.353484 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc33d5-dc5d-4ad4-9d21-e2b49c7bbe3a None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:07.358832 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edeea3-7031-4188-a085-26f6023fb16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:07.359428 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edeea3-7031-4188-a085-26f6023fb16f admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:07.359711 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edeea3-7031-4188-a085-26f6023fb16f admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:07.359980 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edeea3-7031-4188-a085-26f6023fb16f admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:07.360604 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edeea3-7031-4188-a085-26f6023fb16f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:07.362524 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edeea3-7031-4188-a085-26f6023fb16f admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:07.396472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1187/2382] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:48:07 2022] POST /identity/v3/projects => generated 397 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:48:07.400892 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bb86f-1415-4545-8dbe-8897a011cc9c admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:07.411644 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bb86f-1415-4545-8dbe-8897a011cc9c admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:07.467499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da7d3d-c918-4e1a-aed3-4ba02bda2936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:07.468145 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da7d3d-c918-4e1a-aed3-4ba02bda2936 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:07.468358 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da7d3d-c918-4e1a-aed3-4ba02bda2936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:07.468895 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da7d3d-c918-4e1a-aed3-4ba02bda2936 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:07.469534 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da7d3d-c918-4e1a-aed3-4ba02bda2936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:07.471427 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da7d3d-c918-4e1a-aed3-4ba02bda2936 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:07.495541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1196/2383] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:48:07 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:48:07.499749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edeea3-7031-4188-a085-26f6023fb16f admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:07.513812 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edeea3-7031-4188-a085-26f6023fb16f admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:07.518975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa3071-9db8-409c-b213-2df82d7ee9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:07.519501 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa3071-9db8-409c-b213-2df82d7ee9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:07.520233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa3071-9db8-409c-b213-2df82d7ee9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:07.520468 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa3071-9db8-409c-b213-2df82d7ee9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:07.521410 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa3071-9db8-409c-b213-2df82d7ee9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:07.524125 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fa3071-9db8-409c-b213-2df82d7ee9e1 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:07.539322 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1188/2384] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:48:07.543763 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da7d3d-c918-4e1a-aed3-4ba02bda2936 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:07.557690 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da7d3d-c918-4e1a-aed3-4ba02bda2936 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:07.562929 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a51ffa-a0e0-4678-b6e8-a9b6f58edd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:07.563537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a51ffa-a0e0-4678-b6e8-a9b6f58edd8f admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:07.563814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a51ffa-a0e0-4678-b6e8-a9b6f58edd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:07.564087 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a51ffa-a0e0-4678-b6e8-a9b6f58edd8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:07.564728 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a51ffa-a0e0-4678-b6e8-a9b6f58edd8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:07.566961 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a51ffa-a0e0-4678-b6e8-a9b6f58edd8f admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:07.580085 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1197/2385] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:48:07.585685 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa3071-9db8-409c-b213-2df82d7ee9e1 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:07.601455 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa3071-9db8-409c-b213-2df82d7ee9e1 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:07.608262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731236a0-6d08-42b9-812f-d603cc9ab878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:07.608939 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731236a0-6d08-42b9-812f-d603cc9ab878 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:07.609232 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731236a0-6d08-42b9-812f-d603cc9ab878 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:07.609543 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731236a0-6d08-42b9-812f-d603cc9ab878 admin admin] PATH_INFO: `/v3/projects/27e5c04153154c8484850ed7dc6f4e30/users/6109aa6039744fcb9938741d00dcc023/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:07.627771 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731236a0-6d08-42b9-812f-d603cc9ab878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27e5c04153154c8484850ed7dc6f4e30, user_id=6109aa6039744fcb9938741d00dcc023, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:07.630629 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731236a0-6d08-42b9-812f-d603cc9ab878 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:07.651643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1189/2386] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:48:07 2022] PUT /identity/v3/projects/27e5c04153154c8484850ed7dc6f4e30/users/6109aa6039744fcb9938741d00dcc023/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:48:07.667339 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed04a50-b45f-4460-8a18-0b87956dc330 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:07.667339 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed04a50-b45f-4460-8a18-0b87956dc330 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:07.667339 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed04a50-b45f-4460-8a18-0b87956dc330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:07.703995 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-5ed04a50-b45f-4460-8a18-0b87956dc330 None None] MFA Rules not processed for user `6109aa6039744fcb9938741d00dcc023`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:07.705216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-5ed04a50-b45f-4460-8a18-0b87956dc330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:07.781587 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1198/2387] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:48:07 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:48:07.793751 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731236a0-6d08-42b9-812f-d603cc9ab878 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:07.795560 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-731236a0-6d08-42b9-812f-d603cc9ab878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:07.865142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731236a0-6d08-42b9-812f-d603cc9ab878 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:07.868945 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853a5b2-f72d-42b4-9be0-c3720a3d4283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:07.869733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853a5b2-f72d-42b4-9be0-c3720a3d4283 service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:07.870223 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853a5b2-f72d-42b4-9be0-c3720a3d4283 service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:07.870672 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853a5b2-f72d-42b4-9be0-c3720a3d4283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:07.881737 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1853a5b2-f72d-42b4-9be0-c3720a3d4283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:07.883661 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1853a5b2-f72d-42b4-9be0-c3720a3d4283 service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:07.895439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1190/2388] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:48:07 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:48:12.946443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed04a50-b45f-4460-8a18-0b87956dc330 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:12.956644 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:13.017565 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed04a50-b45f-4460-8a18-0b87956dc330 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:13.022415 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb593834-1280-4ce9-a01c-e8b7a9ef9990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:13.023043 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb593834-1280-4ce9-a01c-e8b7a9ef9990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:13.023330 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb593834-1280-4ce9-a01c-e8b7a9ef9990 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:13.023598 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb593834-1280-4ce9-a01c-e8b7a9ef9990 admin admin] PATH_INFO: `/v3/users/6109aa6039744fcb9938741d00dcc023` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:13.024712 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb593834-1280-4ce9-a01c-e8b7a9ef9990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6109aa6039744fcb9938741d00dcc023)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:13.026650 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb593834-1280-4ce9-a01c-e8b7a9ef9990 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:13.072559 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-cb593834-1280-4ce9-a01c-e8b7a9ef9990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6109aa6039744fcb9938741d00dcc023'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:13.073236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-cb593834-1280-4ce9-a01c-e8b7a9ef9990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6109aa6039744fcb9938741d00dcc023'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:13.086870 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-cb593834-1280-4ce9-a01c-e8b7a9ef9990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6109aa6039744fcb9938741d00dcc023'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:13.097015 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-cb593834-1280-4ce9-a01c-e8b7a9ef9990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6109aa6039744fcb9938741d00dcc023'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:13.106118 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-cb593834-1280-4ce9-a01c-e8b7a9ef9990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6109aa6039744fcb9938741d00dcc023'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:13.112122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1199/2389] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:48:12 2022] DELETE /identity/v3/users/6109aa6039744fcb9938741d00dcc023 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:48:13.116624 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16234bf-273e-471c-a4b4-91ef07ab01b6 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:13.117100 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16234bf-273e-471c-a4b4-91ef07ab01b6 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:13.117223 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16234bf-273e-471c-a4b4-91ef07ab01b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:13.138873 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-d16234bf-273e-471c-a4b4-91ef07ab01b6 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:13.140146 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-d16234bf-273e-471c-a4b4-91ef07ab01b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:13.166707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:13.202249 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1191/2390] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:48:13.211831 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb593834-1280-4ce9-a01c-e8b7a9ef9990 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:13.213226 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-cb593834-1280-4ce9-a01c-e8b7a9ef9990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:13.271849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb593834-1280-4ce9-a01c-e8b7a9ef9990 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:13.275488 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743c29f-8305-4290-84b4-bd551435ed04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:13.276089 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743c29f-8305-4290-84b4-bd551435ed04 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:13.276366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743c29f-8305-4290-84b4-bd551435ed04 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:13.276638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743c29f-8305-4290-84b4-bd551435ed04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:13.285986 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743c29f-8305-4290-84b4-bd551435ed04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:13.287560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743c29f-8305-4290-84b4-bd551435ed04 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:13.297606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1200/2391] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:48:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:48:13.655326 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16234bf-273e-471c-a4b4-91ef07ab01b6 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:13.656851 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-d16234bf-273e-471c-a4b4-91ef07ab01b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:13.670647 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16234bf-273e-471c-a4b4-91ef07ab01b6 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:13.677033 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b471ad-1743-4e58-9b8c-9fe483dfa589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:13.677848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b471ad-1743-4e58-9b8c-9fe483dfa589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:13.678195 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b471ad-1743-4e58-9b8c-9fe483dfa589 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:13.678547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b471ad-1743-4e58-9b8c-9fe483dfa589 admin admin] PATH_INFO: `/v3/projects/27e5c04153154c8484850ed7dc6f4e30` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:13.679833 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b471ad-1743-4e58-9b8c-9fe483dfa589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27e5c04153154c8484850ed7dc6f4e30)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:13.682139 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b471ad-1743-4e58-9b8c-9fe483dfa589 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:13.736010 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c1b471ad-1743-4e58-9b8c-9fe483dfa589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27e5c04153154c8484850ed7dc6f4e30', 'request_id': 'req-c1b471ad-1743-4e58-9b8c-9fe483dfa589'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:13.743803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c1b471ad-1743-4e58-9b8c-9fe483dfa589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27e5c04153154c8484850ed7dc6f4e30', 'request_id': 'req-c1b471ad-1743-4e58-9b8c-9fe483dfa589'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:13.750823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c1b471ad-1743-4e58-9b8c-9fe483dfa589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27e5c04153154c8484850ed7dc6f4e30', 'request_id': 'req-c1b471ad-1743-4e58-9b8c-9fe483dfa589'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:13.760788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c1b471ad-1743-4e58-9b8c-9fe483dfa589 admin admin] The token cache is being invalidate because project 27e5c04153154c8484850ed7dc6f4e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:48:13.761072 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c1b471ad-1743-4e58-9b8c-9fe483dfa589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:13.762272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c1b471ad-1743-4e58-9b8c-9fe483dfa589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:48:13.764030 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1192/2392] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:48:13 2022] DELETE /identity/v3/projects/27e5c04153154c8484850ed7dc6f4e30 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:48:23.293206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=75,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:23.757784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:32.236222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecce35a-47f5-4286-aa6a-5b624ff40d9d None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:32.236726 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecce35a-47f5-4286-aa6a-5b624ff40d9d None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:32.236826 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecce35a-47f5-4286-aa6a-5b624ff40d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:32.255961 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-eecce35a-47f5-4286-aa6a-5b624ff40d9d None None] MFA Rules not processed for user `3ae62427d5914e67b5b4d0237ecccd06`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:32.257159 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-eecce35a-47f5-4286-aa6a-5b624ff40d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:32.314672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1201/2393] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 09:48:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:48:32.365040 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b471ad-1743-4e58-9b8c-9fe483dfa589 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:32.366354 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-c1b471ad-1743-4e58-9b8c-9fe483dfa589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:32.439524 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b471ad-1743-4e58-9b8c-9fe483dfa589 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:32.444883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14154df6-0c39-44c3-ab70-def562d5017f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2db35b94c84ec7bba96117d23baf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:32.445515 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14154df6-0c39-44c3-ab70-def562d5017f service swift] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:32.445799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14154df6-0c39-44c3-ab70-def562d5017f service swift] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:32.446073 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14154df6-0c39-44c3-ab70-def562d5017f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:32.455054 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14154df6-0c39-44c3-ab70-def562d5017f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:32.456618 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14154df6-0c39-44c3-ab70-def562d5017f service swift] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:32.465768 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1193/2394] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 09:48:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:48:42.307983 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=25 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:42.461862 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=32 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:48.753797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecce35a-47f5-4286-aa6a-5b624ff40d9d None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:48.755234 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-eecce35a-47f5-4286-aa6a-5b624ff40d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:48.825736 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecce35a-47f5-4286-aa6a-5b624ff40d9d None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:48.830742 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbf364-4143-4101-abc4-93abd10c1583 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983e364f5564ed7854dff06a80f55d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:48.831348 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbf364-4143-4101-abc4-93abd10c1583 service placement] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:48.831629 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbf364-4143-4101-abc4-93abd10c1583 service placement] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:48.831905 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbf364-4143-4101-abc4-93abd10c1583 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:48.833675 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-5fcbf364-4143-4101-abc4-93abd10c1583 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:48.845292 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbf364-4143-4101-abc4-93abd10c1583 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:48.846896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbf364-4143-4101-abc4-93abd10c1583 service placement] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:48.859430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1202/2395] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:48:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:48:49.799775 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d38e11-7159-4e0c-97f5-fa12f25bc6ff None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:49.800317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d38e11-7159-4e0c-97f5-fa12f25bc6ff None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:49.800317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d38e11-7159-4e0c-97f5-fa12f25bc6ff None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:49.801749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1194/2396] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 09:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:49.807190 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e27f03-7bd4-4619-8c25-fac6fbca0a00 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:49.808055 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e27f03-7bd4-4619-8c25-fac6fbca0a00 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:49.808333 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e27f03-7bd4-4619-8c25-fac6fbca0a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:49.956047 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-04e27f03-7bd4-4619-8c25-fac6fbca0a00 None None] MFA Rules not processed for user `18be8c54c9644c5e9812eea09e60c11c`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:49.957324 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-04e27f03-7bd4-4619-8c25-fac6fbca0a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:50.027809 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1203/2397] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 09:48:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:48:50.039664 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d38e11-7159-4e0c-97f5-fa12f25bc6ff None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:50.041601 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-68d38e11-7159-4e0c-97f5-fa12f25bc6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:50.104395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d38e11-7159-4e0c-97f5-fa12f25bc6ff None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:50.108373 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3184e-7dce-4cfe-84f9-cd4fd66d5785 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51fe6dfa43d04cdeb0421d2613c8c2ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:50.108985 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3184e-7dce-4cfe-84f9-cd4fd66d5785 service glance] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:50.109267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3184e-7dce-4cfe-84f9-cd4fd66d5785 service glance] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:50.109580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3184e-7dce-4cfe-84f9-cd4fd66d5785 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:50.121897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3184e-7dce-4cfe-84f9-cd4fd66d5785 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:50.123353 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3184e-7dce-4cfe-84f9-cd4fd66d5785 service glance] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:50.134487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1195/2398] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:48:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:48:50.215485 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17404638-d715-4716-b429-453a3b3195bf None None] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:50.215764 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17404638-d715-4716-b429-453a3b3195bf None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:50.216036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17404638-d715-4716-b429-453a3b3195bf None None] PATH_INFO: `/` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:50.217374 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1204/2399] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 09:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:50.222251 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c87021-1898-4a03-94fe-fc964d660f8b None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:50.222537 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c87021-1898-4a03-94fe-fc964d660f8b None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:50.222811 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c87021-1898-4a03-94fe-fc964d660f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:50.243249 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-48c87021-1898-4a03-94fe-fc964d660f8b None None] MFA Rules not processed for user `7847dbf8f31146c5ab2136fbdb487783`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:50.244548 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-48c87021-1898-4a03-94fe-fc964d660f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:50.300515 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1196/2400] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 09:48:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:48:50.312873 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17404638-d715-4716-b429-453a3b3195bf None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:50.316275 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-17404638-d715-4716-b429-453a3b3195bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:50.328466 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17404638-d715-4716-b429-453a3b3195bf None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:50.331956 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb6fa2-8b9f-4d30-8288-a61a9074d170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:50.332543 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb6fa2-8b9f-4d30-8288-a61a9074d170 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:50.332817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb6fa2-8b9f-4d30-8288-a61a9074d170 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:50.333081 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb6fa2-8b9f-4d30-8288-a61a9074d170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:50.340913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb6fa2-8b9f-4d30-8288-a61a9074d170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:50.342349 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb6fa2-8b9f-4d30-8288-a61a9074d170 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:50.351137 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1205/2401] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:48:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:48:50.446934 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1399eb7-e3dd-4bc4-8fea-a5816961c8a5 None None] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:50.447240 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1399eb7-e3dd-4bc4-8fea-a5816961c8a5 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:50.447704 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1399eb7-e3dd-4bc4-8fea-a5816961c8a5 None None] PATH_INFO: `/` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:50.450246 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1197/2402] 10.222.0.58 () {54 vars in 921 bytes} [Wed Aug 24 09:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 09:48:50.455642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7092e-54d3-4b86-a14d-24d5770d7a33 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:50.455920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7092e-54d3-4b86-a14d-24d5770d7a33 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:50.456224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7092e-54d3-4b86-a14d-24d5770d7a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:50.476302 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-b3c7092e-54d3-4b86-a14d-24d5770d7a33 None None] MFA Rules not processed for user `18be8c54c9644c5e9812eea09e60c11c`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:50.477532 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-b3c7092e-54d3-4b86-a14d-24d5770d7a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:50.489729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1206/2403] 10.222.0.58 () {58 vars in 1018 bytes} [Wed Aug 24 09:48:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:48:50.505780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1399eb7-e3dd-4bc4-8fea-a5816961c8a5 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:50.518449 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1399eb7-e3dd-4bc4-8fea-a5816961c8a5 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:50.522266 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cc09a-9c39-4e32-9768-80e6d76513a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:50.523015 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cc09a-9c39-4e32-9768-80e6d76513a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:50.523458 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cc09a-9c39-4e32-9768-80e6d76513a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:50.523739 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cc09a-9c39-4e32-9768-80e6d76513a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:50.535710 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cc09a-9c39-4e32-9768-80e6d76513a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:50.537529 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cc09a-9c39-4e32-9768-80e6d76513a3 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:50.554662 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1198/2404] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:48:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:48:52.879707 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0341062-b06f-45b7-a053-0b98bac5efbd None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:52.880171 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0341062-b06f-45b7-a053-0b98bac5efbd None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:52.880261 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0341062-b06f-45b7-a053-0b98bac5efbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:52.899137 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-a0341062-b06f-45b7-a053-0b98bac5efbd None None] MFA Rules not processed for user `3ae62427d5914e67b5b4d0237ecccd06`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:48:52.900770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a0341062-b06f-45b7-a053-0b98bac5efbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:48:52.909497 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1207/2405] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 09:48:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:48:52.922207 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cc09a-9c39-4e32-9768-80e6d76513a3 service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:48:52.933484 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cc09a-9c39-4e32-9768-80e6d76513a3 service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:48:52.938453 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab14876-b33b-40bc-8fc4-fe991f7c689d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2db35b94c84ec7bba96117d23baf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:48:52.939052 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab14876-b33b-40bc-8fc4-fe991f7c689d service swift] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:48:52.939320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab14876-b33b-40bc-8fc4-fe991f7c689d service swift] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:48:52.939592 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab14876-b33b-40bc-8fc4-fe991f7c689d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:48:52.947847 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab14876-b33b-40bc-8fc4-fe991f7c689d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:48:52.949418 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab14876-b33b-40bc-8fc4-fe991f7c689d service swift] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:48:52.957412 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1199/2406] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 09:48:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:49:02.894624 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=75 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:02.954348 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=61 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:18.194764 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f1863-f2b1-4b24-ba6b-59fe8c356931 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:18.195326 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f1863-f2b1-4b24-ba6b-59fe8c356931 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:18.195326 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f1863-f2b1-4b24-ba6b-59fe8c356931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:18.213941 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-433f1863-f2b1-4b24-ba6b-59fe8c356931 None None] MFA Rules not processed for user `3ae62427d5914e67b5b4d0237ecccd06`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:49:18.215106 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-433f1863-f2b1-4b24-ba6b-59fe8c356931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:49:18.226284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1208/2407] 10.222.0.58 () {58 vars in 967 bytes} [Wed Aug 24 09:49:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:49:18.235028 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab14876-b33b-40bc-8fc4-fe991f7c689d service swift] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:49:18.247458 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab14876-b33b-40bc-8fc4-fe991f7c689d service swift] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:49:18.252647 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0c433-09c9-4dc7-a513-21ba316a7d71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2db35b94c84ec7bba96117d23baf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:49:18.253253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0c433-09c9-4dc7-a513-21ba316a7d71 service swift] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:18.253563 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0c433-09c9-4dc7-a513-21ba316a7d71 service swift] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:18.253841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0c433-09c9-4dc7-a513-21ba316a7d71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:18.262949 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0c433-09c9-4dc7-a513-21ba316a7d71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:49:18.264534 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0c433-09c9-4dc7-a513-21ba316a7d71 service swift] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:49:18.273188 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1200/2408] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 09:49:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 09:49:28.209208 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:28.269962 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=6 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:36.919660 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d775c-6945-45c9-8518-493002decd59 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:36.920154 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d775c-6945-45c9-8518-493002decd59 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:36.920264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d775c-6945-45c9-8518-493002decd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:36.939781 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-247d775c-6945-45c9-8518-493002decd59 None None] MFA Rules not processed for user `f197b03d644e4176bf6a0800aae31b4d`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:49:36.940965 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-247d775c-6945-45c9-8518-493002decd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:49:36.994320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1209/2409] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:49:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:49:46.987134 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=25 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:54.572782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0c433-09c9-4dc7-a513-21ba316a7d71 service swift] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:49:54.583352 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0c433-09c9-4dc7-a513-21ba316a7d71 service swift] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:49:54.587118 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82bcca-446f-456e-b36c-b97a882fee72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:49:54.587803 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82bcca-446f-456e-b36c-b97a882fee72 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:54.588173 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82bcca-446f-456e-b36c-b97a882fee72 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:54.588505 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82bcca-446f-456e-b36c-b97a882fee72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:54.590545 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-bb82bcca-446f-456e-b36c-b97a882fee72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:49:54.608526 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82bcca-446f-456e-b36c-b97a882fee72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:49:54.610054 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82bcca-446f-456e-b36c-b97a882fee72 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:49:54.623372 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1201/2410] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:49:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:49:55.805004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d775c-6945-45c9-8518-493002decd59 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:49:55.806417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-247d775c-6945-45c9-8518-493002decd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:49:55.818115 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d775c-6945-45c9-8518-493002decd59 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:49:55.822128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9aec0-3415-45f2-a4f8-4cd3b731ed97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:49:55.822713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9aec0-3415-45f2-a4f8-4cd3b731ed97 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:49:55.822984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9aec0-3415-45f2-a4f8-4cd3b731ed97 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:49:55.823252 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9aec0-3415-45f2-a4f8-4cd3b731ed97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:49:55.824896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-24b9aec0-3415-45f2-a4f8-4cd3b731ed97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:49:55.838292 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9aec0-3415-45f2-a4f8-4cd3b731ed97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:49:55.839680 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9aec0-3415-45f2-a4f8-4cd3b731ed97 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:49:55.850544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1210/2411] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:49:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:50:04.617481 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=6 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:05.845893 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=6 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:23.411110 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82bcca-446f-456e-b36c-b97a882fee72 service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:23.412800 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-bb82bcca-446f-456e-b36c-b97a882fee72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:23.426529 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82bcca-446f-456e-b36c-b97a882fee72 service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:23.432332 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b48347-cdc7-435d-8b4c-a77d12981656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:23.432958 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b48347-cdc7-435d-8b4c-a77d12981656 service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:23.433241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b48347-cdc7-435d-8b4c-a77d12981656 service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:23.433547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b48347-cdc7-435d-8b4c-a77d12981656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:23.435265 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-20b48347-cdc7-435d-8b4c-a77d12981656 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:23.492944 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b48347-cdc7-435d-8b4c-a77d12981656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:23.494587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b48347-cdc7-435d-8b4c-a77d12981656 service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:23.503495 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1202/2412] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:50:23 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:50:32.197529 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caf099-5b16-48f9-b4d2-80e8826ef80a None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:32.198061 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caf099-5b16-48f9-b4d2-80e8826ef80a None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:32.198179 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caf099-5b16-48f9-b4d2-80e8826ef80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:32.222973 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-60caf099-5b16-48f9-b4d2-80e8826ef80a None None] MFA Rules not processed for user `6a42998888a34c099624c08e64013a13`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:50:32.224739 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-60caf099-5b16-48f9-b4d2-80e8826ef80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:32.231908 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1211/2413] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:50:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:50:32.542836 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b48347-cdc7-435d-8b4c-a77d12981656 service nova] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:32.552660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b48347-cdc7-435d-8b4c-a77d12981656 service nova] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:32.556267 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b3408-1572-437d-a915-8b79afc0317a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:32.556863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b3408-1572-437d-a915-8b79afc0317a service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:32.557145 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b3408-1572-437d-a915-8b79afc0317a service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:32.557423 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b3408-1572-437d-a915-8b79afc0317a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:32.559181 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-d42b3408-1572-437d-a915-8b79afc0317a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:32.568820 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b3408-1572-437d-a915-8b79afc0317a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:32.570334 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b3408-1572-437d-a915-8b79afc0317a service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:32.578265 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1203/2414] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:50:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:50:32.896370 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60caf099-5b16-48f9-b4d2-80e8826ef80a None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:32.908770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60caf099-5b16-48f9-b4d2-80e8826ef80a None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:32.914641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459312c5-7d47-4635-99db-1b363465e689 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983e364f5564ed7854dff06a80f55d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:32.915261 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459312c5-7d47-4635-99db-1b363465e689 service placement] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:32.915537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459312c5-7d47-4635-99db-1b363465e689 service placement] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:32.915812 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459312c5-7d47-4635-99db-1b363465e689 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:32.917597 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-459312c5-7d47-4635-99db-1b363465e689 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:32.930114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459312c5-7d47-4635-99db-1b363465e689 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:32.931686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459312c5-7d47-4635-99db-1b363465e689 service placement] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:32.941968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1212/2415] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:50:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:50:34.865656 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b3408-1572-437d-a915-8b79afc0317a service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:34.876210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b3408-1572-437d-a915-8b79afc0317a service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:34.880928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac6beb-445c-4633-bb2b-6fd27a93d9b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:34.881568 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac6beb-445c-4633-bb2b-6fd27a93d9b2 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:34.882094 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac6beb-445c-4633-bb2b-6fd27a93d9b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:34.882369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac6beb-445c-4633-bb2b-6fd27a93d9b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:34.884189 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-a6ac6beb-445c-4633-bb2b-6fd27a93d9b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:34.896546 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac6beb-445c-4633-bb2b-6fd27a93d9b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:34.898242 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac6beb-445c-4633-bb2b-6fd27a93d9b2 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:34.907493 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1204/2416] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:50:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:50:35.550585 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459312c5-7d47-4635-99db-1b363465e689 service placement] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:35.552823 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-459312c5-7d47-4635-99db-1b363465e689 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:35.571459 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459312c5-7d47-4635-99db-1b363465e689 service placement] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:35.577103 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31deb2dc-2770-416d-8554-5133c3000569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:35.577826 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31deb2dc-2770-416d-8554-5133c3000569 service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:35.578110 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31deb2dc-2770-416d-8554-5133c3000569 service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:35.578385 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31deb2dc-2770-416d-8554-5133c3000569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:35.580154 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-31deb2dc-2770-416d-8554-5133c3000569 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:35.594622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31deb2dc-2770-416d-8554-5133c3000569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:35.596362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31deb2dc-2770-416d-8554-5133c3000569 service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:35.608423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1213/2417] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:50:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:50:41.938505 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac6beb-445c-4633-bb2b-6fd27a93d9b2 service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:41.954257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac6beb-445c-4633-bb2b-6fd27a93d9b2 service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:41.960907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a3975-88f3-4c47-8406-3efc310565bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:41.961800 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a3975-88f3-4c47-8406-3efc310565bf service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:41.962311 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a3975-88f3-4c47-8406-3efc310565bf service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:41.962863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a3975-88f3-4c47-8406-3efc310565bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:41.964849 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-fd8a3975-88f3-4c47-8406-3efc310565bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:41.979676 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a3975-88f3-4c47-8406-3efc310565bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:41.981377 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a3975-88f3-4c47-8406-3efc310565bf service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:41.993921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1205/2418] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:50:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:50:45.603805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=15 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:47.503997 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31deb2dc-2770-416d-8554-5133c3000569 service nova] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:47.506222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-31deb2dc-2770-416d-8554-5133c3000569 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:47.561541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31deb2dc-2770-416d-8554-5133c3000569 service nova] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:47.565086 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39954a2a-5dc6-4596-b0f4-272c73435020 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:47.565713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39954a2a-5dc6-4596-b0f4-272c73435020 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:47.565991 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39954a2a-5dc6-4596-b0f4-272c73435020 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:47.566259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39954a2a-5dc6-4596-b0f4-272c73435020 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:47.568482 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-39954a2a-5dc6-4596-b0f4-272c73435020 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:47.579072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39954a2a-5dc6-4596-b0f4-272c73435020 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:47.580459 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39954a2a-5dc6-4596-b0f4-272c73435020 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:47.589843 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1214/2419] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:50:47 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:50:51.989601 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=46 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:54.421451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a3975-88f3-4c47-8406-3efc310565bf service nova] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:50:54.423059 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-fd8a3975-88f3-4c47-8406-3efc310565bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:54.444547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a3975-88f3-4c47-8406-3efc310565bf service nova] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:50:54.449614 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d5454-1d7e-4736-97b3-81e3a7f25e37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:50:54.450402 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d5454-1d7e-4736-97b3-81e3a7f25e37 service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:50:54.450864 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d5454-1d7e-4736-97b3-81e3a7f25e37 service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:50:54.451306 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d5454-1d7e-4736-97b3-81e3a7f25e37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:50:54.453611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-2a9d5454-1d7e-4736-97b3-81e3a7f25e37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:50:54.525546 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d5454-1d7e-4736-97b3-81e3a7f25e37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:50:54.527763 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d5454-1d7e-4736-97b3-81e3a7f25e37 service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:50:54.541061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1206/2420] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:50:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:50:57.586338 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=26 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:01.446264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439941c5-bd08-49a9-a752-813cf394a6a2 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:01.446914 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439941c5-bd08-49a9-a752-813cf394a6a2 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:01.446914 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439941c5-bd08-49a9-a752-813cf394a6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:01.465311 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-439941c5-bd08-49a9-a752-813cf394a6a2 None None] MFA Rules not processed for user `1b1b38b0aa504cd1ac7e851be5b6e266`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:01.466985 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-439941c5-bd08-49a9-a752-813cf394a6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:01.474391 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1215/2421] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:01.784643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d5454-1d7e-4736-97b3-81e3a7f25e37 service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:01.794391 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d5454-1d7e-4736-97b3-81e3a7f25e37 service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:01.797959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73ecab-cd55-421b-958c-0953ecfaffdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:01.798564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73ecab-cd55-421b-958c-0953ecfaffdc service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:01.798840 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73ecab-cd55-421b-958c-0953ecfaffdc service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:01.799211 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73ecab-cd55-421b-958c-0953ecfaffdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:01.801062 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-9f73ecab-cd55-421b-958c-0953ecfaffdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:01.810711 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f73ecab-cd55-421b-958c-0953ecfaffdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:01.812107 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f73ecab-cd55-421b-958c-0953ecfaffdc service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:01.820930 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1207/2422] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:51:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:51:07.220909 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439941c5-bd08-49a9-a752-813cf394a6a2 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:07.247149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439941c5-bd08-49a9-a752-813cf394a6a2 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:07.253224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a74020-13e4-4305-95d0-349b7cc40700 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:07.254188 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74020-13e4-4305-95d0-349b7cc40700 service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:07.254697 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74020-13e4-4305-95d0-349b7cc40700 service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:07.255205 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74020-13e4-4305-95d0-349b7cc40700 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:07.257181 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-29a74020-13e4-4305-95d0-349b7cc40700 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:07.271262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a74020-13e4-4305-95d0-349b7cc40700 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:07.272747 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a74020-13e4-4305-95d0-349b7cc40700 service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:07.284906 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1216/2423] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:51:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:51:11.133170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73ecab-cd55-421b-958c-0953ecfaffdc service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:11.141889 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73ecab-cd55-421b-958c-0953ecfaffdc service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:11.145762 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c373e1-e0c0-4020-8ac0-08a3037e5b97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:11.146360 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c373e1-e0c0-4020-8ac0-08a3037e5b97 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:11.146639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c373e1-e0c0-4020-8ac0-08a3037e5b97 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:11.146913 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c373e1-e0c0-4020-8ac0-08a3037e5b97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:11.148631 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-11c373e1-e0c0-4020-8ac0-08a3037e5b97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:11.211571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c373e1-e0c0-4020-8ac0-08a3037e5b97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:11.212992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c373e1-e0c0-4020-8ac0-08a3037e5b97 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:11.223398 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1208/2424] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:51:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:51:14.569873 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a74020-13e4-4305-95d0-349b7cc40700 service nova] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:14.571843 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-29a74020-13e4-4305-95d0-349b7cc40700 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:14.588829 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a74020-13e4-4305-95d0-349b7cc40700 service nova] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:14.593985 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d77ed-6cb3-49e1-8172-c5018b959ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:14.594621 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d77ed-6cb3-49e1-8172-c5018b959ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:14.595085 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d77ed-6cb3-49e1-8172-c5018b959ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:14.595534 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d77ed-6cb3-49e1-8172-c5018b959ec6 admin admin] PATH_INFO: `/v3/users/f197b03d644e4176bf6a0800aae31b4d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:14.596867 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d77ed-6cb3-49e1-8172-c5018b959ec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f197b03d644e4176bf6a0800aae31b4d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:14.598848 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d77ed-6cb3-49e1-8172-c5018b959ec6 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:14.657945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-f42d77ed-6cb3-49e1-8172-c5018b959ec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f197b03d644e4176bf6a0800aae31b4d'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:14.658764 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-f42d77ed-6cb3-49e1-8172-c5018b959ec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f197b03d644e4176bf6a0800aae31b4d'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:14.672089 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-f42d77ed-6cb3-49e1-8172-c5018b959ec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f197b03d644e4176bf6a0800aae31b4d'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:14.679840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-f42d77ed-6cb3-49e1-8172-c5018b959ec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f197b03d644e4176bf6a0800aae31b4d'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:14.688457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-f42d77ed-6cb3-49e1-8172-c5018b959ec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f197b03d644e4176bf6a0800aae31b4d'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:14.695599 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1217/2425] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:51:14 2022] DELETE /identity/v3/users/f197b03d644e4176bf6a0800aae31b4d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:14.870743 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c373e1-e0c0-4020-8ac0-08a3037e5b97 service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:14.884455 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c373e1-e0c0-4020-8ac0-08a3037e5b97 service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:14.945417 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f99af-ce68-430b-a957-a5ceb69dfbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:14.946076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f99af-ce68-430b-a957-a5ceb69dfbbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:14.946356 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f99af-ce68-430b-a957-a5ceb69dfbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:14.946633 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f99af-ce68-430b-a957-a5ceb69dfbbe admin admin] PATH_INFO: `/v3/projects/6610b09646374657aef5dfe84929577e` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:14.947745 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f99af-ce68-430b-a957-a5ceb69dfbbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6610b09646374657aef5dfe84929577e)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:14.949676 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f99af-ce68-430b-a957-a5ceb69dfbbe admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:14.973437 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:14.996390 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b52f99af-ce68-430b-a957-a5ceb69dfbbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6610b09646374657aef5dfe84929577e', 'request_id': 'req-b52f99af-ce68-430b-a957-a5ceb69dfbbe'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:15.004384 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b52f99af-ce68-430b-a957-a5ceb69dfbbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6610b09646374657aef5dfe84929577e', 'request_id': 'req-b52f99af-ce68-430b-a957-a5ceb69dfbbe'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:15.010644 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b52f99af-ce68-430b-a957-a5ceb69dfbbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6610b09646374657aef5dfe84929577e', 'request_id': 'req-b52f99af-ce68-430b-a957-a5ceb69dfbbe'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:15.020789 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b52f99af-ce68-430b-a957-a5ceb69dfbbe admin admin] The token cache is being invalidate because project 6610b09646374657aef5dfe84929577e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:51:15.021077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b52f99af-ce68-430b-a957-a5ceb69dfbbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:15.021743 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b52f99af-ce68-430b-a957-a5ceb69dfbbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:15.023278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1209/2426] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:51:14 2022] DELETE /identity/v3/projects/6610b09646374657aef5dfe84929577e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:15.028152 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea5f57-f0d6-4d4b-9b64-ccdfbd29d31b None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:15.028443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea5f57-f0d6-4d4b-9b64-ccdfbd29d31b None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:15.028722 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea5f57-f0d6-4d4b-9b64-ccdfbd29d31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:15.048150 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-80ea5f57-f0d6-4d4b-9b64-ccdfbd29d31b None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:15.049376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-80ea5f57-f0d6-4d4b-9b64-ccdfbd29d31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:15.107847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1218/2427] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:15.115565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c74e4e-5ee5-41cd-9b8c-612abb7a3aa4 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:15.115847 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c74e4e-5ee5-41cd-9b8c-612abb7a3aa4 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:15.116149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c74e4e-5ee5-41cd-9b8c-612abb7a3aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:15.136118 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-53c74e4e-5ee5-41cd-9b8c-612abb7a3aa4 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:15.137351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-53c74e4e-5ee5-41cd-9b8c-612abb7a3aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:15.145329 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1210/2428] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:15.149567 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea5f57-f0d6-4d4b-9b64-ccdfbd29d31b None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:15.159062 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea5f57-f0d6-4d4b-9b64-ccdfbd29d31b None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:15.164668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6707c3-bfd3-4083-b9fb-3108f292e694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:15.165267 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6707c3-bfd3-4083-b9fb-3108f292e694 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:15.165571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6707c3-bfd3-4083-b9fb-3108f292e694 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:15.165983 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6707c3-bfd3-4083-b9fb-3108f292e694 admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:15.166479 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6707c3-bfd3-4083-b9fb-3108f292e694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:51:15.166775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6707c3-bfd3-4083-b9fb-3108f292e694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:15.168347 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6707c3-bfd3-4083-b9fb-3108f292e694 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:15.180650 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1219/2429] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:15.184948 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c74e4e-5ee5-41cd-9b8c-612abb7a3aa4 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:15.194160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c74e4e-5ee5-41cd-9b8c-612abb7a3aa4 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:15.199056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06ad7c-fd03-4b53-be12-ca02849d1dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:15.199699 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ad7c-fd03-4b53-be12-ca02849d1dbb admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:15.199980 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ad7c-fd03-4b53-be12-ca02849d1dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:15.200256 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ad7c-fd03-4b53-be12-ca02849d1dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:15.200886 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06ad7c-fd03-4b53-be12-ca02849d1dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:15.202833 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06ad7c-fd03-4b53-be12-ca02849d1dbb admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:15.237043 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1211/2430] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:51:15 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:15.239020 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6707c3-bfd3-4083-b9fb-3108f292e694 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:15.255830 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6707c3-bfd3-4083-b9fb-3108f292e694 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:15.294616 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:15.315321 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d899d3-363b-4098-90b4-513cb33923d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:15.316630 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d899d3-363b-4098-90b4-513cb33923d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:15.316910 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d899d3-363b-4098-90b4-513cb33923d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:15.317177 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d899d3-363b-4098-90b4-513cb33923d3 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:15.317831 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d899d3-363b-4098-90b4-513cb33923d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:15.319725 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d899d3-363b-4098-90b4-513cb33923d3 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:15.344196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1220/2431] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:51:15 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:15.345395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06ad7c-fd03-4b53-be12-ca02849d1dbb admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:15.356083 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06ad7c-fd03-4b53-be12-ca02849d1dbb admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:15.360615 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976d42f-0178-4473-8521-9e95bc04ee22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:15.361213 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976d42f-0178-4473-8521-9e95bc04ee22 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:15.361516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976d42f-0178-4473-8521-9e95bc04ee22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:15.361792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976d42f-0178-4473-8521-9e95bc04ee22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:15.362981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976d42f-0178-4473-8521-9e95bc04ee22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:15.364821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976d42f-0178-4473-8521-9e95bc04ee22 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:15.375265 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1212/2432] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:51:15.380140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d899d3-363b-4098-90b4-513cb33923d3 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:15.390766 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d899d3-363b-4098-90b4-513cb33923d3 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:15.396157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbd26b-c119-4b91-ac8a-cbd208bdbcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:15.396771 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbd26b-c119-4b91-ac8a-cbd208bdbcf8 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:15.397050 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbd26b-c119-4b91-ac8a-cbd208bdbcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:15.397326 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbd26b-c119-4b91-ac8a-cbd208bdbcf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:15.398161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbd26b-c119-4b91-ac8a-cbd208bdbcf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:15.399600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbd26b-c119-4b91-ac8a-cbd208bdbcf8 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:15.410397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1221/2433] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:51:15.414571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976d42f-0178-4473-8521-9e95bc04ee22 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:15.424594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976d42f-0178-4473-8521-9e95bc04ee22 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:15.430215 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fffdfd-1b01-4ec7-a7d3-019124a02967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:15.430873 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fffdfd-1b01-4ec7-a7d3-019124a02967 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:15.431167 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fffdfd-1b01-4ec7-a7d3-019124a02967 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:15.431425 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fffdfd-1b01-4ec7-a7d3-019124a02967 admin admin] PATH_INFO: `/v3/projects/5dc30a1e65e841b1b5063c958374a95c/users/9c7c2e497d154a8196ca248525c241bd/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:15.446853 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fffdfd-1b01-4ec7-a7d3-019124a02967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc30a1e65e841b1b5063c958374a95c, user_id=9c7c2e497d154a8196ca248525c241bd, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:15.449593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fffdfd-1b01-4ec7-a7d3-019124a02967 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:15.463074 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1213/2434] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:51:15 2022] PUT /identity/v3/projects/5dc30a1e65e841b1b5063c958374a95c/users/9c7c2e497d154a8196ca248525c241bd/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:15.476998 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1ac5b-8257-4473-a1a7-25ece73236f9 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:15.477734 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1ac5b-8257-4473-a1a7-25ece73236f9 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:15.477734 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1ac5b-8257-4473-a1a7-25ece73236f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:15.508202 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-56c1ac5b-8257-4473-a1a7-25ece73236f9 None None] MFA Rules not processed for user `9c7c2e497d154a8196ca248525c241bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:15.509445 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-56c1ac5b-8257-4473-a1a7-25ece73236f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:15.574198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1222/2435] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:15.585935 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fffdfd-1b01-4ec7-a7d3-019124a02967 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:15.587758 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-91fffdfd-1b01-4ec7-a7d3-019124a02967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:15.663838 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fffdfd-1b01-4ec7-a7d3-019124a02967 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:15.669390 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d8abe-8299-42dc-9d01-1c0e4ac11a79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:15.670155 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d8abe-8299-42dc-9d01-1c0e4ac11a79 service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:15.670487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d8abe-8299-42dc-9d01-1c0e4ac11a79 service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:15.670764 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d8abe-8299-42dc-9d01-1c0e4ac11a79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:15.679405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d8abe-8299-42dc-9d01-1c0e4ac11a79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:15.681026 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d8abe-8299-42dc-9d01-1c0e4ac11a79 service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:15.691865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1214/2436] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:51:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:51:20.926823 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1ac5b-8257-4473-a1a7-25ece73236f9 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:20.996207 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1ac5b-8257-4473-a1a7-25ece73236f9 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:21.000720 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9bab1-7287-4b13-9b38-8bb8125b74b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:21.001339 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9bab1-7287-4b13-9b38-8bb8125b74b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:21.001656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9bab1-7287-4b13-9b38-8bb8125b74b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:21.001932 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9bab1-7287-4b13-9b38-8bb8125b74b2 admin admin] PATH_INFO: `/v3/users/9c7c2e497d154a8196ca248525c241bd` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:21.003226 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9bab1-7287-4b13-9b38-8bb8125b74b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c7c2e497d154a8196ca248525c241bd)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:21.005128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9bab1-7287-4b13-9b38-8bb8125b74b2 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:21.051743 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1ad9bab1-7287-4b13-9b38-8bb8125b74b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c7c2e497d154a8196ca248525c241bd'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:21.052316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1ad9bab1-7287-4b13-9b38-8bb8125b74b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c7c2e497d154a8196ca248525c241bd'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:21.054226 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:21.065974 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1ad9bab1-7287-4b13-9b38-8bb8125b74b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c7c2e497d154a8196ca248525c241bd'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:21.073087 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1ad9bab1-7287-4b13-9b38-8bb8125b74b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c7c2e497d154a8196ca248525c241bd'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:21.079865 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1ad9bab1-7287-4b13-9b38-8bb8125b74b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c7c2e497d154a8196ca248525c241bd'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:21.086033 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1223/2437] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:51:20 2022] DELETE /identity/v3/users/9c7c2e497d154a8196ca248525c241bd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:51:21.090822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cb342-0fbb-473a-baef-ae1c8a45e7bc None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:21.091298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cb342-0fbb-473a-baef-ae1c8a45e7bc None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:21.091393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cb342-0fbb-473a-baef-ae1c8a45e7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:21.110614 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-e71cb342-0fbb-473a-baef-ae1c8a45e7bc None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:21.111938 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e71cb342-0fbb-473a-baef-ae1c8a45e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:21.137543 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:21.172455 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1215/2438] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:21.182786 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9bab1-7287-4b13-9b38-8bb8125b74b2 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:21.184217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-1ad9bab1-7287-4b13-9b38-8bb8125b74b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:21.241079 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9bab1-7287-4b13-9b38-8bb8125b74b2 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:21.244840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9d4c8-2e51-4da6-8721-cca682c827c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:21.245448 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9d4c8-2e51-4da6-8721-cca682c827c9 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:21.245768 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9d4c8-2e51-4da6-8721-cca682c827c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:21.246041 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9d4c8-2e51-4da6-8721-cca682c827c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:21.255169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9d4c8-2e51-4da6-8721-cca682c827c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:21.256582 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9d4c8-2e51-4da6-8721-cca682c827c9 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:21.265987 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1224/2439] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:51:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:51:21.545688 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cb342-0fbb-473a-baef-ae1c8a45e7bc None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:21.547191 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e71cb342-0fbb-473a-baef-ae1c8a45e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:21.567382 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cb342-0fbb-473a-baef-ae1c8a45e7bc None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:21.572519 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb0c64-121f-400c-a185-026abcf3bde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:21.573156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb0c64-121f-400c-a185-026abcf3bde1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:21.573434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb0c64-121f-400c-a185-026abcf3bde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:21.573790 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb0c64-121f-400c-a185-026abcf3bde1 admin admin] PATH_INFO: `/v3/projects/5dc30a1e65e841b1b5063c958374a95c` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:21.574914 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb0c64-121f-400c-a185-026abcf3bde1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc30a1e65e841b1b5063c958374a95c)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:21.576810 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb0c64-121f-400c-a185-026abcf3bde1 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:21.626347 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b6cb0c64-121f-400c-a185-026abcf3bde1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc30a1e65e841b1b5063c958374a95c', 'request_id': 'req-b6cb0c64-121f-400c-a185-026abcf3bde1'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:21.633860 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b6cb0c64-121f-400c-a185-026abcf3bde1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc30a1e65e841b1b5063c958374a95c', 'request_id': 'req-b6cb0c64-121f-400c-a185-026abcf3bde1'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:21.640246 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b6cb0c64-121f-400c-a185-026abcf3bde1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc30a1e65e841b1b5063c958374a95c', 'request_id': 'req-b6cb0c64-121f-400c-a185-026abcf3bde1'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:21.651140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b6cb0c64-121f-400c-a185-026abcf3bde1 admin admin] The token cache is being invalidate because project 5dc30a1e65e841b1b5063c958374a95c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:51:21.651439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b6cb0c64-121f-400c-a185-026abcf3bde1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:21.652070 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b6cb0c64-121f-400c-a185-026abcf3bde1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:21.653583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1216/2440] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:51:21 2022] DELETE /identity/v3/projects/5dc30a1e65e841b1b5063c958374a95c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:21.658436 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda25030-8976-41f1-8837-57a85e43364b None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:21.658725 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda25030-8976-41f1-8837-57a85e43364b None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:21.659006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda25030-8976-41f1-8837-57a85e43364b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:21.682818 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-dda25030-8976-41f1-8837-57a85e43364b None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:21.684676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-dda25030-8976-41f1-8837-57a85e43364b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:21.743057 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1225/2441] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:21.752053 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501d67b-161a-4a48-86ad-a99fec417f06 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:21.752345 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501d67b-161a-4a48-86ad-a99fec417f06 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:21.752629 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501d67b-161a-4a48-86ad-a99fec417f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:21.778532 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-c501d67b-161a-4a48-86ad-a99fec417f06 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:21.779775 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-c501d67b-161a-4a48-86ad-a99fec417f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:21.788200 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1217/2442] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:21.792673 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda25030-8976-41f1-8837-57a85e43364b None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:21.802578 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda25030-8976-41f1-8837-57a85e43364b None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:21.807129 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d239102-656e-48b4-be08-864af0479a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:21.807722 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d239102-656e-48b4-be08-864af0479a5b admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:21.808000 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d239102-656e-48b4-be08-864af0479a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:21.808275 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d239102-656e-48b4-be08-864af0479a5b admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:21.808948 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d239102-656e-48b4-be08-864af0479a5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:51:21.809248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d239102-656e-48b4-be08-864af0479a5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:21.810871 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d239102-656e-48b4-be08-864af0479a5b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:21.822685 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1226/2443] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:21.826898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501d67b-161a-4a48-86ad-a99fec417f06 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:21.836931 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501d67b-161a-4a48-86ad-a99fec417f06 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:21.841866 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c5697-36a2-49ec-ae5b-ba15fc52f407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:21.842460 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c5697-36a2-49ec-ae5b-ba15fc52f407 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:21.842749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c5697-36a2-49ec-ae5b-ba15fc52f407 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:21.843017 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c5697-36a2-49ec-ae5b-ba15fc52f407 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:21.843668 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c5697-36a2-49ec-ae5b-ba15fc52f407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:21.845585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c5697-36a2-49ec-ae5b-ba15fc52f407 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:21.879665 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1218/2444] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:51:21 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:21.884098 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d239102-656e-48b4-be08-864af0479a5b admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:21.895031 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d239102-656e-48b4-be08-864af0479a5b admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:21.946184 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:21.952377 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd62faf-d6e1-40c0-a155-15a8395f4ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:21.953203 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd62faf-d6e1-40c0-a155-15a8395f4ebb admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:21.953528 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd62faf-d6e1-40c0-a155-15a8395f4ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:21.953818 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd62faf-d6e1-40c0-a155-15a8395f4ebb admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:21.954602 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd62faf-d6e1-40c0-a155-15a8395f4ebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:21.957485 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd62faf-d6e1-40c0-a155-15a8395f4ebb admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:21.978580 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1227/2445] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:51:21 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:21.982962 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c5697-36a2-49ec-ae5b-ba15fc52f407 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:21.993624 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c5697-36a2-49ec-ae5b-ba15fc52f407 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:21.998295 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae1107-343a-4f77-b73b-99c3fb983c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:21.998888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae1107-343a-4f77-b73b-99c3fb983c3d admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:21.999173 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae1107-343a-4f77-b73b-99c3fb983c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:21.999448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae1107-343a-4f77-b73b-99c3fb983c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:22.000087 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae1107-343a-4f77-b73b-99c3fb983c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:22.001726 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae1107-343a-4f77-b73b-99c3fb983c3d admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:22.012080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1219/2446] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:51:22.015972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd62faf-d6e1-40c0-a155-15a8395f4ebb admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:22.026005 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd62faf-d6e1-40c0-a155-15a8395f4ebb admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:22.030697 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ad586-7c95-4d90-8234-717a83c6c99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:22.031292 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ad586-7c95-4d90-8234-717a83c6c99a admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:22.031571 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ad586-7c95-4d90-8234-717a83c6c99a admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:22.031845 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ad586-7c95-4d90-8234-717a83c6c99a admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:22.032479 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ad586-7c95-4d90-8234-717a83c6c99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:22.034785 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ad586-7c95-4d90-8234-717a83c6c99a admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:22.045395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1228/2447] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:51:22.049595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae1107-343a-4f77-b73b-99c3fb983c3d admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:22.060263 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae1107-343a-4f77-b73b-99c3fb983c3d admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:22.064857 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf11e83-09ff-49c2-8e4f-f7a50195dcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:22.065747 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf11e83-09ff-49c2-8e4f-f7a50195dcb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:22.066041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf11e83-09ff-49c2-8e4f-f7a50195dcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:22.066318 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf11e83-09ff-49c2-8e4f-f7a50195dcb2 admin admin] PATH_INFO: `/v3/projects/635c221709934abbab43a54ab3708bb8/users/fcf44aad0d924f659c59e36d0549cd47/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:22.080592 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf11e83-09ff-49c2-8e4f-f7a50195dcb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=635c221709934abbab43a54ab3708bb8, user_id=fcf44aad0d924f659c59e36d0549cd47, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:22.083987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf11e83-09ff-49c2-8e4f-f7a50195dcb2 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:22.097940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1220/2448] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:51:22 2022] PUT /identity/v3/projects/635c221709934abbab43a54ab3708bb8/users/fcf44aad0d924f659c59e36d0549cd47/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:22.108190 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cafc9-55bd-4e6d-b7d0-1ff0705d9d0b None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:22.108471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cafc9-55bd-4e6d-b7d0-1ff0705d9d0b None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:22.108740 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cafc9-55bd-4e6d-b7d0-1ff0705d9d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:22.135903 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-6d3cafc9-55bd-4e6d-b7d0-1ff0705d9d0b None None] MFA Rules not processed for user `fcf44aad0d924f659c59e36d0549cd47`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:22.137040 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-6d3cafc9-55bd-4e6d-b7d0-1ff0705d9d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:22.200055 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1229/2449] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:51:22.204543 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf11e83-09ff-49c2-8e4f-f7a50195dcb2 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:22.259918 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:22.273387 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf11e83-09ff-49c2-8e4f-f7a50195dcb2 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:22.278049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fabfd-f145-4234-b954-837fcafa01cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:22.278650 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fabfd-f145-4234-b954-837fcafa01cb admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:22.278928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fabfd-f145-4234-b954-837fcafa01cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:22.279199 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fabfd-f145-4234-b954-837fcafa01cb admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:22.279818 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fabfd-f145-4234-b954-837fcafa01cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:22.281731 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fabfd-f145-4234-b954-837fcafa01cb admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:22.308562 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1221/2450] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:51:22 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:22.312722 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cafc9-55bd-4e6d-b7d0-1ff0705d9d0b None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:22.323423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cafc9-55bd-4e6d-b7d0-1ff0705d9d0b None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:22.379898 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776ce09-8a76-4503-bcb3-97b030155bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:22.380496 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776ce09-8a76-4503-bcb3-97b030155bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:22.380779 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776ce09-8a76-4503-bcb3-97b030155bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:22.381057 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776ce09-8a76-4503-bcb3-97b030155bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:22.381707 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776ce09-8a76-4503-bcb3-97b030155bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:22.383612 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776ce09-8a76-4503-bcb3-97b030155bf0 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:22.404470 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1230/2451] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:51:22 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:22.408669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fabfd-f145-4234-b954-837fcafa01cb admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:22.419678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fabfd-f145-4234-b954-837fcafa01cb admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:22.424211 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046a380-59cf-40ef-863f-2da562224041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:22.425052 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046a380-59cf-40ef-863f-2da562224041 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:22.425336 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046a380-59cf-40ef-863f-2da562224041 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:22.425708 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046a380-59cf-40ef-863f-2da562224041 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:22.426343 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046a380-59cf-40ef-863f-2da562224041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:22.427911 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046a380-59cf-40ef-863f-2da562224041 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:22.438406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1222/2452] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:51:22.442910 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776ce09-8a76-4503-bcb3-97b030155bf0 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:22.452759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776ce09-8a76-4503-bcb3-97b030155bf0 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:22.458076 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af7343-38d7-47a3-8985-810a286d3928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:22.458718 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af7343-38d7-47a3-8985-810a286d3928 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:22.458993 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af7343-38d7-47a3-8985-810a286d3928 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:22.459265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af7343-38d7-47a3-8985-810a286d3928 admin admin] PATH_INFO: `/v3/projects/0bc7e6bb4c7846a3b8c7c5d0299e6231/users/d68dd811d99847799b1869f3696d5457/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:22.474739 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af7343-38d7-47a3-8985-810a286d3928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc7e6bb4c7846a3b8c7c5d0299e6231, user_id=d68dd811d99847799b1869f3696d5457, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:22.477411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af7343-38d7-47a3-8985-810a286d3928 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:22.490847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1231/2453] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:51:22 2022] PUT /identity/v3/projects/0bc7e6bb4c7846a3b8c7c5d0299e6231/users/d68dd811d99847799b1869f3696d5457/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:22.494847 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046a380-59cf-40ef-863f-2da562224041 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:22.506315 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046a380-59cf-40ef-863f-2da562224041 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:22.564276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7342bd-6354-445e-84c2-9759cd73e3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:22.564874 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7342bd-6354-445e-84c2-9759cd73e3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:22.565155 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7342bd-6354-445e-84c2-9759cd73e3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:22.566171 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7342bd-6354-445e-84c2-9759cd73e3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:22.566812 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7342bd-6354-445e-84c2-9759cd73e3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:22.568390 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7342bd-6354-445e-84c2-9759cd73e3d2 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:22.577930 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1223/2454] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:51:22.582890 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af7343-38d7-47a3-8985-810a286d3928 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:22.593369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af7343-38d7-47a3-8985-810a286d3928 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:22.598164 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125e1f1-6af0-4312-bfdd-087fa4d09610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:22.598800 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125e1f1-6af0-4312-bfdd-087fa4d09610 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:22.599071 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125e1f1-6af0-4312-bfdd-087fa4d09610 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:22.599340 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125e1f1-6af0-4312-bfdd-087fa4d09610 admin admin] PATH_INFO: `/v3/projects/0bc7e6bb4c7846a3b8c7c5d0299e6231/users/d68dd811d99847799b1869f3696d5457/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:22.601252 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125e1f1-6af0-4312-bfdd-087fa4d09610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc7e6bb4c7846a3b8c7c5d0299e6231, user_id=d68dd811d99847799b1869f3696d5457, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:22.603883 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125e1f1-6af0-4312-bfdd-087fa4d09610 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:22.614029 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1232/2455] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:51:22 2022] PUT /identity/v3/projects/0bc7e6bb4c7846a3b8c7c5d0299e6231/users/d68dd811d99847799b1869f3696d5457/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:51:22.623975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40a930-9f15-4cda-9334-f305df3d34c3 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:22.624261 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40a930-9f15-4cda-9334-f305df3d34c3 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:22.624541 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40a930-9f15-4cda-9334-f305df3d34c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:22.652986 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-4b40a930-9f15-4cda-9334-f305df3d34c3 None None] MFA Rules not processed for user `d68dd811d99847799b1869f3696d5457`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:22.654284 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-4b40a930-9f15-4cda-9334-f305df3d34c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:22.722245 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1224/2456] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:22.733408 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125e1f1-6af0-4312-bfdd-087fa4d09610 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:22.735143 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-5125e1f1-6af0-4312-bfdd-087fa4d09610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:22.756220 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:22.793709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125e1f1-6af0-4312-bfdd-087fa4d09610 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:22.797345 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87b312-58ab-4a6e-8a5c-6cb275b94868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:22.797977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87b312-58ab-4a6e-8a5c-6cb275b94868 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:22.798255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87b312-58ab-4a6e-8a5c-6cb275b94868 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:22.798529 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87b312-58ab-4a6e-8a5c-6cb275b94868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:22.808171 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87b312-58ab-4a6e-8a5c-6cb275b94868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:22.809624 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87b312-58ab-4a6e-8a5c-6cb275b94868 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:22.819254 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1233/2457] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:51:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:51:23.203263 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40a930-9f15-4cda-9334-f305df3d34c3 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:23.251424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:23.267542 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40a930-9f15-4cda-9334-f305df3d34c3 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:23.272786 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8bac7-c6e3-4a60-81c4-b293374bc241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:23.273409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8bac7-c6e3-4a60-81c4-b293374bc241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:23.273716 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8bac7-c6e3-4a60-81c4-b293374bc241 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:23.273989 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8bac7-c6e3-4a60-81c4-b293374bc241 admin admin] PATH_INFO: `/v3/users/fcf44aad0d924f659c59e36d0549cd47` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:23.275102 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8bac7-c6e3-4a60-81c4-b293374bc241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcf44aad0d924f659c59e36d0549cd47)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:23.277001 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8bac7-c6e3-4a60-81c4-b293374bc241 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:23.326276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2eb8bac7-c6e3-4a60-81c4-b293374bc241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcf44aad0d924f659c59e36d0549cd47'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:23.326930 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2eb8bac7-c6e3-4a60-81c4-b293374bc241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcf44aad0d924f659c59e36d0549cd47'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:23.327616 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2eb8bac7-c6e3-4a60-81c4-b293374bc241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcf44aad0d924f659c59e36d0549cd47'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:23.340863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2eb8bac7-c6e3-4a60-81c4-b293374bc241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcf44aad0d924f659c59e36d0549cd47'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:23.349308 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2eb8bac7-c6e3-4a60-81c4-b293374bc241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcf44aad0d924f659c59e36d0549cd47'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:23.362276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1225/2458] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:51:23 2022] DELETE /identity/v3/users/fcf44aad0d924f659c59e36d0549cd47 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:23.366982 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed254a1-e148-40f7-8b03-e043f9b26876 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:23.367471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed254a1-e148-40f7-8b03-e043f9b26876 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:23.367691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed254a1-e148-40f7-8b03-e043f9b26876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:23.388863 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-3ed254a1-e148-40f7-8b03-e043f9b26876 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:23.390128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-3ed254a1-e148-40f7-8b03-e043f9b26876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:23.451388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1234/2459] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:51:23.461101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8bac7-c6e3-4a60-81c4-b293374bc241 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:23.463252 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-2eb8bac7-c6e3-4a60-81c4-b293374bc241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:23.520611 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8bac7-c6e3-4a60-81c4-b293374bc241 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:23.524291 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2d495-946b-4c30-b55d-f2fc433b208f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:23.524890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2d495-946b-4c30-b55d-f2fc433b208f service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:23.525167 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2d495-946b-4c30-b55d-f2fc433b208f service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:23.525435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2d495-946b-4c30-b55d-f2fc433b208f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:23.534935 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2d495-946b-4c30-b55d-f2fc433b208f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:23.536361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2d495-946b-4c30-b55d-f2fc433b208f service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:23.545873 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1226/2460] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:51:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:51:23.807383 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed254a1-e148-40f7-8b03-e043f9b26876 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:23.809315 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-3ed254a1-e148-40f7-8b03-e043f9b26876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:23.826671 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed254a1-e148-40f7-8b03-e043f9b26876 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:23.832168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714d325-b21e-4a45-9cf9-79952a403cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:23.832750 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714d325-b21e-4a45-9cf9-79952a403cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:23.833021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714d325-b21e-4a45-9cf9-79952a403cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:23.833294 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714d325-b21e-4a45-9cf9-79952a403cc7 admin admin] PATH_INFO: `/v3/projects/635c221709934abbab43a54ab3708bb8` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:23.834577 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714d325-b21e-4a45-9cf9-79952a403cc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=635c221709934abbab43a54ab3708bb8)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:23.836632 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714d325-b21e-4a45-9cf9-79952a403cc7 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:23.885161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b714d325-b21e-4a45-9cf9-79952a403cc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '635c221709934abbab43a54ab3708bb8', 'request_id': 'req-b714d325-b21e-4a45-9cf9-79952a403cc7'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:23.892444 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b714d325-b21e-4a45-9cf9-79952a403cc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '635c221709934abbab43a54ab3708bb8', 'request_id': 'req-b714d325-b21e-4a45-9cf9-79952a403cc7'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:23.898970 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b714d325-b21e-4a45-9cf9-79952a403cc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '635c221709934abbab43a54ab3708bb8', 'request_id': 'req-b714d325-b21e-4a45-9cf9-79952a403cc7'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:23.909099 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b714d325-b21e-4a45-9cf9-79952a403cc7 admin admin] The token cache is being invalidate because project 635c221709934abbab43a54ab3708bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:51:23.909312 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b714d325-b21e-4a45-9cf9-79952a403cc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:23.909973 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b714d325-b21e-4a45-9cf9-79952a403cc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:23.911429 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1235/2461] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:51:23 2022] DELETE /identity/v3/projects/635c221709934abbab43a54ab3708bb8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:23.915412 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2d495-946b-4c30-b55d-f2fc433b208f service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:23.925641 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2d495-946b-4c30-b55d-f2fc433b208f service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:23.981090 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a06dcb-446e-4226-becc-4e855372f052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:23.981670 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a06dcb-446e-4226-becc-4e855372f052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:23.981947 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a06dcb-446e-4226-becc-4e855372f052 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:23.982216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a06dcb-446e-4226-becc-4e855372f052 admin admin] PATH_INFO: `/v3/users/d68dd811d99847799b1869f3696d5457` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:23.983317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a06dcb-446e-4226-becc-4e855372f052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d68dd811d99847799b1869f3696d5457)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:23.985237 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a06dcb-446e-4226-becc-4e855372f052 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:23.995845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:24.030981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-38a06dcb-446e-4226-becc-4e855372f052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd68dd811d99847799b1869f3696d5457'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:24.031641 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-38a06dcb-446e-4226-becc-4e855372f052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd68dd811d99847799b1869f3696d5457'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:24.032251 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-38a06dcb-446e-4226-becc-4e855372f052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd68dd811d99847799b1869f3696d5457'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:24.044829 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-38a06dcb-446e-4226-becc-4e855372f052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd68dd811d99847799b1869f3696d5457'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:24.052946 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-38a06dcb-446e-4226-becc-4e855372f052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd68dd811d99847799b1869f3696d5457'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:24.065380 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1227/2462] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:51:23 2022] DELETE /identity/v3/users/d68dd811d99847799b1869f3696d5457 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:24.342874 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714d325-b21e-4a45-9cf9-79952a403cc7 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:24.344415 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-b714d325-b21e-4a45-9cf9-79952a403cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:24.366345 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714d325-b21e-4a45-9cf9-79952a403cc7 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:24.408550 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:24.425715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e011a9-0d54-4ba5-9196-d054e374690b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:24.426428 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e011a9-0d54-4ba5-9196-d054e374690b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:24.426712 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e011a9-0d54-4ba5-9196-d054e374690b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:24.426985 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e011a9-0d54-4ba5-9196-d054e374690b admin admin] PATH_INFO: `/v3/projects/0bc7e6bb4c7846a3b8c7c5d0299e6231` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:24.428134 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e011a9-0d54-4ba5-9196-d054e374690b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bc7e6bb4c7846a3b8c7c5d0299e6231)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:24.430202 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e011a9-0d54-4ba5-9196-d054e374690b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:24.478456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-94e011a9-0d54-4ba5-9196-d054e374690b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bc7e6bb4c7846a3b8c7c5d0299e6231', 'request_id': 'req-94e011a9-0d54-4ba5-9196-d054e374690b'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:24.486130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-94e011a9-0d54-4ba5-9196-d054e374690b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bc7e6bb4c7846a3b8c7c5d0299e6231', 'request_id': 'req-94e011a9-0d54-4ba5-9196-d054e374690b'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:24.493583 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-94e011a9-0d54-4ba5-9196-d054e374690b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bc7e6bb4c7846a3b8c7c5d0299e6231', 'request_id': 'req-94e011a9-0d54-4ba5-9196-d054e374690b'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:24.504706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-94e011a9-0d54-4ba5-9196-d054e374690b admin admin] The token cache is being invalidate because project 0bc7e6bb4c7846a3b8c7c5d0299e6231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:51:24.504986 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-94e011a9-0d54-4ba5-9196-d054e374690b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:24.505664 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-94e011a9-0d54-4ba5-9196-d054e374690b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:24.507414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1236/2463] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:51:24 2022] DELETE /identity/v3/projects/0bc7e6bb4c7846a3b8c7c5d0299e6231 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:24.512276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07744b9-ffc9-4bdf-aa36-40550122d1f6 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:24.512702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07744b9-ffc9-4bdf-aa36-40550122d1f6 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:24.512825 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07744b9-ffc9-4bdf-aa36-40550122d1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:24.532427 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-f07744b9-ffc9-4bdf-aa36-40550122d1f6 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:24.533595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-f07744b9-ffc9-4bdf-aa36-40550122d1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:24.593860 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1228/2464] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:24.603045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3b244-4884-4376-8062-5aac7a4800f7 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:24.603362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3b244-4884-4376-8062-5aac7a4800f7 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:24.603641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3b244-4884-4376-8062-5aac7a4800f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:24.623470 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-7bc3b244-4884-4376-8062-5aac7a4800f7 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:24.624684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-7bc3b244-4884-4376-8062-5aac7a4800f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:24.633540 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1237/2465] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:51:24.637798 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07744b9-ffc9-4bdf-aa36-40550122d1f6 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:24.647814 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07744b9-ffc9-4bdf-aa36-40550122d1f6 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:24.652382 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fa4c5-844d-4a8a-b595-745c6f048d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:24.652976 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fa4c5-844d-4a8a-b595-745c6f048d16 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:24.653255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fa4c5-844d-4a8a-b595-745c6f048d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:24.653556 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fa4c5-844d-4a8a-b595-745c6f048d16 admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:24.654207 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fa4c5-844d-4a8a-b595-745c6f048d16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:51:24.654539 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fa4c5-844d-4a8a-b595-745c6f048d16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:24.656116 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fa4c5-844d-4a8a-b595-745c6f048d16 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:24.667780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1229/2466] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:24.671795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3b244-4884-4376-8062-5aac7a4800f7 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:24.681438 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3b244-4884-4376-8062-5aac7a4800f7 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:24.686078 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de7c99-6ab0-4693-9344-90cda66e1242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:24.686656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de7c99-6ab0-4693-9344-90cda66e1242 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:24.686928 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de7c99-6ab0-4693-9344-90cda66e1242 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:24.687193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de7c99-6ab0-4693-9344-90cda66e1242 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:24.687799 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de7c99-6ab0-4693-9344-90cda66e1242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:24.689680 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de7c99-6ab0-4693-9344-90cda66e1242 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:24.716300 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1238/2467] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:51:24 2022] POST /identity/v3/projects => generated 401 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:24.720375 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fa4c5-844d-4a8a-b595-745c6f048d16 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:24.731008 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fa4c5-844d-4a8a-b595-745c6f048d16 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:24.790944 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d8974-0c1d-4f02-94da-b5cbd314c415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:24.791554 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d8974-0c1d-4f02-94da-b5cbd314c415 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:24.791851 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d8974-0c1d-4f02-94da-b5cbd314c415 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:24.792108 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d8974-0c1d-4f02-94da-b5cbd314c415 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:24.792732 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d8974-0c1d-4f02-94da-b5cbd314c415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:24.794680 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d8974-0c1d-4f02-94da-b5cbd314c415 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:24.818604 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1230/2468] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:51:24 2022] POST /identity/v3/users => generated 301 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:24.819733 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de7c99-6ab0-4693-9344-90cda66e1242 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:24.829847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de7c99-6ab0-4693-9344-90cda66e1242 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:24.834483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c4f7f-0d3c-4f34-88c5-e8272e220427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:24.835075 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c4f7f-0d3c-4f34-88c5-e8272e220427 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:24.835357 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c4f7f-0d3c-4f34-88c5-e8272e220427 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:24.835653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c4f7f-0d3c-4f34-88c5-e8272e220427 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:24.836284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c4f7f-0d3c-4f34-88c5-e8272e220427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:24.837899 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c4f7f-0d3c-4f34-88c5-e8272e220427 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:24.848435 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1239/2469] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:51:24.852389 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d8974-0c1d-4f02-94da-b5cbd314c415 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:24.858870 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:24.863712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d8974-0c1d-4f02-94da-b5cbd314c415 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:24.870488 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c37357-b94b-4b0a-9607-21def675d099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:24.871094 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c37357-b94b-4b0a-9607-21def675d099 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:24.871363 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c37357-b94b-4b0a-9607-21def675d099 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:24.871638 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c37357-b94b-4b0a-9607-21def675d099 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:24.872311 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c37357-b94b-4b0a-9607-21def675d099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:24.873964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c37357-b94b-4b0a-9607-21def675d099 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:24.885052 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1231/2470] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:51:24.889487 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c4f7f-0d3c-4f34-88c5-e8272e220427 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:24.899492 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c4f7f-0d3c-4f34-88c5-e8272e220427 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:24.904041 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766dfde0-0dec-4890-b516-53d9672fbcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:24.904682 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dfde0-0dec-4890-b516-53d9672fbcf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:24.904954 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dfde0-0dec-4890-b516-53d9672fbcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:24.905225 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766dfde0-0dec-4890-b516-53d9672fbcf9 admin admin] PATH_INFO: `/v3/projects/a653d121d6494f9d971d26d2f913866a/users/587c31f43b43427ea79f7dd5bf61ff69/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:24.919920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766dfde0-0dec-4890-b516-53d9672fbcf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a653d121d6494f9d971d26d2f913866a, user_id=587c31f43b43427ea79f7dd5bf61ff69, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:24.922560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766dfde0-0dec-4890-b516-53d9672fbcf9 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:24.935842 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1240/2471] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:51:24 2022] PUT /identity/v3/projects/a653d121d6494f9d971d26d2f913866a/users/587c31f43b43427ea79f7dd5bf61ff69/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:24.946162 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f80aa-ece3-4670-b2b1-268dd2c614af None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:24.946453 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f80aa-ece3-4670-b2b1-268dd2c614af None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:24.946732 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f80aa-ece3-4670-b2b1-268dd2c614af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:24.974805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-542f80aa-ece3-4670-b2b1-268dd2c614af None None] MFA Rules not processed for user `587c31f43b43427ea79f7dd5bf61ff69`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:24.976011 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-542f80aa-ece3-4670-b2b1-268dd2c614af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:25.047311 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1232/2472] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:24 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:25.052508 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766dfde0-0dec-4890-b516-53d9672fbcf9 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:25.114249 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766dfde0-0dec-4890-b516-53d9672fbcf9 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:25.119022 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553a5e6-924b-40a5-bf37-9b6f3e557f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:25.119621 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553a5e6-924b-40a5-bf37-9b6f3e557f9b admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:25.119898 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553a5e6-924b-40a5-bf37-9b6f3e557f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:25.120182 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553a5e6-924b-40a5-bf37-9b6f3e557f9b admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:25.120815 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553a5e6-924b-40a5-bf37-9b6f3e557f9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:25.122814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553a5e6-924b-40a5-bf37-9b6f3e557f9b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:25.137235 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:25.150658 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1241/2473] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:51:25 2022] POST /identity/v3/projects => generated 399 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:25.154927 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f80aa-ece3-4670-b2b1-268dd2c614af None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:25.167270 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f80aa-ece3-4670-b2b1-268dd2c614af None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:25.224364 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82cff7-b04b-4e47-ba3b-6d28123aab63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:25.225037 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82cff7-b04b-4e47-ba3b-6d28123aab63 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:25.225321 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82cff7-b04b-4e47-ba3b-6d28123aab63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:25.225648 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82cff7-b04b-4e47-ba3b-6d28123aab63 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:25.226288 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82cff7-b04b-4e47-ba3b-6d28123aab63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:25.228211 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82cff7-b04b-4e47-ba3b-6d28123aab63 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:25.249588 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1233/2474] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:51:25 2022] POST /identity/v3/users => generated 306 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:25.253862 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553a5e6-924b-40a5-bf37-9b6f3e557f9b admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:25.264071 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553a5e6-924b-40a5-bf37-9b6f3e557f9b admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:25.269323 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e8821-037d-48a9-8b86-a866db476c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:25.269948 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e8821-037d-48a9-8b86-a866db476c99 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:25.270231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e8821-037d-48a9-8b86-a866db476c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:25.270505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e8821-037d-48a9-8b86-a866db476c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:25.271137 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e8821-037d-48a9-8b86-a866db476c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:25.272705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e8821-037d-48a9-8b86-a866db476c99 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:25.283030 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1242/2475] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:51:25.287581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82cff7-b04b-4e47-ba3b-6d28123aab63 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:25.297736 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82cff7-b04b-4e47-ba3b-6d28123aab63 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:25.302839 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1fb5e-481c-41c5-94d1-6abc090a3fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:25.303487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1fb5e-481c-41c5-94d1-6abc090a3fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:25.303767 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1fb5e-481c-41c5-94d1-6abc090a3fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:25.304040 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1fb5e-481c-41c5-94d1-6abc090a3fb9 admin admin] PATH_INFO: `/v3/projects/72d6ed0984b94952ad3bbc96c345939a/users/ad5f0bfd4c3d446e8435aa32416f2352/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:25.318983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1fb5e-481c-41c5-94d1-6abc090a3fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d6ed0984b94952ad3bbc96c345939a, user_id=ad5f0bfd4c3d446e8435aa32416f2352, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:25.321650 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1fb5e-481c-41c5-94d1-6abc090a3fb9 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:25.335092 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1234/2476] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:51:25 2022] PUT /identity/v3/projects/72d6ed0984b94952ad3bbc96c345939a/users/ad5f0bfd4c3d446e8435aa32416f2352/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:51:25.339104 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e8821-037d-48a9-8b86-a866db476c99 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:25.350434 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e8821-037d-48a9-8b86-a866db476c99 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:25.406234 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd30426-cc5b-4a85-b1b3-108b0daaa2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:25.406832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd30426-cc5b-4a85-b1b3-108b0daaa2ff admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:25.407107 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd30426-cc5b-4a85-b1b3-108b0daaa2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:25.407379 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd30426-cc5b-4a85-b1b3-108b0daaa2ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:25.408004 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd30426-cc5b-4a85-b1b3-108b0daaa2ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:25.409891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd30426-cc5b-4a85-b1b3-108b0daaa2ff admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:25.419446 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1243/2477] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:51:25.423572 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1fb5e-481c-41c5-94d1-6abc090a3fb9 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:25.434415 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1fb5e-481c-41c5-94d1-6abc090a3fb9 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:25.439060 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d827a18-c555-4115-9dc3-0bbe0b392e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:25.439707 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d827a18-c555-4115-9dc3-0bbe0b392e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:25.439985 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d827a18-c555-4115-9dc3-0bbe0b392e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:25.440977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d827a18-c555-4115-9dc3-0bbe0b392e83 admin admin] PATH_INFO: `/v3/projects/72d6ed0984b94952ad3bbc96c345939a/users/ad5f0bfd4c3d446e8435aa32416f2352/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:25.443007 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d827a18-c555-4115-9dc3-0bbe0b392e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d6ed0984b94952ad3bbc96c345939a, user_id=ad5f0bfd4c3d446e8435aa32416f2352, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:25.445644 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d827a18-c555-4115-9dc3-0bbe0b392e83 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:25.455540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1235/2478] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:51:25 2022] PUT /identity/v3/projects/72d6ed0984b94952ad3bbc96c345939a/users/ad5f0bfd4c3d446e8435aa32416f2352/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:25.467320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f796371-ae40-4c7d-9ed0-5e5135889049 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:25.467604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f796371-ae40-4c7d-9ed0-5e5135889049 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:25.467877 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f796371-ae40-4c7d-9ed0-5e5135889049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:25.496572 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-3f796371-ae40-4c7d-9ed0-5e5135889049 None None] MFA Rules not processed for user `ad5f0bfd4c3d446e8435aa32416f2352`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:25.497804 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-3f796371-ae40-4c7d-9ed0-5e5135889049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:25.563329 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1244/2479] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:25 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:25.573774 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d827a18-c555-4115-9dc3-0bbe0b392e83 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:25.575640 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-5d827a18-c555-4115-9dc3-0bbe0b392e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:25.616767 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:25.635804 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d827a18-c555-4115-9dc3-0bbe0b392e83 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:25.639513 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b06456-696a-4236-8f66-55b9ac9c86fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:25.640122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b06456-696a-4236-8f66-55b9ac9c86fc service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:25.640403 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b06456-696a-4236-8f66-55b9ac9c86fc service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:25.640679 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b06456-696a-4236-8f66-55b9ac9c86fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:25.649964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b06456-696a-4236-8f66-55b9ac9c86fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:25.651395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b06456-696a-4236-8f66-55b9ac9c86fc service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:25.661688 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1236/2480] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:51:25 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:51:25.736626 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f796371-ae40-4c7d-9ed0-5e5135889049 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:25.747236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f796371-ae40-4c7d-9ed0-5e5135889049 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:25.750833 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18481838-67a9-4cf8-a963-16835b998954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:25.751420 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18481838-67a9-4cf8-a963-16835b998954 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:25.751691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18481838-67a9-4cf8-a963-16835b998954 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:25.751959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18481838-67a9-4cf8-a963-16835b998954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:25.809011 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18481838-67a9-4cf8-a963-16835b998954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:25.810504 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18481838-67a9-4cf8-a963-16835b998954 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:25.819756 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1245/2481] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:51:25 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:51:29.862797 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b06456-696a-4236-8f66-55b9ac9c86fc service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:29.923905 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b06456-696a-4236-8f66-55b9ac9c86fc service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:29.928675 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadf2fe-980b-4bdc-8e39-48401d3ffb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:29.929292 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadf2fe-980b-4bdc-8e39-48401d3ffb49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:29.929592 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadf2fe-980b-4bdc-8e39-48401d3ffb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:29.929870 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadf2fe-980b-4bdc-8e39-48401d3ffb49 admin admin] PATH_INFO: `/v3/users/587c31f43b43427ea79f7dd5bf61ff69` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:29.930972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadf2fe-980b-4bdc-8e39-48401d3ffb49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=587c31f43b43427ea79f7dd5bf61ff69)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:29.932853 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadf2fe-980b-4bdc-8e39-48401d3ffb49 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:29.978569 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cbadf2fe-980b-4bdc-8e39-48401d3ffb49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '587c31f43b43427ea79f7dd5bf61ff69'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:29.979235 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cbadf2fe-980b-4bdc-8e39-48401d3ffb49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '587c31f43b43427ea79f7dd5bf61ff69'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:29.979837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cbadf2fe-980b-4bdc-8e39-48401d3ffb49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '587c31f43b43427ea79f7dd5bf61ff69'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:29.992605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cbadf2fe-980b-4bdc-8e39-48401d3ffb49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '587c31f43b43427ea79f7dd5bf61ff69'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:30.001754 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cbadf2fe-980b-4bdc-8e39-48401d3ffb49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '587c31f43b43427ea79f7dd5bf61ff69'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:30.014719 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1237/2482] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:51:29 2022] DELETE /identity/v3/users/587c31f43b43427ea79f7dd5bf61ff69 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:51:30.019773 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb0b02-a9df-45ca-96f3-94b71c4789a2 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:30.020239 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb0b02-a9df-45ca-96f3-94b71c4789a2 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:30.020466 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb0b02-a9df-45ca-96f3-94b71c4789a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:30.028487 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:30.040018 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-76eb0b02-a9df-45ca-96f3-94b71c4789a2 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:30.041208 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-76eb0b02-a9df-45ca-96f3-94b71c4789a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:30.098460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1246/2483] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:30.108149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadf2fe-980b-4bdc-8e39-48401d3ffb49 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:30.109593 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-cbadf2fe-980b-4bdc-8e39-48401d3ffb49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:30.166630 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadf2fe-980b-4bdc-8e39-48401d3ffb49 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:30.170253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5aadbd-2a6d-44ef-9f6d-6b7c54e21b8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:30.170850 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5aadbd-2a6d-44ef-9f6d-6b7c54e21b8d service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:30.171127 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5aadbd-2a6d-44ef-9f6d-6b7c54e21b8d service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:30.171395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5aadbd-2a6d-44ef-9f6d-6b7c54e21b8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:30.180180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5aadbd-2a6d-44ef-9f6d-6b7c54e21b8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:30.181615 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5aadbd-2a6d-44ef-9f6d-6b7c54e21b8d service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:30.186423 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:30.192039 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1238/2484] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:51:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:51:30.462355 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb0b02-a9df-45ca-96f3-94b71c4789a2 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:30.463967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-76eb0b02-a9df-45ca-96f3-94b71c4789a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:30.476735 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb0b02-a9df-45ca-96f3-94b71c4789a2 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:30.481507 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa375fb-b7e4-4eab-907e-483bc994e48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:30.482157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa375fb-b7e4-4eab-907e-483bc994e48c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:30.482427 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa375fb-b7e4-4eab-907e-483bc994e48c admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:30.482704 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa375fb-b7e4-4eab-907e-483bc994e48c admin admin] PATH_INFO: `/v3/projects/a653d121d6494f9d971d26d2f913866a` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:30.483942 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa375fb-b7e4-4eab-907e-483bc994e48c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a653d121d6494f9d971d26d2f913866a)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:30.485745 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa375fb-b7e4-4eab-907e-483bc994e48c admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:30.534600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-afa375fb-b7e4-4eab-907e-483bc994e48c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a653d121d6494f9d971d26d2f913866a', 'request_id': 'req-afa375fb-b7e4-4eab-907e-483bc994e48c'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:30.541855 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-afa375fb-b7e4-4eab-907e-483bc994e48c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a653d121d6494f9d971d26d2f913866a', 'request_id': 'req-afa375fb-b7e4-4eab-907e-483bc994e48c'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:30.547933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-afa375fb-b7e4-4eab-907e-483bc994e48c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a653d121d6494f9d971d26d2f913866a', 'request_id': 'req-afa375fb-b7e4-4eab-907e-483bc994e48c'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:30.558832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-afa375fb-b7e4-4eab-907e-483bc994e48c admin admin] The token cache is being invalidate because project a653d121d6494f9d971d26d2f913866a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:51:30.559120 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-afa375fb-b7e4-4eab-907e-483bc994e48c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:30.559753 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-afa375fb-b7e4-4eab-907e-483bc994e48c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:30.561278 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1247/2485] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:51:30 2022] DELETE /identity/v3/projects/a653d121d6494f9d971d26d2f913866a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:30.566074 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5aadbd-2a6d-44ef-9f6d-6b7c54e21b8d service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:30.575918 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5aadbd-2a6d-44ef-9f6d-6b7c54e21b8d service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:30.633123 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64989de-4168-47e7-8814-d67b86a12047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:30.633699 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64989de-4168-47e7-8814-d67b86a12047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:30.633981 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64989de-4168-47e7-8814-d67b86a12047 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:30.634256 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64989de-4168-47e7-8814-d67b86a12047 admin admin] PATH_INFO: `/v3/users/ad5f0bfd4c3d446e8435aa32416f2352` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:30.635376 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64989de-4168-47e7-8814-d67b86a12047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad5f0bfd4c3d446e8435aa32416f2352)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:30.637292 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64989de-4168-47e7-8814-d67b86a12047 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:30.686546 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c64989de-4168-47e7-8814-d67b86a12047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad5f0bfd4c3d446e8435aa32416f2352'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:30.687180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c64989de-4168-47e7-8814-d67b86a12047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad5f0bfd4c3d446e8435aa32416f2352'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:30.687782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c64989de-4168-47e7-8814-d67b86a12047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad5f0bfd4c3d446e8435aa32416f2352'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:30.708506 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c64989de-4168-47e7-8814-d67b86a12047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad5f0bfd4c3d446e8435aa32416f2352'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:30.717129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c64989de-4168-47e7-8814-d67b86a12047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad5f0bfd4c3d446e8435aa32416f2352'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:30.730017 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1239/2486] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:51:30 2022] DELETE /identity/v3/users/ad5f0bfd4c3d446e8435aa32416f2352 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:31.007413 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa375fb-b7e4-4eab-907e-483bc994e48c admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:31.008894 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-afa375fb-b7e4-4eab-907e-483bc994e48c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:31.024154 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa375fb-b7e4-4eab-907e-483bc994e48c admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:31.083373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f3a56-1b1b-439d-993e-cab3b1b2e1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:31.084005 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f3a56-1b1b-439d-993e-cab3b1b2e1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:31.084289 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f3a56-1b1b-439d-993e-cab3b1b2e1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:31.084566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f3a56-1b1b-439d-993e-cab3b1b2e1d0 admin admin] PATH_INFO: `/v3/projects/72d6ed0984b94952ad3bbc96c345939a` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:31.085711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f3a56-1b1b-439d-993e-cab3b1b2e1d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72d6ed0984b94952ad3bbc96c345939a)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:31.087597 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f3a56-1b1b-439d-993e-cab3b1b2e1d0 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:31.120813 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:31.135794 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-781f3a56-1b1b-439d-993e-cab3b1b2e1d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72d6ed0984b94952ad3bbc96c345939a', 'request_id': 'req-781f3a56-1b1b-439d-993e-cab3b1b2e1d0'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:31.142713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-781f3a56-1b1b-439d-993e-cab3b1b2e1d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72d6ed0984b94952ad3bbc96c345939a', 'request_id': 'req-781f3a56-1b1b-439d-993e-cab3b1b2e1d0'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:31.149347 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-781f3a56-1b1b-439d-993e-cab3b1b2e1d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72d6ed0984b94952ad3bbc96c345939a', 'request_id': 'req-781f3a56-1b1b-439d-993e-cab3b1b2e1d0'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:31.160386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-781f3a56-1b1b-439d-993e-cab3b1b2e1d0 admin admin] The token cache is being invalidate because project 72d6ed0984b94952ad3bbc96c345939a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:51:31.160681 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-781f3a56-1b1b-439d-993e-cab3b1b2e1d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:31.161332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-781f3a56-1b1b-439d-993e-cab3b1b2e1d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:31.162890 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1248/2487] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:51:31 2022] DELETE /identity/v3/projects/72d6ed0984b94952ad3bbc96c345939a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:31.167810 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202198eb-3bec-4c32-93d3-0c4078f70911 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:31.168284 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202198eb-3bec-4c32-93d3-0c4078f70911 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:31.168385 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202198eb-3bec-4c32-93d3-0c4078f70911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:31.188759 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-202198eb-3bec-4c32-93d3-0c4078f70911 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:31.190558 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-202198eb-3bec-4c32-93d3-0c4078f70911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:31.251446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1240/2488] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:31.259795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea008f1-2008-4beb-a3a7-904d30b2a132 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:31.260083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea008f1-2008-4beb-a3a7-904d30b2a132 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:31.260362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea008f1-2008-4beb-a3a7-904d30b2a132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:31.279535 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-2ea008f1-2008-4beb-a3a7-904d30b2a132 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:31.280741 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2ea008f1-2008-4beb-a3a7-904d30b2a132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:31.288844 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1249/2489] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:31.293031 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202198eb-3bec-4c32-93d3-0c4078f70911 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:31.304201 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202198eb-3bec-4c32-93d3-0c4078f70911 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:31.308737 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836eac59-c060-4bf7-bc60-dddf20752365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:31.309323 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836eac59-c060-4bf7-bc60-dddf20752365 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:31.309639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836eac59-c060-4bf7-bc60-dddf20752365 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:31.309908 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836eac59-c060-4bf7-bc60-dddf20752365 admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:31.310541 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836eac59-c060-4bf7-bc60-dddf20752365 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:51:31.310837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836eac59-c060-4bf7-bc60-dddf20752365 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:31.312429 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836eac59-c060-4bf7-bc60-dddf20752365 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:31.324990 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1241/2490] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:31.329691 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea008f1-2008-4beb-a3a7-904d30b2a132 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:31.342692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea008f1-2008-4beb-a3a7-904d30b2a132 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:31.350955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f210fc-2d42-455e-b65a-1234191b894a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:31.351564 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f210fc-2d42-455e-b65a-1234191b894a admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:31.351838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f210fc-2d42-455e-b65a-1234191b894a admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:31.352110 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f210fc-2d42-455e-b65a-1234191b894a admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:31.352729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f210fc-2d42-455e-b65a-1234191b894a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:31.354642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f210fc-2d42-455e-b65a-1234191b894a admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:31.383141 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1250/2491] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:51:31 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:31.387804 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836eac59-c060-4bf7-bc60-dddf20752365 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:31.397992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836eac59-c060-4bf7-bc60-dddf20752365 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:31.401568 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:31.455305 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097bcc7-ae4d-4a1d-96e2-9a6b815a69f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:31.455936 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097bcc7-ae4d-4a1d-96e2-9a6b815a69f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:31.456212 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097bcc7-ae4d-4a1d-96e2-9a6b815a69f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:31.456483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097bcc7-ae4d-4a1d-96e2-9a6b815a69f1 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:31.457138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097bcc7-ae4d-4a1d-96e2-9a6b815a69f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:31.459071 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097bcc7-ae4d-4a1d-96e2-9a6b815a69f1 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:31.484560 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1242/2492] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:51:31 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:31.485723 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f210fc-2d42-455e-b65a-1234191b894a admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:31.496872 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f210fc-2d42-455e-b65a-1234191b894a admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:31.501549 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8aaa07-6f2d-493b-92e7-9fc7117e79c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:31.502094 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8aaa07-6f2d-493b-92e7-9fc7117e79c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:31.502430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8aaa07-6f2d-493b-92e7-9fc7117e79c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:31.502706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8aaa07-6f2d-493b-92e7-9fc7117e79c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:31.503342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8aaa07-6f2d-493b-92e7-9fc7117e79c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:31.504915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8aaa07-6f2d-493b-92e7-9fc7117e79c8 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:31.514611 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1251/2493] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:51:31.518937 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097bcc7-ae4d-4a1d-96e2-9a6b815a69f1 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:31.529039 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097bcc7-ae4d-4a1d-96e2-9a6b815a69f1 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:31.534299 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55987d-8919-4e9d-a71f-28a281176c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:31.534877 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55987d-8919-4e9d-a71f-28a281176c36 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:31.535157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55987d-8919-4e9d-a71f-28a281176c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:31.535431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55987d-8919-4e9d-a71f-28a281176c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:31.536101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55987d-8919-4e9d-a71f-28a281176c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:31.537737 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55987d-8919-4e9d-a71f-28a281176c36 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:31.548135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1243/2494] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:51:31.552853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8aaa07-6f2d-493b-92e7-9fc7117e79c8 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:31.562681 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8aaa07-6f2d-493b-92e7-9fc7117e79c8 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:31.567356 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856fdb4-176c-494d-a065-9a0518d3b709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:31.567990 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856fdb4-176c-494d-a065-9a0518d3b709 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:31.568263 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856fdb4-176c-494d-a065-9a0518d3b709 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:31.568531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856fdb4-176c-494d-a065-9a0518d3b709 admin admin] PATH_INFO: `/v3/projects/9f80b8dbd623476b96c0baaf8153cc5e/users/2a404b53fd624c1aab75615bd42df690/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:31.582707 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856fdb4-176c-494d-a065-9a0518d3b709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f80b8dbd623476b96c0baaf8153cc5e, user_id=2a404b53fd624c1aab75615bd42df690, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:31.585294 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856fdb4-176c-494d-a065-9a0518d3b709 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:31.599131 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1252/2495] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:51:31 2022] PUT /identity/v3/projects/9f80b8dbd623476b96c0baaf8153cc5e/users/2a404b53fd624c1aab75615bd42df690/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:31.609287 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d041c-423e-4b7c-918e-00c5b3acd330 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:31.609604 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d041c-423e-4b7c-918e-00c5b3acd330 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:31.609885 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d041c-423e-4b7c-918e-00c5b3acd330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:31.637152 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-644d041c-423e-4b7c-918e-00c5b3acd330 None None] MFA Rules not processed for user `2a404b53fd624c1aab75615bd42df690`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:31.638468 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-644d041c-423e-4b7c-918e-00c5b3acd330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:31.701972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1244/2496] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:31.707059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856fdb4-176c-494d-a065-9a0518d3b709 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:31.767577 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856fdb4-176c-494d-a065-9a0518d3b709 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:31.772758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120e6b2-cff1-4f85-9f75-87cda04d1503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:31.773352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120e6b2-cff1-4f85-9f75-87cda04d1503 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:31.773663 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120e6b2-cff1-4f85-9f75-87cda04d1503 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:31.773940 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120e6b2-cff1-4f85-9f75-87cda04d1503 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:31.774548 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120e6b2-cff1-4f85-9f75-87cda04d1503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:31.776713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120e6b2-cff1-4f85-9f75-87cda04d1503 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:31.802949 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1253/2497] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:51:31 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:51:31.807152 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d041c-423e-4b7c-918e-00c5b3acd330 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:31.818450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d041c-423e-4b7c-918e-00c5b3acd330 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:31.874334 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe582e-cdaa-4758-b98e-88af43d2f1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:31.874933 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe582e-cdaa-4758-b98e-88af43d2f1a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:31.875211 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe582e-cdaa-4758-b98e-88af43d2f1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:31.875483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe582e-cdaa-4758-b98e-88af43d2f1a2 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:31.876109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe582e-cdaa-4758-b98e-88af43d2f1a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:31.878597 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe582e-cdaa-4758-b98e-88af43d2f1a2 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:31.902261 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1245/2498] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:51:31 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:31.903392 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120e6b2-cff1-4f85-9f75-87cda04d1503 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:31.914035 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120e6b2-cff1-4f85-9f75-87cda04d1503 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:31.918583 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c5cb8-9965-4238-b1ee-49e1636fbe3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:31.919176 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c5cb8-9965-4238-b1ee-49e1636fbe3b admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:31.919455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c5cb8-9965-4238-b1ee-49e1636fbe3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:31.919727 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c5cb8-9965-4238-b1ee-49e1636fbe3b admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:31.920356 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c5cb8-9965-4238-b1ee-49e1636fbe3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:31.921998 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c5cb8-9965-4238-b1ee-49e1636fbe3b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:31.932906 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1254/2499] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:51:31.937005 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe582e-cdaa-4758-b98e-88af43d2f1a2 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:31.944254 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:31.948450 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe582e-cdaa-4758-b98e-88af43d2f1a2 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:31.954166 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f30ae-69e1-46aa-aea2-cee4476d41c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:31.954812 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f30ae-69e1-46aa-aea2-cee4476d41c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:31.955096 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f30ae-69e1-46aa-aea2-cee4476d41c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:31.955371 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f30ae-69e1-46aa-aea2-cee4476d41c1 admin admin] PATH_INFO: `/v3/projects/9c900d9ad41b4a75bda90392a525d51b/users/1d78418b78ce4b149c209a6ee107d1bc/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:31.970624 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f30ae-69e1-46aa-aea2-cee4476d41c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c900d9ad41b4a75bda90392a525d51b, user_id=1d78418b78ce4b149c209a6ee107d1bc, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:31.973498 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f30ae-69e1-46aa-aea2-cee4476d41c1 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:31.986420 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1246/2500] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:51:31 2022] PUT /identity/v3/projects/9c900d9ad41b4a75bda90392a525d51b/users/1d78418b78ce4b149c209a6ee107d1bc/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:31.990892 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c5cb8-9965-4238-b1ee-49e1636fbe3b admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:32.001312 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c5cb8-9965-4238-b1ee-49e1636fbe3b admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:32.027473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:32.058635 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162c345-fdad-490b-b36d-0b1155578f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:32.059237 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162c345-fdad-490b-b36d-0b1155578f94 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:32.059524 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162c345-fdad-490b-b36d-0b1155578f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:32.059799 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162c345-fdad-490b-b36d-0b1155578f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:32.060492 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162c345-fdad-490b-b36d-0b1155578f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:32.062140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162c345-fdad-490b-b36d-0b1155578f94 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:32.072046 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1255/2501] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:51:32.076228 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f30ae-69e1-46aa-aea2-cee4476d41c1 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:32.087045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f30ae-69e1-46aa-aea2-cee4476d41c1 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:32.091851 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb2179-76d4-4e77-b76e-dd6c5fb92346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:32.092489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb2179-76d4-4e77-b76e-dd6c5fb92346 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:32.092769 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb2179-76d4-4e77-b76e-dd6c5fb92346 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:32.093041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb2179-76d4-4e77-b76e-dd6c5fb92346 admin admin] PATH_INFO: `/v3/projects/9c900d9ad41b4a75bda90392a525d51b/users/1d78418b78ce4b149c209a6ee107d1bc/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:32.094971 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb2179-76d4-4e77-b76e-dd6c5fb92346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c900d9ad41b4a75bda90392a525d51b, user_id=1d78418b78ce4b149c209a6ee107d1bc, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:32.098470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb2179-76d4-4e77-b76e-dd6c5fb92346 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:32.108361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1247/2502] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:51:32 2022] PUT /identity/v3/projects/9c900d9ad41b4a75bda90392a525d51b/users/1d78418b78ce4b149c209a6ee107d1bc/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:51:32.119428 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacff40-eb3f-4cda-a1e3-1c69fb574f40 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:32.119716 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacff40-eb3f-4cda-a1e3-1c69fb574f40 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:32.120274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacff40-eb3f-4cda-a1e3-1c69fb574f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:32.148118 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-5dacff40-eb3f-4cda-a1e3-1c69fb574f40 None None] MFA Rules not processed for user `1d78418b78ce4b149c209a6ee107d1bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:32.149348 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-5dacff40-eb3f-4cda-a1e3-1c69fb574f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:32.217080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1256/2503] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:32.228460 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb2179-76d4-4e77-b76e-dd6c5fb92346 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:32.230205 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-9fbb2179-76d4-4e77-b76e-dd6c5fb92346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:32.288040 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb2179-76d4-4e77-b76e-dd6c5fb92346 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:32.291725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a095bc-c9fb-42e6-9565-f8b7914829a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:32.292329 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a095bc-c9fb-42e6-9565-f8b7914829a8 service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:32.292612 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a095bc-c9fb-42e6-9565-f8b7914829a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:32.292887 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a095bc-c9fb-42e6-9565-f8b7914829a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:32.302057 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a095bc-c9fb-42e6-9565-f8b7914829a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:32.303489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a095bc-c9fb-42e6-9565-f8b7914829a8 service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:32.313048 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1248/2504] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:51:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:51:32.419057 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacff40-eb3f-4cda-a1e3-1c69fb574f40 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:32.429629 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacff40-eb3f-4cda-a1e3-1c69fb574f40 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:32.433260 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafd4ea-fd84-4f96-ab1c-e05cfe9005e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:32.433908 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafd4ea-fd84-4f96-ab1c-e05cfe9005e3 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:32.434186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafd4ea-fd84-4f96-ab1c-e05cfe9005e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:32.434455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafd4ea-fd84-4f96-ab1c-e05cfe9005e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:32.492094 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bafd4ea-fd84-4f96-ab1c-e05cfe9005e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:32.493479 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bafd4ea-fd84-4f96-ab1c-e05cfe9005e3 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:32.502451 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1257/2505] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:51:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:51:35.084316 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a095bc-c9fb-42e6-9565-f8b7914829a8 service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:35.145664 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a095bc-c9fb-42e6-9565-f8b7914829a8 service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:35.150112 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0570844-7574-4870-a770-4e908031a0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:35.150726 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0570844-7574-4870-a770-4e908031a0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:35.151001 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0570844-7574-4870-a770-4e908031a0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:35.151270 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0570844-7574-4870-a770-4e908031a0f4 admin admin] PATH_INFO: `/v3/users/2a404b53fd624c1aab75615bd42df690` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:35.152369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0570844-7574-4870-a770-4e908031a0f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a404b53fd624c1aab75615bd42df690)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:35.154303 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0570844-7574-4870-a770-4e908031a0f4 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:35.200165 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f0570844-7574-4870-a770-4e908031a0f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a404b53fd624c1aab75615bd42df690'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:35.200806 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f0570844-7574-4870-a770-4e908031a0f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a404b53fd624c1aab75615bd42df690'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:35.201405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f0570844-7574-4870-a770-4e908031a0f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a404b53fd624c1aab75615bd42df690'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:35.213903 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f0570844-7574-4870-a770-4e908031a0f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a404b53fd624c1aab75615bd42df690'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:35.222457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f0570844-7574-4870-a770-4e908031a0f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a404b53fd624c1aab75615bd42df690'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:35.223784 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:35.238446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1249/2506] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:51:35 2022] DELETE /identity/v3/users/2a404b53fd624c1aab75615bd42df690 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:35.242978 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd2d69-475d-4495-b299-03933d808c4f None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:35.243449 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd2d69-475d-4495-b299-03933d808c4f None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:35.243651 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd2d69-475d-4495-b299-03933d808c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:35.262820 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-b2bd2d69-475d-4495-b299-03933d808c4f None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:35.264046 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-b2bd2d69-475d-4495-b299-03933d808c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:35.307141 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:35.322906 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1258/2507] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:51:35.334456 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0570844-7574-4870-a770-4e908031a0f4 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:35.335906 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-f0570844-7574-4870-a770-4e908031a0f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:35.392435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0570844-7574-4870-a770-4e908031a0f4 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:35.396772 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1c1bc-6364-4355-a2ec-f96ad28c6d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:35.397374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1c1bc-6364-4355-a2ec-f96ad28c6d7d service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:35.397681 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1c1bc-6364-4355-a2ec-f96ad28c6d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:35.397961 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1c1bc-6364-4355-a2ec-f96ad28c6d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:35.406816 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1c1bc-6364-4355-a2ec-f96ad28c6d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:35.408223 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1c1bc-6364-4355-a2ec-f96ad28c6d7d service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:35.417587 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1250/2508] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:51:35.687235 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd2d69-475d-4495-b299-03933d808c4f None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:35.688720 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-b2bd2d69-475d-4495-b299-03933d808c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:35.701767 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd2d69-475d-4495-b299-03933d808c4f None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:35.706620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097f5ab-cf2d-4949-999f-dab18fcc6d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:35.707258 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097f5ab-cf2d-4949-999f-dab18fcc6d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:35.707539 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097f5ab-cf2d-4949-999f-dab18fcc6d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:35.707816 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097f5ab-cf2d-4949-999f-dab18fcc6d8b admin admin] PATH_INFO: `/v3/projects/9f80b8dbd623476b96c0baaf8153cc5e` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:35.708939 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097f5ab-cf2d-4949-999f-dab18fcc6d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f80b8dbd623476b96c0baaf8153cc5e)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:35.710865 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097f5ab-cf2d-4949-999f-dab18fcc6d8b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:35.758067 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0097f5ab-cf2d-4949-999f-dab18fcc6d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f80b8dbd623476b96c0baaf8153cc5e', 'request_id': 'req-0097f5ab-cf2d-4949-999f-dab18fcc6d8b'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:35.765141 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0097f5ab-cf2d-4949-999f-dab18fcc6d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f80b8dbd623476b96c0baaf8153cc5e', 'request_id': 'req-0097f5ab-cf2d-4949-999f-dab18fcc6d8b'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:35.771864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0097f5ab-cf2d-4949-999f-dab18fcc6d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f80b8dbd623476b96c0baaf8153cc5e', 'request_id': 'req-0097f5ab-cf2d-4949-999f-dab18fcc6d8b'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:35.782090 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0097f5ab-cf2d-4949-999f-dab18fcc6d8b admin admin] The token cache is being invalidate because project 9f80b8dbd623476b96c0baaf8153cc5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:51:35.782379 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0097f5ab-cf2d-4949-999f-dab18fcc6d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:35.783006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0097f5ab-cf2d-4949-999f-dab18fcc6d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:35.784668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1259/2509] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:51:35 2022] DELETE /identity/v3/projects/9f80b8dbd623476b96c0baaf8153cc5e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:35.788674 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1c1bc-6364-4355-a2ec-f96ad28c6d7d service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:35.798383 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1c1bc-6364-4355-a2ec-f96ad28c6d7d service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:35.855725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb1ba6-4904-44fe-83eb-960c66700148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:35.856349 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb1ba6-4904-44fe-83eb-960c66700148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:35.856625 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb1ba6-4904-44fe-83eb-960c66700148 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:35.856899 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb1ba6-4904-44fe-83eb-960c66700148 admin admin] PATH_INFO: `/v3/users/1d78418b78ce4b149c209a6ee107d1bc` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:35.858040 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb1ba6-4904-44fe-83eb-960c66700148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d78418b78ce4b149c209a6ee107d1bc)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:35.859960 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb1ba6-4904-44fe-83eb-960c66700148 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:35.906567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-d2cb1ba6-4904-44fe-83eb-960c66700148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d78418b78ce4b149c209a6ee107d1bc'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:35.907145 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-d2cb1ba6-4904-44fe-83eb-960c66700148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d78418b78ce4b149c209a6ee107d1bc'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:35.907746 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-d2cb1ba6-4904-44fe-83eb-960c66700148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d78418b78ce4b149c209a6ee107d1bc'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:35.928693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-d2cb1ba6-4904-44fe-83eb-960c66700148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d78418b78ce4b149c209a6ee107d1bc'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:35.935594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-d2cb1ba6-4904-44fe-83eb-960c66700148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d78418b78ce4b149c209a6ee107d1bc'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:35.948089 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1251/2510] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:51:35 2022] DELETE /identity/v3/users/1d78418b78ce4b149c209a6ee107d1bc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:36.217027 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097f5ab-cf2d-4949-999f-dab18fcc6d8b admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:36.218514 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-0097f5ab-cf2d-4949-999f-dab18fcc6d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:36.232377 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097f5ab-cf2d-4949-999f-dab18fcc6d8b admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:36.289176 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce38d58-97eb-4ea6-9c9c-e8f61ba350f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:36.289861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce38d58-97eb-4ea6-9c9c-e8f61ba350f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:36.290095 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce38d58-97eb-4ea6-9c9c-e8f61ba350f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:36.290369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce38d58-97eb-4ea6-9c9c-e8f61ba350f7 admin admin] PATH_INFO: `/v3/projects/9c900d9ad41b4a75bda90392a525d51b` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:36.291508 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce38d58-97eb-4ea6-9c9c-e8f61ba350f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c900d9ad41b4a75bda90392a525d51b)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:36.293389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce38d58-97eb-4ea6-9c9c-e8f61ba350f7 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:36.339242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-bce38d58-97eb-4ea6-9c9c-e8f61ba350f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c900d9ad41b4a75bda90392a525d51b', 'request_id': 'req-bce38d58-97eb-4ea6-9c9c-e8f61ba350f7'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:36.347668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-bce38d58-97eb-4ea6-9c9c-e8f61ba350f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c900d9ad41b4a75bda90392a525d51b', 'request_id': 'req-bce38d58-97eb-4ea6-9c9c-e8f61ba350f7'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:36.353920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-bce38d58-97eb-4ea6-9c9c-e8f61ba350f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c900d9ad41b4a75bda90392a525d51b', 'request_id': 'req-bce38d58-97eb-4ea6-9c9c-e8f61ba350f7'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:36.364808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-bce38d58-97eb-4ea6-9c9c-e8f61ba350f7 admin admin] The token cache is being invalidate because project 9c900d9ad41b4a75bda90392a525d51b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:51:36.365364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-bce38d58-97eb-4ea6-9c9c-e8f61ba350f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:36.366042 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-bce38d58-97eb-4ea6-9c9c-e8f61ba350f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:36.367544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1260/2511] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:51:36 2022] DELETE /identity/v3/projects/9c900d9ad41b4a75bda90392a525d51b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:36.372765 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730109d-d006-4541-a63d-3e4ffca6f9a2 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:36.373316 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730109d-d006-4541-a63d-3e4ffca6f9a2 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:36.373316 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730109d-d006-4541-a63d-3e4ffca6f9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:36.394362 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-7730109d-d006-4541-a63d-3e4ffca6f9a2 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:36.395551 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7730109d-d006-4541-a63d-3e4ffca6f9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:36.400895 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:36.457949 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1252/2512] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:51:36.467184 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a628cf5-4a7a-412f-ad17-d2aa4e2b164c None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:36.467469 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a628cf5-4a7a-412f-ad17-d2aa4e2b164c None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:36.467745 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a628cf5-4a7a-412f-ad17-d2aa4e2b164c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:36.476680 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:36.491611 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-0a628cf5-4a7a-412f-ad17-d2aa4e2b164c None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:36.492811 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-0a628cf5-4a7a-412f-ad17-d2aa4e2b164c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:36.500682 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1261/2513] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:36.505547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730109d-d006-4541-a63d-3e4ffca6f9a2 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:36.515289 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730109d-d006-4541-a63d-3e4ffca6f9a2 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:36.519976 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043aa96d-aa5f-4507-88e4-d00634cbe36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:36.520573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043aa96d-aa5f-4507-88e4-d00634cbe36e admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:36.520860 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043aa96d-aa5f-4507-88e4-d00634cbe36e admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:36.521148 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043aa96d-aa5f-4507-88e4-d00634cbe36e admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:36.521817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043aa96d-aa5f-4507-88e4-d00634cbe36e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:51:36.522122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043aa96d-aa5f-4507-88e4-d00634cbe36e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:36.523725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043aa96d-aa5f-4507-88e4-d00634cbe36e admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:36.535158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1253/2514] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:36.539346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a628cf5-4a7a-412f-ad17-d2aa4e2b164c None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:36.548694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a628cf5-4a7a-412f-ad17-d2aa4e2b164c None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:36.553850 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9f8e6-a3f6-45e0-a073-eb54d980d876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:36.554442 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9f8e6-a3f6-45e0-a073-eb54d980d876 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:36.554713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9f8e6-a3f6-45e0-a073-eb54d980d876 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:36.554981 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9f8e6-a3f6-45e0-a073-eb54d980d876 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:36.555607 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9f8e6-a3f6-45e0-a073-eb54d980d876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:36.557481 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9f8e6-a3f6-45e0-a073-eb54d980d876 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:36.585490 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1262/2515] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:51:36 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:51:36.589662 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043aa96d-aa5f-4507-88e4-d00634cbe36e admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:36.600333 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043aa96d-aa5f-4507-88e4-d00634cbe36e admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:36.656217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90bb53-bcfe-4000-8cd0-4d6e9902b1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:36.656817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90bb53-bcfe-4000-8cd0-4d6e9902b1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:36.657101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90bb53-bcfe-4000-8cd0-4d6e9902b1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:36.657373 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90bb53-bcfe-4000-8cd0-4d6e9902b1e1 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:36.658025 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90bb53-bcfe-4000-8cd0-4d6e9902b1e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:36.660592 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90bb53-bcfe-4000-8cd0-4d6e9902b1e1 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:36.681331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1254/2516] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:51:36 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:36.685435 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9f8e6-a3f6-45e0-a073-eb54d980d876 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:36.696083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9f8e6-a3f6-45e0-a073-eb54d980d876 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:36.700863 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3143823-711f-40ed-9b65-0e56d584267c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:36.701451 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3143823-711f-40ed-9b65-0e56d584267c admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:36.701762 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3143823-711f-40ed-9b65-0e56d584267c admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:36.702036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3143823-711f-40ed-9b65-0e56d584267c admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:36.702669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3143823-711f-40ed-9b65-0e56d584267c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:36.704259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3143823-711f-40ed-9b65-0e56d584267c admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:36.714722 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1263/2517] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:51:36.718888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90bb53-bcfe-4000-8cd0-4d6e9902b1e1 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:36.729631 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90bb53-bcfe-4000-8cd0-4d6e9902b1e1 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:36.734364 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1598e-0736-4b6d-af37-cfde0a2867ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:36.734990 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1598e-0736-4b6d-af37-cfde0a2867ac admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:36.735274 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1598e-0736-4b6d-af37-cfde0a2867ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:36.735552 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1598e-0736-4b6d-af37-cfde0a2867ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:36.736194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1598e-0736-4b6d-af37-cfde0a2867ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:36.738204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1598e-0736-4b6d-af37-cfde0a2867ac admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:36.748570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1255/2518] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:51:36.753119 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3143823-711f-40ed-9b65-0e56d584267c admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:36.763077 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3143823-711f-40ed-9b65-0e56d584267c admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:36.768665 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19506dc-1efb-4ba2-9016-1eed1bf8ebb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:36.769321 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19506dc-1efb-4ba2-9016-1eed1bf8ebb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:36.769633 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19506dc-1efb-4ba2-9016-1eed1bf8ebb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:36.769915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19506dc-1efb-4ba2-9016-1eed1bf8ebb5 admin admin] PATH_INFO: `/v3/projects/be1a1262551f4eb49749eaa2e5a11dc9/users/e15556cbfc1545dc8059713eda1bc8d5/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:36.784257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19506dc-1efb-4ba2-9016-1eed1bf8ebb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1a1262551f4eb49749eaa2e5a11dc9, user_id=e15556cbfc1545dc8059713eda1bc8d5, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:36.786919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19506dc-1efb-4ba2-9016-1eed1bf8ebb5 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:36.799656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1264/2519] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:51:36 2022] PUT /identity/v3/projects/be1a1262551f4eb49749eaa2e5a11dc9/users/e15556cbfc1545dc8059713eda1bc8d5/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:36.809960 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e25dad-5a88-4b07-b197-4f0332d00e0f None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:36.810250 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e25dad-5a88-4b07-b197-4f0332d00e0f None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:36.810530 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e25dad-5a88-4b07-b197-4f0332d00e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:36.840895 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-f0e25dad-5a88-4b07-b197-4f0332d00e0f None None] MFA Rules not processed for user `e15556cbfc1545dc8059713eda1bc8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:36.842145 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-f0e25dad-5a88-4b07-b197-4f0332d00e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:36.913937 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1256/2520] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:36.925140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19506dc-1efb-4ba2-9016-1eed1bf8ebb5 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:36.926951 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-b19506dc-1efb-4ba2-9016-1eed1bf8ebb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:36.984132 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19506dc-1efb-4ba2-9016-1eed1bf8ebb5 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:36.987970 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d9744-4fd7-4abc-863d-45934a7b0306 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:36.988570 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d9744-4fd7-4abc-863d-45934a7b0306 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:36.988851 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d9744-4fd7-4abc-863d-45934a7b0306 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:36.989124 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d9744-4fd7-4abc-863d-45934a7b0306 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:36.997488 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d9744-4fd7-4abc-863d-45934a7b0306 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:36.998924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d9744-4fd7-4abc-863d-45934a7b0306 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:37.008190 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1265/2521] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:51:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:51:37.030014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e25dad-5a88-4b07-b197-4f0332d00e0f None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:37.038831 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:37.094132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e25dad-5a88-4b07-b197-4f0332d00e0f None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:37.098841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f16885-b280-4902-ab51-25dfbe7590f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:37.100053 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f16885-b280-4902-ab51-25dfbe7590f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:37.100053 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f16885-b280-4902-ab51-25dfbe7590f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:37.100053 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f16885-b280-4902-ab51-25dfbe7590f2 admin admin] PATH_INFO: `/v3/users/e15556cbfc1545dc8059713eda1bc8d5` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:37.101136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f16885-b280-4902-ab51-25dfbe7590f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e15556cbfc1545dc8059713eda1bc8d5)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:37.103129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f16885-b280-4902-ab51-25dfbe7590f2 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:37.152067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c5f16885-b280-4902-ab51-25dfbe7590f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e15556cbfc1545dc8059713eda1bc8d5'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:37.152737 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c5f16885-b280-4902-ab51-25dfbe7590f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e15556cbfc1545dc8059713eda1bc8d5'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:37.153364 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c5f16885-b280-4902-ab51-25dfbe7590f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e15556cbfc1545dc8059713eda1bc8d5'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:37.165489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c5f16885-b280-4902-ab51-25dfbe7590f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e15556cbfc1545dc8059713eda1bc8d5'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:37.173094 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c5f16885-b280-4902-ab51-25dfbe7590f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e15556cbfc1545dc8059713eda1bc8d5'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:37.186130 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1257/2522] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:51:37 2022] DELETE /identity/v3/users/e15556cbfc1545dc8059713eda1bc8d5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:37.191178 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fde4b8-d8d8-4d3a-98fa-c68defeb96b2 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:37.191436 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fde4b8-d8d8-4d3a-98fa-c68defeb96b2 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:37.191717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fde4b8-d8d8-4d3a-98fa-c68defeb96b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:37.212932 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-66fde4b8-d8d8-4d3a-98fa-c68defeb96b2 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:37.214175 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-66fde4b8-d8d8-4d3a-98fa-c68defeb96b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:37.274585 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1266/2523] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:37.284176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f16885-b280-4902-ab51-25dfbe7590f2 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:37.285687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-c5f16885-b280-4902-ab51-25dfbe7590f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:37.346402 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f16885-b280-4902-ab51-25dfbe7590f2 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:37.350072 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d4abb-1453-465d-be4c-253e36d8d54c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:37.350679 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d4abb-1453-465d-be4c-253e36d8d54c service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:37.350960 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d4abb-1453-465d-be4c-253e36d8d54c service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:37.351234 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d4abb-1453-465d-be4c-253e36d8d54c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:37.360427 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d4abb-1453-465d-be4c-253e36d8d54c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:37.362437 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d4abb-1453-465d-be4c-253e36d8d54c service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:37.372404 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1258/2524] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:51:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:51:37.642153 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fde4b8-d8d8-4d3a-98fa-c68defeb96b2 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:37.643627 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-66fde4b8-d8d8-4d3a-98fa-c68defeb96b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:37.655894 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fde4b8-d8d8-4d3a-98fa-c68defeb96b2 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:37.661889 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a661a3e-4e0c-43e1-b65a-d3ff0c226435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:37.662562 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a661a3e-4e0c-43e1-b65a-d3ff0c226435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:37.662808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a661a3e-4e0c-43e1-b65a-d3ff0c226435 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:37.663152 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a661a3e-4e0c-43e1-b65a-d3ff0c226435 admin admin] PATH_INFO: `/v3/projects/be1a1262551f4eb49749eaa2e5a11dc9` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:37.664576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a661a3e-4e0c-43e1-b65a-d3ff0c226435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be1a1262551f4eb49749eaa2e5a11dc9)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:37.666494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a661a3e-4e0c-43e1-b65a-d3ff0c226435 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:37.708943 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:37.719178 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-7a661a3e-4e0c-43e1-b65a-d3ff0c226435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be1a1262551f4eb49749eaa2e5a11dc9', 'request_id': 'req-7a661a3e-4e0c-43e1-b65a-d3ff0c226435'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:37.726862 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-7a661a3e-4e0c-43e1-b65a-d3ff0c226435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be1a1262551f4eb49749eaa2e5a11dc9', 'request_id': 'req-7a661a3e-4e0c-43e1-b65a-d3ff0c226435'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:37.733290 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-7a661a3e-4e0c-43e1-b65a-d3ff0c226435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be1a1262551f4eb49749eaa2e5a11dc9', 'request_id': 'req-7a661a3e-4e0c-43e1-b65a-d3ff0c226435'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:37.744109 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-7a661a3e-4e0c-43e1-b65a-d3ff0c226435 admin admin] The token cache is being invalidate because project be1a1262551f4eb49749eaa2e5a11dc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:51:37.744400 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-7a661a3e-4e0c-43e1-b65a-d3ff0c226435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:37.745036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-7a661a3e-4e0c-43e1-b65a-d3ff0c226435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:37.746557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1267/2525] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:51:37 2022] DELETE /identity/v3/projects/be1a1262551f4eb49749eaa2e5a11dc9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:37.751405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9a2fb-4b1e-4f32-bb60-919c10b04199 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:37.751889 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9a2fb-4b1e-4f32-bb60-919c10b04199 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:37.751983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9a2fb-4b1e-4f32-bb60-919c10b04199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:37.770852 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-7ab9a2fb-4b1e-4f32-bb60-919c10b04199 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:37.772043 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7ab9a2fb-4b1e-4f32-bb60-919c10b04199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:37.796098 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:37.833090 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1259/2526] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:37.841997 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ed8c3-2360-463d-b6f2-25fdd1b6d0da None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:37.842284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ed8c3-2360-463d-b6f2-25fdd1b6d0da None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:37.842559 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ed8c3-2360-463d-b6f2-25fdd1b6d0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:37.863138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-6b1ed8c3-2360-463d-b6f2-25fdd1b6d0da None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:37.864505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-6b1ed8c3-2360-463d-b6f2-25fdd1b6d0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:37.872627 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1268/2527] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:37.877176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9a2fb-4b1e-4f32-bb60-919c10b04199 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:37.887483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9a2fb-4b1e-4f32-bb60-919c10b04199 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:37.892002 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f60b0-8d65-44b4-b794-75aeca6fa2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:37.892590 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f60b0-8d65-44b4-b794-75aeca6fa2d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:37.892893 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f60b0-8d65-44b4-b794-75aeca6fa2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:37.893168 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f60b0-8d65-44b4-b794-75aeca6fa2d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:37.893828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f60b0-8d65-44b4-b794-75aeca6fa2d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:51:37.894130 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f60b0-8d65-44b4-b794-75aeca6fa2d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:37.895703 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f60b0-8d65-44b4-b794-75aeca6fa2d7 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:37.906974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1260/2528] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:37.911202 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ed8c3-2360-463d-b6f2-25fdd1b6d0da None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:37.920553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ed8c3-2360-463d-b6f2-25fdd1b6d0da None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:37.925917 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4c1bc-cfda-4250-99ed-eeaf63800e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:37.926514 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4c1bc-cfda-4250-99ed-eeaf63800e02 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:37.926790 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4c1bc-cfda-4250-99ed-eeaf63800e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:37.927065 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4c1bc-cfda-4250-99ed-eeaf63800e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:37.927676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4c1bc-cfda-4250-99ed-eeaf63800e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:37.929599 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4c1bc-cfda-4250-99ed-eeaf63800e02 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:37.957131 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1269/2529] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:51:37 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:37.961270 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f60b0-8d65-44b4-b794-75aeca6fa2d7 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:37.971502 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f60b0-8d65-44b4-b794-75aeca6fa2d7 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:38.027509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2efa3-0fff-428a-8f3c-f4d994c33d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:38.028101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2efa3-0fff-428a-8f3c-f4d994c33d12 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:38.028376 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2efa3-0fff-428a-8f3c-f4d994c33d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:38.028646 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2efa3-0fff-428a-8f3c-f4d994c33d12 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:38.029268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2efa3-0fff-428a-8f3c-f4d994c33d12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:38.031203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2efa3-0fff-428a-8f3c-f4d994c33d12 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:38.052469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1261/2530] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:51:37 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:38.056608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4c1bc-cfda-4250-99ed-eeaf63800e02 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:38.068342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4c1bc-cfda-4250-99ed-eeaf63800e02 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:38.072896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804a9eb-be67-4998-a065-3585147e125e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:38.073502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804a9eb-be67-4998-a065-3585147e125e admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:38.073779 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804a9eb-be67-4998-a065-3585147e125e admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:38.074044 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804a9eb-be67-4998-a065-3585147e125e admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:38.074697 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804a9eb-be67-4998-a065-3585147e125e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:38.076258 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b804a9eb-be67-4998-a065-3585147e125e admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:38.086065 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1270/2531] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:51:38.089865 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2efa3-0fff-428a-8f3c-f4d994c33d12 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:38.100369 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2efa3-0fff-428a-8f3c-f4d994c33d12 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:38.104988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613480b8-0b4b-4e81-84ec-722413f553c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:38.105618 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613480b8-0b4b-4e81-84ec-722413f553c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:38.105902 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613480b8-0b4b-4e81-84ec-722413f553c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:38.106177 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613480b8-0b4b-4e81-84ec-722413f553c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:38.106819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613480b8-0b4b-4e81-84ec-722413f553c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:38.108400 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613480b8-0b4b-4e81-84ec-722413f553c7 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:38.119469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1262/2532] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:51:38.123447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804a9eb-be67-4998-a065-3585147e125e admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:38.134128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804a9eb-be67-4998-a065-3585147e125e admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:38.138901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53a34f-9607-4178-a907-97328d036f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:38.139554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53a34f-9607-4178-a907-97328d036f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:38.139833 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53a34f-9607-4178-a907-97328d036f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:38.140111 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53a34f-9607-4178-a907-97328d036f04 admin admin] PATH_INFO: `/v3/projects/fb62e27875574535b994534e87b4eefb/users/eed7e6be506d4fe9bda7f060619dabc2/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:38.155447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53a34f-9607-4178-a907-97328d036f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb62e27875574535b994534e87b4eefb, user_id=eed7e6be506d4fe9bda7f060619dabc2, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:38.158117 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53a34f-9607-4178-a907-97328d036f04 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:38.171312 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1271/2533] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:51:38 2022] PUT /identity/v3/projects/fb62e27875574535b994534e87b4eefb/users/eed7e6be506d4fe9bda7f060619dabc2/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:38.181703 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec3d25-f9d6-4603-8fa4-b50dc19b1360 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:38.181988 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec3d25-f9d6-4603-8fa4-b50dc19b1360 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:38.182261 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec3d25-f9d6-4603-8fa4-b50dc19b1360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:38.209743 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-0dec3d25-f9d6-4603-8fa4-b50dc19b1360 None None] MFA Rules not processed for user `eed7e6be506d4fe9bda7f060619dabc2`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:38.210946 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-0dec3d25-f9d6-4603-8fa4-b50dc19b1360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:38.276653 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1263/2534] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:38.287483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53a34f-9607-4178-a907-97328d036f04 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:38.289194 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-0f53a34f-9607-4178-a907-97328d036f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:38.346300 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53a34f-9607-4178-a907-97328d036f04 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:38.350131 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bddad7-ce82-43d9-a7d7-1b4268a245fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:38.350737 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bddad7-ce82-43d9-a7d7-1b4268a245fb service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:38.351019 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bddad7-ce82-43d9-a7d7-1b4268a245fb service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:38.351296 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bddad7-ce82-43d9-a7d7-1b4268a245fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:38.359669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bddad7-ce82-43d9-a7d7-1b4268a245fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:38.361079 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bddad7-ce82-43d9-a7d7-1b4268a245fb service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:38.369951 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1272/2535] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:51:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:51:43.681264 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec3d25-f9d6-4603-8fa4-b50dc19b1360 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:43.707601 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:43.745309 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec3d25-f9d6-4603-8fa4-b50dc19b1360 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:43.749902 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1875b3-6efa-4dac-b6b5-6b76360caf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:43.750532 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1875b3-6efa-4dac-b6b5-6b76360caf7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:43.750813 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1875b3-6efa-4dac-b6b5-6b76360caf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:43.751090 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1875b3-6efa-4dac-b6b5-6b76360caf7e admin admin] PATH_INFO: `/v3/users/eed7e6be506d4fe9bda7f060619dabc2` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:43.752212 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1875b3-6efa-4dac-b6b5-6b76360caf7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed7e6be506d4fe9bda7f060619dabc2)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:43.754179 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1875b3-6efa-4dac-b6b5-6b76360caf7e admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:43.799753 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-6d1875b3-6efa-4dac-b6b5-6b76360caf7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed7e6be506d4fe9bda7f060619dabc2'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:43.800419 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-6d1875b3-6efa-4dac-b6b5-6b76360caf7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed7e6be506d4fe9bda7f060619dabc2'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:43.801030 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-6d1875b3-6efa-4dac-b6b5-6b76360caf7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed7e6be506d4fe9bda7f060619dabc2'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:43.813088 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-6d1875b3-6efa-4dac-b6b5-6b76360caf7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed7e6be506d4fe9bda7f060619dabc2'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:43.821716 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-6d1875b3-6efa-4dac-b6b5-6b76360caf7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed7e6be506d4fe9bda7f060619dabc2'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:43.835487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1264/2536] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:51:43 2022] DELETE /identity/v3/users/eed7e6be506d4fe9bda7f060619dabc2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:43.839961 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5970997-8080-4f93-a60a-382e21911490 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:43.840703 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5970997-8080-4f93-a60a-382e21911490 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:43.840822 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5970997-8080-4f93-a60a-382e21911490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:43.859891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-a5970997-8080-4f93-a60a-382e21911490 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:43.861072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a5970997-8080-4f93-a60a-382e21911490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:43.920259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1273/2537] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:43.930041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1875b3-6efa-4dac-b6b5-6b76360caf7e admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:43.931440 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-6d1875b3-6efa-4dac-b6b5-6b76360caf7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:43.988476 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1875b3-6efa-4dac-b6b5-6b76360caf7e admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:43.992125 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c468832-271e-48a5-b0ed-f1eac2acae6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:43.992742 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c468832-271e-48a5-b0ed-f1eac2acae6b service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:43.993009 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c468832-271e-48a5-b0ed-f1eac2acae6b service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:43.993285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c468832-271e-48a5-b0ed-f1eac2acae6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:44.002746 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c468832-271e-48a5-b0ed-f1eac2acae6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:44.004188 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c468832-271e-48a5-b0ed-f1eac2acae6b service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:44.013558 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1265/2538] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:51:44.284576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5970997-8080-4f93-a60a-382e21911490 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:44.286296 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a5970997-8080-4f93-a60a-382e21911490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:44.295977 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:44.300492 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5970997-8080-4f93-a60a-382e21911490 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:44.308739 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c49ea3-8658-46d8-9877-63bde8babebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:44.309838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c49ea3-8658-46d8-9877-63bde8babebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:44.310187 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c49ea3-8658-46d8-9877-63bde8babebe admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:44.310664 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c49ea3-8658-46d8-9877-63bde8babebe admin admin] PATH_INFO: `/v3/projects/fb62e27875574535b994534e87b4eefb` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:44.312112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c49ea3-8658-46d8-9877-63bde8babebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb62e27875574535b994534e87b4eefb)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:44.314306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c49ea3-8658-46d8-9877-63bde8babebe admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:44.361749 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-80c49ea3-8658-46d8-9877-63bde8babebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb62e27875574535b994534e87b4eefb', 'request_id': 'req-80c49ea3-8658-46d8-9877-63bde8babebe'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:44.368925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-80c49ea3-8658-46d8-9877-63bde8babebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb62e27875574535b994534e87b4eefb', 'request_id': 'req-80c49ea3-8658-46d8-9877-63bde8babebe'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:44.375244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-80c49ea3-8658-46d8-9877-63bde8babebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb62e27875574535b994534e87b4eefb', 'request_id': 'req-80c49ea3-8658-46d8-9877-63bde8babebe'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:44.386331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-80c49ea3-8658-46d8-9877-63bde8babebe admin admin] The token cache is being invalidate because project fb62e27875574535b994534e87b4eefb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:51:44.386617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-80c49ea3-8658-46d8-9877-63bde8babebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:44.387256 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-80c49ea3-8658-46d8-9877-63bde8babebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:44.388760 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1274/2539] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:51:44 2022] DELETE /identity/v3/projects/fb62e27875574535b994534e87b4eefb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:44.394283 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df1000-e3ff-4ea8-b0a0-1bf47e05dd94 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:44.394568 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df1000-e3ff-4ea8-b0a0-1bf47e05dd94 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:44.395197 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df1000-e3ff-4ea8-b0a0-1bf47e05dd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:44.414653 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-68df1000-e3ff-4ea8-b0a0-1bf47e05dd94 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:44.415860 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-68df1000-e3ff-4ea8-b0a0-1bf47e05dd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:44.457572 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:44.476946 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1266/2540] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:44.485816 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9854d-31e9-40a6-8978-9471ddd56f54 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:44.486121 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9854d-31e9-40a6-8978-9471ddd56f54 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:44.487576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9854d-31e9-40a6-8978-9471ddd56f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:44.510898 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-eef9854d-31e9-40a6-8978-9471ddd56f54 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:44.512100 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-eef9854d-31e9-40a6-8978-9471ddd56f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:44.520709 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1275/2541] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:51:44.524995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df1000-e3ff-4ea8-b0a0-1bf47e05dd94 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:44.534736 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df1000-e3ff-4ea8-b0a0-1bf47e05dd94 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:44.539491 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e76ce8-2402-43c1-907a-ea73ab73aa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:44.540122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e76ce8-2402-43c1-907a-ea73ab73aa1f admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:44.540512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e76ce8-2402-43c1-907a-ea73ab73aa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:44.540789 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e76ce8-2402-43c1-907a-ea73ab73aa1f admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:44.541434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e76ce8-2402-43c1-907a-ea73ab73aa1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:51:44.541766 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e76ce8-2402-43c1-907a-ea73ab73aa1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:44.543375 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e76ce8-2402-43c1-907a-ea73ab73aa1f admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:44.555151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1267/2542] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:44.559325 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9854d-31e9-40a6-8978-9471ddd56f54 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:44.569320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9854d-31e9-40a6-8978-9471ddd56f54 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:44.574019 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a639b-d284-435e-8294-79ac4a11b9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:44.574607 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a639b-d284-435e-8294-79ac4a11b9df admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:44.574887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a639b-d284-435e-8294-79ac4a11b9df admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:44.575169 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a639b-d284-435e-8294-79ac4a11b9df admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:44.575819 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a639b-d284-435e-8294-79ac4a11b9df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:44.577729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a639b-d284-435e-8294-79ac4a11b9df admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:44.605056 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1276/2543] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:51:44 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:44.609341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e76ce8-2402-43c1-907a-ea73ab73aa1f admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:44.619945 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e76ce8-2402-43c1-907a-ea73ab73aa1f admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:44.676792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6db3f-d577-4ab3-b86d-a512fd8fcdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:44.677397 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6db3f-d577-4ab3-b86d-a512fd8fcdf2 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:44.677710 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6db3f-d577-4ab3-b86d-a512fd8fcdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:44.677987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6db3f-d577-4ab3-b86d-a512fd8fcdf2 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:44.678605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6db3f-d577-4ab3-b86d-a512fd8fcdf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:44.680513 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6db3f-d577-4ab3-b86d-a512fd8fcdf2 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:44.702069 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1268/2544] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:51:44 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:44.706300 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a639b-d284-435e-8294-79ac4a11b9df admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:44.716975 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a639b-d284-435e-8294-79ac4a11b9df admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:44.721871 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec521b3b-8df5-434e-bb59-641104369d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:44.722462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec521b3b-8df5-434e-bb59-641104369d4e admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:44.722769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec521b3b-8df5-434e-bb59-641104369d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:44.723045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec521b3b-8df5-434e-bb59-641104369d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:44.723683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec521b3b-8df5-434e-bb59-641104369d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:44.725259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec521b3b-8df5-434e-bb59-641104369d4e admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:44.735047 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1277/2545] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:51:44.739398 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6db3f-d577-4ab3-b86d-a512fd8fcdf2 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:44.749567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6db3f-d577-4ab3-b86d-a512fd8fcdf2 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:44.754680 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9be9f-17cc-4db0-b3a9-6ba67bdd331b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:44.755266 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9be9f-17cc-4db0-b3a9-6ba67bdd331b admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:44.755545 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9be9f-17cc-4db0-b3a9-6ba67bdd331b admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:44.755819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9be9f-17cc-4db0-b3a9-6ba67bdd331b admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:44.756453 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9be9f-17cc-4db0-b3a9-6ba67bdd331b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:44.758059 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9be9f-17cc-4db0-b3a9-6ba67bdd331b admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:44.768500 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1269/2546] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:51:44.772656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec521b3b-8df5-434e-bb59-641104369d4e admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:44.782616 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec521b3b-8df5-434e-bb59-641104369d4e admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:44.787297 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c3f03-53f5-42ed-a705-348c7108ab3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:44.787939 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c3f03-53f5-42ed-a705-348c7108ab3a admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:44.788219 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c3f03-53f5-42ed-a705-348c7108ab3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:44.788494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c3f03-53f5-42ed-a705-348c7108ab3a admin admin] PATH_INFO: `/v3/projects/bf31a31569bf4941b1039cfd595d088f/users/f6f6cb18141d4379b30bc6a8aa2ebb42/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:44.803209 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c3f03-53f5-42ed-a705-348c7108ab3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf31a31569bf4941b1039cfd595d088f, user_id=f6f6cb18141d4379b30bc6a8aa2ebb42, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:44.805873 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c3f03-53f5-42ed-a705-348c7108ab3a admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:44.819202 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1278/2547] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:51:44 2022] PUT /identity/v3/projects/bf31a31569bf4941b1039cfd595d088f/users/f6f6cb18141d4379b30bc6a8aa2ebb42/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:44.884104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b26bb1-f24c-48e3-bd10-5ff77f8bbc65 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:44.884298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b26bb1-f24c-48e3-bd10-5ff77f8bbc65 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:44.884571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b26bb1-f24c-48e3-bd10-5ff77f8bbc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:44.912154 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-83b26bb1-f24c-48e3-bd10-5ff77f8bbc65 None None] MFA Rules not processed for user `f6f6cb18141d4379b30bc6a8aa2ebb42`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:44.913371 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-83b26bb1-f24c-48e3-bd10-5ff77f8bbc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:44.978528 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1270/2548] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:44.990128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c3f03-53f5-42ed-a705-348c7108ab3a admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:44.991836 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-0a0c3f03-53f5-42ed-a705-348c7108ab3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:45.048247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c3f03-53f5-42ed-a705-348c7108ab3a admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:45.052434 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7504c6-9ec3-4f2e-9318-4661793a9c77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:45.053030 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7504c6-9ec3-4f2e-9318-4661793a9c77 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:45.053308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7504c6-9ec3-4f2e-9318-4661793a9c77 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:45.053616 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7504c6-9ec3-4f2e-9318-4661793a9c77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:45.061749 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7504c6-9ec3-4f2e-9318-4661793a9c77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:45.063159 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7504c6-9ec3-4f2e-9318-4661793a9c77 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:45.071769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1279/2549] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:51:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:51:54.975627 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=78,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:55.067955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:58.552605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b26bb1-f24c-48e3-bd10-5ff77f8bbc65 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:58.618694 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b26bb1-f24c-48e3-bd10-5ff77f8bbc65 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:58.624054 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219755b-c714-46f6-bc6f-0b7bce4597d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:58.624684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219755b-c714-46f6-bc6f-0b7bce4597d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:58.624961 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219755b-c714-46f6-bc6f-0b7bce4597d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:58.625233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219755b-c714-46f6-bc6f-0b7bce4597d9 admin admin] PATH_INFO: `/v3/users/f6f6cb18141d4379b30bc6a8aa2ebb42` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:58.626444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219755b-c714-46f6-bc6f-0b7bce4597d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6f6cb18141d4379b30bc6a8aa2ebb42)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:58.628841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219755b-c714-46f6-bc6f-0b7bce4597d9 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:58.676102 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f219755b-c714-46f6-bc6f-0b7bce4597d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6f6cb18141d4379b30bc6a8aa2ebb42'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:58.676750 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f219755b-c714-46f6-bc6f-0b7bce4597d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6f6cb18141d4379b30bc6a8aa2ebb42'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:58.677358 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f219755b-c714-46f6-bc6f-0b7bce4597d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6f6cb18141d4379b30bc6a8aa2ebb42'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:58.689136 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f219755b-c714-46f6-bc6f-0b7bce4597d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6f6cb18141d4379b30bc6a8aa2ebb42'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:58.696715 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f219755b-c714-46f6-bc6f-0b7bce4597d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6f6cb18141d4379b30bc6a8aa2ebb42'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:58.708837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1271/2550] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:51:58 2022] DELETE /identity/v3/users/f6f6cb18141d4379b30bc6a8aa2ebb42 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:58.713595 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf0eb2-6571-4b2d-b732-69a7209e9ebd None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:58.714084 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf0eb2-6571-4b2d-b732-69a7209e9ebd None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:58.714200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf0eb2-6571-4b2d-b732-69a7209e9ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:58.734370 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-a3cf0eb2-6571-4b2d-b732-69a7209e9ebd None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:58.736167 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a3cf0eb2-6571-4b2d-b732-69a7209e9ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:58.793850 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1280/2551] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:58.804283 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219755b-c714-46f6-bc6f-0b7bce4597d9 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:58.805705 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-f219755b-c714-46f6-bc6f-0b7bce4597d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:58.867837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219755b-c714-46f6-bc6f-0b7bce4597d9 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:58.871535 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e3c63-8ab2-4481-9353-439426dd084b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:58.872141 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e3c63-8ab2-4481-9353-439426dd084b service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:58.872426 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e3c63-8ab2-4481-9353-439426dd084b service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:58.872704 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e3c63-8ab2-4481-9353-439426dd084b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:58.881759 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e3c63-8ab2-4481-9353-439426dd084b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:58.883186 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e3c63-8ab2-4481-9353-439426dd084b service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:58.894149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1272/2552] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:51:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:51:59.165604 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf0eb2-6571-4b2d-b732-69a7209e9ebd None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:59.167043 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a3cf0eb2-6571-4b2d-b732-69a7209e9ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:59.180412 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf0eb2-6571-4b2d-b732-69a7209e9ebd None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:59.185125 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2089a33-20e9-4048-9ab7-7918f6242cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:59.185785 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2089a33-20e9-4048-9ab7-7918f6242cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:59.186060 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2089a33-20e9-4048-9ab7-7918f6242cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:59.186332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2089a33-20e9-4048-9ab7-7918f6242cf8 admin admin] PATH_INFO: `/v3/projects/bf31a31569bf4941b1039cfd595d088f` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:59.187447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2089a33-20e9-4048-9ab7-7918f6242cf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf31a31569bf4941b1039cfd595d088f)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:59.190096 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2089a33-20e9-4048-9ab7-7918f6242cf8 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:59.239017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b2089a33-20e9-4048-9ab7-7918f6242cf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf31a31569bf4941b1039cfd595d088f', 'request_id': 'req-b2089a33-20e9-4048-9ab7-7918f6242cf8'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:59.246828 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b2089a33-20e9-4048-9ab7-7918f6242cf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf31a31569bf4941b1039cfd595d088f', 'request_id': 'req-b2089a33-20e9-4048-9ab7-7918f6242cf8'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:59.253397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b2089a33-20e9-4048-9ab7-7918f6242cf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf31a31569bf4941b1039cfd595d088f', 'request_id': 'req-b2089a33-20e9-4048-9ab7-7918f6242cf8'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:59.263817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b2089a33-20e9-4048-9ab7-7918f6242cf8 admin admin] The token cache is being invalidate because project bf31a31569bf4941b1039cfd595d088f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:51:59.264102 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b2089a33-20e9-4048-9ab7-7918f6242cf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:59.264733 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b2089a33-20e9-4048-9ab7-7918f6242cf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:51:59.266292 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1281/2553] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:51:59 2022] DELETE /identity/v3/projects/bf31a31569bf4941b1039cfd595d088f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:51:59.271316 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ff1cb-fb86-421b-8593-6699307f13af None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:59.271604 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ff1cb-fb86-421b-8593-6699307f13af None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:59.271882 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ff1cb-fb86-421b-8593-6699307f13af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:59.291779 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-490ff1cb-fb86-421b-8593-6699307f13af None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:59.292919 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-490ff1cb-fb86-421b-8593-6699307f13af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:59.309989 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:59.355236 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1273/2554] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:59.363498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296f5ba-59e6-4eee-8e7d-1d049ea1492f None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:59.363783 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296f5ba-59e6-4eee-8e7d-1d049ea1492f None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:59.364059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296f5ba-59e6-4eee-8e7d-1d049ea1492f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:59.386542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-a296f5ba-59e6-4eee-8e7d-1d049ea1492f None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:59.387706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a296f5ba-59e6-4eee-8e7d-1d049ea1492f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:59.395888 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1282/2555] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:59.400294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ff1cb-fb86-421b-8593-6699307f13af None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:59.411231 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ff1cb-fb86-421b-8593-6699307f13af None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:59.416155 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c38c1-505b-43f7-b5a9-fe32921ce253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:59.416768 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c38c1-505b-43f7-b5a9-fe32921ce253 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:59.417066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c38c1-505b-43f7-b5a9-fe32921ce253 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:59.417331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c38c1-505b-43f7-b5a9-fe32921ce253 admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:59.418095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c38c1-505b-43f7-b5a9-fe32921ce253 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:51:59.418404 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c38c1-505b-43f7-b5a9-fe32921ce253 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:59.420000 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c38c1-505b-43f7-b5a9-fe32921ce253 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:59.432804 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1274/2556] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:51:59.437122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296f5ba-59e6-4eee-8e7d-1d049ea1492f None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:59.447545 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296f5ba-59e6-4eee-8e7d-1d049ea1492f None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:59.452288 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35773dc6-c95d-41f2-b5c3-76bddf08d546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:59.452884 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35773dc6-c95d-41f2-b5c3-76bddf08d546 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:59.453161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35773dc6-c95d-41f2-b5c3-76bddf08d546 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:59.453434 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35773dc6-c95d-41f2-b5c3-76bddf08d546 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:59.454091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35773dc6-c95d-41f2-b5c3-76bddf08d546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:59.456375 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35773dc6-c95d-41f2-b5c3-76bddf08d546 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:59.483925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1283/2557] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:51:59 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:59.488766 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c38c1-505b-43f7-b5a9-fe32921ce253 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:59.498831 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c38c1-505b-43f7-b5a9-fe32921ce253 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:59.557114 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08254a6-74a9-4606-b662-1dfd1eb1c7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:59.557811 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08254a6-74a9-4606-b662-1dfd1eb1c7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:59.557931 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08254a6-74a9-4606-b662-1dfd1eb1c7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:59.558208 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08254a6-74a9-4606-b662-1dfd1eb1c7b7 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:59.558832 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08254a6-74a9-4606-b662-1dfd1eb1c7b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:59.560739 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08254a6-74a9-4606-b662-1dfd1eb1c7b7 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:59.583037 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1275/2558] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:51:59 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:59.587170 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35773dc6-c95d-41f2-b5c3-76bddf08d546 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:59.598064 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35773dc6-c95d-41f2-b5c3-76bddf08d546 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:59.602647 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5c6ae-5597-450f-a46c-8844c2a82965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:59.603236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5c6ae-5597-450f-a46c-8844c2a82965 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:59.603541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5c6ae-5597-450f-a46c-8844c2a82965 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:59.603810 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5c6ae-5597-450f-a46c-8844c2a82965 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:59.604443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5c6ae-5597-450f-a46c-8844c2a82965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:59.606030 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5c6ae-5597-450f-a46c-8844c2a82965 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:59.618669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1284/2559] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:51:59.622551 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08254a6-74a9-4606-b662-1dfd1eb1c7b7 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:59.633522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08254a6-74a9-4606-b662-1dfd1eb1c7b7 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:59.638093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082850f5-0dba-4bc2-9e89-0d9aadf0058f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:59.638680 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082850f5-0dba-4bc2-9e89-0d9aadf0058f admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:59.638992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082850f5-0dba-4bc2-9e89-0d9aadf0058f admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:59.639266 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082850f5-0dba-4bc2-9e89-0d9aadf0058f admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:59.639902 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082850f5-0dba-4bc2-9e89-0d9aadf0058f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:59.641498 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082850f5-0dba-4bc2-9e89-0d9aadf0058f admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:59.652138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1276/2560] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:51:59.656043 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5c6ae-5597-450f-a46c-8844c2a82965 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:59.669886 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5c6ae-5597-450f-a46c-8844c2a82965 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:59.671072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9621c-acb5-4b10-9f2d-3fd31a503328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:59.671723 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9621c-acb5-4b10-9f2d-3fd31a503328 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:59.671996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9621c-acb5-4b10-9f2d-3fd31a503328 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:59.672265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9621c-acb5-4b10-9f2d-3fd31a503328 admin admin] PATH_INFO: `/v3/projects/073767dbd75b4eecad6c4b413ff43b29/users/8eebb6b3e15e4c0c8ff23984ebac5153/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:59.691869 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9621c-acb5-4b10-9f2d-3fd31a503328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=073767dbd75b4eecad6c4b413ff43b29, user_id=8eebb6b3e15e4c0c8ff23984ebac5153, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:59.694566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9621c-acb5-4b10-9f2d-3fd31a503328 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:59.707279 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1285/2561] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:51:59 2022] PUT /identity/v3/projects/073767dbd75b4eecad6c4b413ff43b29/users/8eebb6b3e15e4c0c8ff23984ebac5153/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:51:59.719151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bd4ae-2f9e-46ab-8a68-ede655dea745 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:59.719442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bd4ae-2f9e-46ab-8a68-ede655dea745 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:59.719722 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bd4ae-2f9e-46ab-8a68-ede655dea745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:59.747519 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-e56bd4ae-2f9e-46ab-8a68-ede655dea745 None None] MFA Rules not processed for user `8eebb6b3e15e4c0c8ff23984ebac5153`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:51:59.748732 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e56bd4ae-2f9e-46ab-8a68-ede655dea745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:51:59.817999 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1277/2562] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:51:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:51:59.822410 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9621c-acb5-4b10-9f2d-3fd31a503328 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:59.843698 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:59.887601 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9621c-acb5-4b10-9f2d-3fd31a503328 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:59.892259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b526d-00d8-44f9-a888-871f88e91129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:59.892887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b526d-00d8-44f9-a888-871f88e91129 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:59.893160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b526d-00d8-44f9-a888-871f88e91129 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:59.893429 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b526d-00d8-44f9-a888-871f88e91129 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:59.894074 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b526d-00d8-44f9-a888-871f88e91129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:59.895942 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b526d-00d8-44f9-a888-871f88e91129 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:51:59.921816 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1286/2563] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:51:59 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:51:59.926575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bd4ae-2f9e-46ab-8a68-ede655dea745 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:51:59.937145 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bd4ae-2f9e-46ab-8a68-ede655dea745 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:51:59.949678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:59.995361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4f296-f12f-409d-a729-2c5913fc26b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:51:59.995966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4f296-f12f-409d-a729-2c5913fc26b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:51:59.996249 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4f296-f12f-409d-a729-2c5913fc26b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:51:59.996522 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4f296-f12f-409d-a729-2c5913fc26b1 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:51:59.997140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4f296-f12f-409d-a729-2c5913fc26b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:51:59.999113 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4f296-f12f-409d-a729-2c5913fc26b1 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:00.019484 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1278/2564] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:51:59 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:52:00.023541 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b526d-00d8-44f9-a888-871f88e91129 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:00.034531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b526d-00d8-44f9-a888-871f88e91129 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:00.039222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fa8be-f37b-426c-b13a-cf41fde1ec33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:00.039824 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fa8be-f37b-426c-b13a-cf41fde1ec33 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:00.040102 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fa8be-f37b-426c-b13a-cf41fde1ec33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:00.040384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fa8be-f37b-426c-b13a-cf41fde1ec33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:00.041008 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434fa8be-f37b-426c-b13a-cf41fde1ec33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:00.042609 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434fa8be-f37b-426c-b13a-cf41fde1ec33 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:00.053601 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1287/2565] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:52:00.057580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4f296-f12f-409d-a729-2c5913fc26b1 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:00.067366 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4f296-f12f-409d-a729-2c5913fc26b1 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:00.072000 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c12776-7f57-4627-aee3-342ee4f4f000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:00.072534 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c12776-7f57-4627-aee3-342ee4f4f000 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:00.072814 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c12776-7f57-4627-aee3-342ee4f4f000 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:00.073093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c12776-7f57-4627-aee3-342ee4f4f000 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:00.073767 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c12776-7f57-4627-aee3-342ee4f4f000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:00.075335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c12776-7f57-4627-aee3-342ee4f4f000 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:00.086068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1279/2566] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:52:00.089233 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fa8be-f37b-426c-b13a-cf41fde1ec33 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:00.099972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fa8be-f37b-426c-b13a-cf41fde1ec33 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:00.104563 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedd9f2-fe89-48b3-8b8f-66ab2ddcb361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:00.105201 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedd9f2-fe89-48b3-8b8f-66ab2ddcb361 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:00.105499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedd9f2-fe89-48b3-8b8f-66ab2ddcb361 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:00.105778 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedd9f2-fe89-48b3-8b8f-66ab2ddcb361 admin admin] PATH_INFO: `/v3/projects/b057910462934f43b2f61f7e049c0157/users/48a064188e7143a1b9ef8f34c2ab6f67/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:00.120409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedd9f2-fe89-48b3-8b8f-66ab2ddcb361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b057910462934f43b2f61f7e049c0157, user_id=48a064188e7143a1b9ef8f34c2ab6f67, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:00.123072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedd9f2-fe89-48b3-8b8f-66ab2ddcb361 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:00.135772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1288/2567] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:52:00 2022] PUT /identity/v3/projects/b057910462934f43b2f61f7e049c0157/users/48a064188e7143a1b9ef8f34c2ab6f67/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:00.146111 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a97fb3-d179-4a92-ad9a-b685de663698 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:00.146393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a97fb3-d179-4a92-ad9a-b685de663698 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:00.146689 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a97fb3-d179-4a92-ad9a-b685de663698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:00.174880 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-d8a97fb3-d179-4a92-ad9a-b685de663698 None None] MFA Rules not processed for user `48a064188e7143a1b9ef8f34c2ab6f67`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:00.176175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-d8a97fb3-d179-4a92-ad9a-b685de663698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:00.240928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1280/2568] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:52:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:52:00.245445 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedd9f2-fe89-48b3-8b8f-66ab2ddcb361 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:00.307133 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedd9f2-fe89-48b3-8b8f-66ab2ddcb361 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:00.311807 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1785a9a-a23b-4761-9e02-c63bae9bddf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:00.312406 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1785a9a-a23b-4761-9e02-c63bae9bddf0 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:00.312682 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1785a9a-a23b-4761-9e02-c63bae9bddf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:00.312955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1785a9a-a23b-4761-9e02-c63bae9bddf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:00.313723 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1785a9a-a23b-4761-9e02-c63bae9bddf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:00.315719 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1785a9a-a23b-4761-9e02-c63bae9bddf0 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:00.343174 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1289/2569] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:52:00 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:52:00.347788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a97fb3-d179-4a92-ad9a-b685de663698 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:00.358454 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a97fb3-d179-4a92-ad9a-b685de663698 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:00.414433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05577aa-11bf-40a1-baa6-10fa801270c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:00.415029 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05577aa-11bf-40a1-baa6-10fa801270c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:00.415303 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05577aa-11bf-40a1-baa6-10fa801270c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:00.415573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05577aa-11bf-40a1-baa6-10fa801270c9 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:00.416193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05577aa-11bf-40a1-baa6-10fa801270c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:00.418122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05577aa-11bf-40a1-baa6-10fa801270c9 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:00.439877 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1281/2570] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:52:00 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:52:00.443884 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1785a9a-a23b-4761-9e02-c63bae9bddf0 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:00.454193 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1785a9a-a23b-4761-9e02-c63bae9bddf0 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:00.458928 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b590e-8db9-4ba1-a02e-4d00a3771107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:00.459528 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b590e-8db9-4ba1-a02e-4d00a3771107 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:00.459807 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b590e-8db9-4ba1-a02e-4d00a3771107 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:00.460082 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b590e-8db9-4ba1-a02e-4d00a3771107 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:00.460843 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b590e-8db9-4ba1-a02e-4d00a3771107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:00.462458 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b590e-8db9-4ba1-a02e-4d00a3771107 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:00.473377 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1290/2571] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:52:00.477352 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05577aa-11bf-40a1-baa6-10fa801270c9 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:00.487893 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05577aa-11bf-40a1-baa6-10fa801270c9 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:00.492568 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e63c96-1a89-4da7-8abf-200f11ae4c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:00.493214 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e63c96-1a89-4da7-8abf-200f11ae4c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:00.493523 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e63c96-1a89-4da7-8abf-200f11ae4c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:00.493804 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e63c96-1a89-4da7-8abf-200f11ae4c30 admin admin] PATH_INFO: `/v3/projects/4295513c6374471a860fcfb7ce0f96ba/users/8aa4521fb9ae4caeaf7666a913695018/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:00.506417 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:00.509936 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e63c96-1a89-4da7-8abf-200f11ae4c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4295513c6374471a860fcfb7ce0f96ba, user_id=8aa4521fb9ae4caeaf7666a913695018, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:00.513331 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e63c96-1a89-4da7-8abf-200f11ae4c30 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:00.526493 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1282/2572] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:52:00 2022] PUT /identity/v3/projects/4295513c6374471a860fcfb7ce0f96ba/users/8aa4521fb9ae4caeaf7666a913695018/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:00.530489 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b590e-8db9-4ba1-a02e-4d00a3771107 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:00.540626 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b590e-8db9-4ba1-a02e-4d00a3771107 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:00.582221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:00.598378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b2e48-8309-4bdd-b618-2b8c60794aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:00.598906 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b2e48-8309-4bdd-b618-2b8c60794aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:00.599183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b2e48-8309-4bdd-b618-2b8c60794aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:00.599456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b2e48-8309-4bdd-b618-2b8c60794aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:00.600096 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b2e48-8309-4bdd-b618-2b8c60794aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:00.601745 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b2e48-8309-4bdd-b618-2b8c60794aa0 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:00.612071 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1291/2573] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:52:00.616387 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e63c96-1a89-4da7-8abf-200f11ae4c30 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:00.627509 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e63c96-1a89-4da7-8abf-200f11ae4c30 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:00.632221 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de972265-444f-4c38-a408-6b045f55480c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:00.632882 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de972265-444f-4c38-a408-6b045f55480c admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:00.633161 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de972265-444f-4c38-a408-6b045f55480c admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:00.633436 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de972265-444f-4c38-a408-6b045f55480c admin admin] PATH_INFO: `/v3/projects/4295513c6374471a860fcfb7ce0f96ba/users/8aa4521fb9ae4caeaf7666a913695018/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:00.635403 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de972265-444f-4c38-a408-6b045f55480c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4295513c6374471a860fcfb7ce0f96ba, user_id=8aa4521fb9ae4caeaf7666a913695018, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:00.638058 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de972265-444f-4c38-a408-6b045f55480c admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:00.652490 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1283/2574] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:52:00 2022] PUT /identity/v3/projects/4295513c6374471a860fcfb7ce0f96ba/users/8aa4521fb9ae4caeaf7666a913695018/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:00.664347 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87d2fc-21ec-4ee0-8f88-98fee0ad71e6 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:00.664634 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87d2fc-21ec-4ee0-8f88-98fee0ad71e6 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:00.664913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87d2fc-21ec-4ee0-8f88-98fee0ad71e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:00.693919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-9f87d2fc-21ec-4ee0-8f88-98fee0ad71e6 None None] MFA Rules not processed for user `8aa4521fb9ae4caeaf7666a913695018`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:00.695121 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-9f87d2fc-21ec-4ee0-8f88-98fee0ad71e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:00.762654 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1292/2575] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:52:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:52:00.774160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de972265-444f-4c38-a408-6b045f55480c admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:00.775898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-de972265-444f-4c38-a408-6b045f55480c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:00.836640 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de972265-444f-4c38-a408-6b045f55480c admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:00.840616 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504f8b6-3344-45a1-8e41-6a5f8cecfa0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:00.841225 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504f8b6-3344-45a1-8e41-6a5f8cecfa0d service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:00.841537 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504f8b6-3344-45a1-8e41-6a5f8cecfa0d service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:00.841816 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504f8b6-3344-45a1-8e41-6a5f8cecfa0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:00.898581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504f8b6-3344-45a1-8e41-6a5f8cecfa0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:00.899934 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504f8b6-3344-45a1-8e41-6a5f8cecfa0d service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:00.909565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1284/2576] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:52:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:52:02.410195 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87d2fc-21ec-4ee0-8f88-98fee0ad71e6 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:02.411730 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-9f87d2fc-21ec-4ee0-8f88-98fee0ad71e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:02.423968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87d2fc-21ec-4ee0-8f88-98fee0ad71e6 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:02.427547 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2aed85-ba9d-41a2-ac7a-af979a5bd0b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:02.428142 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aed85-ba9d-41a2-ac7a-af979a5bd0b4 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:02.428422 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aed85-ba9d-41a2-ac7a-af979a5bd0b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:02.428696 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aed85-ba9d-41a2-ac7a-af979a5bd0b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:02.485452 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2aed85-ba9d-41a2-ac7a-af979a5bd0b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:02.486860 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2aed85-ba9d-41a2-ac7a-af979a5bd0b4 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:02.495819 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1293/2577] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:52:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:52:03.018428 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504f8b6-3344-45a1-8e41-6a5f8cecfa0d service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:03.027123 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504f8b6-3344-45a1-8e41-6a5f8cecfa0d service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:03.030755 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc27bf-1cc1-4748-854c-b5a0754c8875 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:03.031353 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc27bf-1cc1-4748-854c-b5a0754c8875 service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:03.031634 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc27bf-1cc1-4748-854c-b5a0754c8875 service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:03.031912 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc27bf-1cc1-4748-854c-b5a0754c8875 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:03.041383 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc27bf-1cc1-4748-854c-b5a0754c8875 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:03.042835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc27bf-1cc1-4748-854c-b5a0754c8875 service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:03.055747 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1285/2578] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:52:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:52:06.912660 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2aed85-ba9d-41a2-ac7a-af979a5bd0b4 service cinder] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:06.974657 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2aed85-ba9d-41a2-ac7a-af979a5bd0b4 service cinder] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:06.979210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d3071-5057-4753-aabb-10368281a63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:06.979880 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d3071-5057-4753-aabb-10368281a63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:06.980161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d3071-5057-4753-aabb-10368281a63b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:06.980434 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d3071-5057-4753-aabb-10368281a63b admin admin] PATH_INFO: `/v3/users/8eebb6b3e15e4c0c8ff23984ebac5153` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:06.981566 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d3071-5057-4753-aabb-10368281a63b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eebb6b3e15e4c0c8ff23984ebac5153)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:06.983468 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d3071-5057-4753-aabb-10368281a63b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:06.988630 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:07.030326 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1f6d3071-5057-4753-aabb-10368281a63b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eebb6b3e15e4c0c8ff23984ebac5153'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:07.030972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1f6d3071-5057-4753-aabb-10368281a63b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eebb6b3e15e4c0c8ff23984ebac5153'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:07.043639 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1f6d3071-5057-4753-aabb-10368281a63b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eebb6b3e15e4c0c8ff23984ebac5153'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:07.051737 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1f6d3071-5057-4753-aabb-10368281a63b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eebb6b3e15e4c0c8ff23984ebac5153'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:07.058725 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-1f6d3071-5057-4753-aabb-10368281a63b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eebb6b3e15e4c0c8ff23984ebac5153'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:07.064697 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1294/2579] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:52:06 2022] DELETE /identity/v3/users/8eebb6b3e15e4c0c8ff23984ebac5153 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:07.069196 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a86374-aa30-4535-887c-5135c1d95834 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:07.069701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a86374-aa30-4535-887c-5135c1d95834 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:07.069819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a86374-aa30-4535-887c-5135c1d95834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:07.089170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-69a86374-aa30-4535-887c-5135c1d95834 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:07.090676 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-69a86374-aa30-4535-887c-5135c1d95834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:07.151646 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1286/2580] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:52:07.161948 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d3071-5057-4753-aabb-10368281a63b admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:07.163725 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-1f6d3071-5057-4753-aabb-10368281a63b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:07.221159 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d3071-5057-4753-aabb-10368281a63b admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:07.225163 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8d18e-c528-4cf6-9a60-f5a11ce9b43b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:07.225845 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8d18e-c528-4cf6-9a60-f5a11ce9b43b service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:07.226139 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8d18e-c528-4cf6-9a60-f5a11ce9b43b service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:07.226413 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8d18e-c528-4cf6-9a60-f5a11ce9b43b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:07.236971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8d18e-c528-4cf6-9a60-f5a11ce9b43b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:07.238562 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8d18e-c528-4cf6-9a60-f5a11ce9b43b service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:07.248666 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1295/2581] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:52:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:52:07.518135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a86374-aa30-4535-887c-5135c1d95834 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:07.519627 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-69a86374-aa30-4535-887c-5135c1d95834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:07.532656 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a86374-aa30-4535-887c-5135c1d95834 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:07.537665 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb380b-5e07-4e22-bf16-2a80e7660861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:07.538311 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb380b-5e07-4e22-bf16-2a80e7660861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:07.538588 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb380b-5e07-4e22-bf16-2a80e7660861 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:07.539368 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb380b-5e07-4e22-bf16-2a80e7660861 admin admin] PATH_INFO: `/v3/projects/073767dbd75b4eecad6c4b413ff43b29` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:07.539984 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb380b-5e07-4e22-bf16-2a80e7660861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=073767dbd75b4eecad6c4b413ff43b29)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:07.541920 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb380b-5e07-4e22-bf16-2a80e7660861 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:07.559917 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:07.594187 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b3bb380b-5e07-4e22-bf16-2a80e7660861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '073767dbd75b4eecad6c4b413ff43b29', 'request_id': 'req-b3bb380b-5e07-4e22-bf16-2a80e7660861'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:07.602945 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b3bb380b-5e07-4e22-bf16-2a80e7660861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '073767dbd75b4eecad6c4b413ff43b29', 'request_id': 'req-b3bb380b-5e07-4e22-bf16-2a80e7660861'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:07.610020 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b3bb380b-5e07-4e22-bf16-2a80e7660861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '073767dbd75b4eecad6c4b413ff43b29', 'request_id': 'req-b3bb380b-5e07-4e22-bf16-2a80e7660861'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:07.621930 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b3bb380b-5e07-4e22-bf16-2a80e7660861 admin admin] The token cache is being invalidate because project 073767dbd75b4eecad6c4b413ff43b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:52:07.622247 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b3bb380b-5e07-4e22-bf16-2a80e7660861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:07.622923 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b3bb380b-5e07-4e22-bf16-2a80e7660861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:07.624624 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1287/2582] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:52:07 2022] DELETE /identity/v3/projects/073767dbd75b4eecad6c4b413ff43b29 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:07.628994 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8d18e-c528-4cf6-9a60-f5a11ce9b43b service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:07.638576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8d18e-c528-4cf6-9a60-f5a11ce9b43b service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:07.696514 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4d4ac-6854-499c-b9cc-c868ef74fbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:07.697144 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4d4ac-6854-499c-b9cc-c868ef74fbe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:07.697420 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4d4ac-6854-499c-b9cc-c868ef74fbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:07.697729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4d4ac-6854-499c-b9cc-c868ef74fbe6 admin admin] PATH_INFO: `/v3/users/48a064188e7143a1b9ef8f34c2ab6f67` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:07.698853 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4d4ac-6854-499c-b9cc-c868ef74fbe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48a064188e7143a1b9ef8f34c2ab6f67)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:07.700816 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4d4ac-6854-499c-b9cc-c868ef74fbe6 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:07.732948 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:07.753872 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-7df4d4ac-6854-499c-b9cc-c868ef74fbe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48a064188e7143a1b9ef8f34c2ab6f67'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:07.754499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-7df4d4ac-6854-499c-b9cc-c868ef74fbe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48a064188e7143a1b9ef8f34c2ab6f67'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:07.766097 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-7df4d4ac-6854-499c-b9cc-c868ef74fbe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48a064188e7143a1b9ef8f34c2ab6f67'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:07.773717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-7df4d4ac-6854-499c-b9cc-c868ef74fbe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48a064188e7143a1b9ef8f34c2ab6f67'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:07.780711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-7df4d4ac-6854-499c-b9cc-c868ef74fbe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48a064188e7143a1b9ef8f34c2ab6f67'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:07.786673 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1296/2583] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:52:07 2022] DELETE /identity/v3/users/48a064188e7143a1b9ef8f34c2ab6f67 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:08.055282 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb380b-5e07-4e22-bf16-2a80e7660861 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:08.057342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b3bb380b-5e07-4e22-bf16-2a80e7660861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:08.073665 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb380b-5e07-4e22-bf16-2a80e7660861 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:08.133856 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e55698-035f-45b0-87a6-d50f21373fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:08.134413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e55698-035f-45b0-87a6-d50f21373fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:08.134697 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e55698-035f-45b0-87a6-d50f21373fac admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:08.134976 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e55698-035f-45b0-87a6-d50f21373fac admin admin] PATH_INFO: `/v3/projects/b057910462934f43b2f61f7e049c0157` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:08.136159 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e55698-035f-45b0-87a6-d50f21373fac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b057910462934f43b2f61f7e049c0157)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:08.138115 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e55698-035f-45b0-87a6-d50f21373fac admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:08.187908 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-24e55698-035f-45b0-87a6-d50f21373fac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b057910462934f43b2f61f7e049c0157', 'request_id': 'req-24e55698-035f-45b0-87a6-d50f21373fac'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:08.194728 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-24e55698-035f-45b0-87a6-d50f21373fac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b057910462934f43b2f61f7e049c0157', 'request_id': 'req-24e55698-035f-45b0-87a6-d50f21373fac'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:08.201867 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-24e55698-035f-45b0-87a6-d50f21373fac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b057910462934f43b2f61f7e049c0157', 'request_id': 'req-24e55698-035f-45b0-87a6-d50f21373fac'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:08.217258 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-24e55698-035f-45b0-87a6-d50f21373fac admin admin] The token cache is being invalidate because project b057910462934f43b2f61f7e049c0157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:52:08.217762 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-24e55698-035f-45b0-87a6-d50f21373fac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:08.218798 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-24e55698-035f-45b0-87a6-d50f21373fac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:08.221245 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1288/2584] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:52:08 2022] DELETE /identity/v3/projects/b057910462934f43b2f61f7e049c0157 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:08.225434 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4d4ac-6854-499c-b9cc-c868ef74fbe6 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:08.226917 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-7df4d4ac-6854-499c-b9cc-c868ef74fbe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:08.240113 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4d4ac-6854-499c-b9cc-c868ef74fbe6 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:08.296051 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371e476-e850-4fc6-89e3-0aaa47a00c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:08.296677 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371e476-e850-4fc6-89e3-0aaa47a00c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:08.296957 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371e476-e850-4fc6-89e3-0aaa47a00c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:08.297231 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371e476-e850-4fc6-89e3-0aaa47a00c91 admin admin] PATH_INFO: `/v3/users/8aa4521fb9ae4caeaf7666a913695018` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:08.298532 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371e476-e850-4fc6-89e3-0aaa47a00c91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aa4521fb9ae4caeaf7666a913695018)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:08.300439 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371e476-e850-4fc6-89e3-0aaa47a00c91 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:08.347331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-9371e476-e850-4fc6-89e3-0aaa47a00c91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aa4521fb9ae4caeaf7666a913695018'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:08.347982 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-9371e476-e850-4fc6-89e3-0aaa47a00c91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aa4521fb9ae4caeaf7666a913695018'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:08.359695 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-9371e476-e850-4fc6-89e3-0aaa47a00c91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aa4521fb9ae4caeaf7666a913695018'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:08.367024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-9371e476-e850-4fc6-89e3-0aaa47a00c91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aa4521fb9ae4caeaf7666a913695018'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:08.374049 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-9371e476-e850-4fc6-89e3-0aaa47a00c91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aa4521fb9ae4caeaf7666a913695018'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:08.380606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1297/2585] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:52:08 2022] DELETE /identity/v3/users/8aa4521fb9ae4caeaf7666a913695018 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:52:08.652104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e55698-035f-45b0-87a6-d50f21373fac admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:08.653722 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-24e55698-035f-45b0-87a6-d50f21373fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:08.671993 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e55698-035f-45b0-87a6-d50f21373fac admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:08.703589 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:08.737615 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56787d-e8be-46a7-85f5-31d63906d20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:08.738298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56787d-e8be-46a7-85f5-31d63906d20d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:08.738583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56787d-e8be-46a7-85f5-31d63906d20d admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:08.738868 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56787d-e8be-46a7-85f5-31d63906d20d admin admin] PATH_INFO: `/v3/projects/4295513c6374471a860fcfb7ce0f96ba` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:08.740406 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56787d-e8be-46a7-85f5-31d63906d20d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4295513c6374471a860fcfb7ce0f96ba)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:08.741942 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56787d-e8be-46a7-85f5-31d63906d20d admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:08.791797 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-5f56787d-e8be-46a7-85f5-31d63906d20d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4295513c6374471a860fcfb7ce0f96ba', 'request_id': 'req-5f56787d-e8be-46a7-85f5-31d63906d20d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:08.802432 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-5f56787d-e8be-46a7-85f5-31d63906d20d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4295513c6374471a860fcfb7ce0f96ba', 'request_id': 'req-5f56787d-e8be-46a7-85f5-31d63906d20d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:08.809116 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-5f56787d-e8be-46a7-85f5-31d63906d20d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4295513c6374471a860fcfb7ce0f96ba', 'request_id': 'req-5f56787d-e8be-46a7-85f5-31d63906d20d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:08.821127 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-5f56787d-e8be-46a7-85f5-31d63906d20d admin admin] The token cache is being invalidate because project 4295513c6374471a860fcfb7ce0f96ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:52:08.821414 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-5f56787d-e8be-46a7-85f5-31d63906d20d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:08.822079 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-5f56787d-e8be-46a7-85f5-31d63906d20d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:52:08.823832 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1289/2586] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:52:08 2022] DELETE /identity/v3/projects/4295513c6374471a860fcfb7ce0f96ba => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:52:18.376954 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=72,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:18.817499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:26.348570 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e9f73-fbb3-4ae0-8193-ddde621e0116 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:26.349082 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e9f73-fbb3-4ae0-8193-ddde621e0116 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:26.349190 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e9f73-fbb3-4ae0-8193-ddde621e0116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:26.369452 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-491e9f73-fbb3-4ae0-8193-ddde621e0116 None None] MFA Rules not processed for user `3ae62427d5914e67b5b4d0237ecccd06`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:26.370690 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-491e9f73-fbb3-4ae0-8193-ddde621e0116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:26.426902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1298/2587] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 09:52:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:52:26.488085 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56787d-e8be-46a7-85f5-31d63906d20d admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:26.489837 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-5f56787d-e8be-46a7-85f5-31d63906d20d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:26.564965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56787d-e8be-46a7-85f5-31d63906d20d admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:26.569976 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8478dd8-692b-40b6-a02c-94dc18ffdfc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2db35b94c84ec7bba96117d23baf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:26.570648 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8478dd8-692b-40b6-a02c-94dc18ffdfc9 service swift] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:26.570853 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8478dd8-692b-40b6-a02c-94dc18ffdfc9 service swift] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:26.571129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8478dd8-692b-40b6-a02c-94dc18ffdfc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:26.580258 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8478dd8-692b-40b6-a02c-94dc18ffdfc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:26.581923 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8478dd8-692b-40b6-a02c-94dc18ffdfc9 service swift] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:26.590287 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1290/2588] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 09:52:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 09:52:36.419524 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=25 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:36.586753 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=32 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:41.738502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e9f73-fbb3-4ae0-8193-ddde621e0116 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:41.739976 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-491e9f73-fbb3-4ae0-8193-ddde621e0116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:41.804730 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e9f73-fbb3-4ae0-8193-ddde621e0116 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:41.808480 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf280a5-6821-459e-b7c7-57274d5263a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:41.809068 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf280a5-6821-459e-b7c7-57274d5263a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:41.809345 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf280a5-6821-459e-b7c7-57274d5263a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:41.809659 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf280a5-6821-459e-b7c7-57274d5263a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:41.811386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2cf280a5-6821-459e-b7c7-57274d5263a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:41.875389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf280a5-6821-459e-b7c7-57274d5263a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:41.876868 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf280a5-6821-459e-b7c7-57274d5263a3 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:41.886904 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1299/2589] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:52:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:52:42.635178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d6a2d-fd64-44b3-a17a-8df2db5cb026 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:42.635682 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d6a2d-fd64-44b3-a17a-8df2db5cb026 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:42.635921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d6a2d-fd64-44b3-a17a-8df2db5cb026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:42.656869 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-024d6a2d-fd64-44b3-a17a-8df2db5cb026 None None] MFA Rules not processed for user `3ae62427d5914e67b5b4d0237ecccd06`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:52:42.658119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-024d6a2d-fd64-44b3-a17a-8df2db5cb026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:52:42.665449 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1291/2590] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 09:52:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:52:42.677957 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf280a5-6821-459e-b7c7-57274d5263a3 service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:52:42.689665 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf280a5-6821-459e-b7c7-57274d5263a3 service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:52:42.694692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c353e-e611-465d-a4c3-a23db8e10d00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2db35b94c84ec7bba96117d23baf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:52:42.695304 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c353e-e611-465d-a4c3-a23db8e10d00 service swift] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:52:42.695585 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c353e-e611-465d-a4c3-a23db8e10d00 service swift] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:52:42.695860 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c353e-e611-465d-a4c3-a23db8e10d00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:52:42.704754 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c353e-e611-465d-a4c3-a23db8e10d00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:52:42.706377 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c353e-e611-465d-a4c3-a23db8e10d00 service swift] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:52:42.714839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1300/2591] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 09:52:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 09:52:52.651049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:52.711672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=54 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:01.301951 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d6a2d-fd64-44b3-a17a-8df2db5cb026 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:01.323056 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d6a2d-fd64-44b3-a17a-8df2db5cb026 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:01.326941 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f6f75-5c43-4451-84b2-aad95a4368f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:01.327558 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f6f75-5c43-4451-84b2-aad95a4368f2 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:01.327851 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f6f75-5c43-4451-84b2-aad95a4368f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:01.328125 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f6f75-5c43-4451-84b2-aad95a4368f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:01.329953 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-592f6f75-5c43-4451-84b2-aad95a4368f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:01.456703 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f6f75-5c43-4451-84b2-aad95a4368f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:01.458189 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f6f75-5c43-4451-84b2-aad95a4368f2 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:01.478559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1292/2592] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:04.876040 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c353e-e611-465d-a4c3-a23db8e10d00 service swift] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:04.877863 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a04c353e-e611-465d-a4c3-a23db8e10d00 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:05.080055 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c353e-e611-465d-a4c3-a23db8e10d00 service swift] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:05.086086 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76908e82-8408-4ce5-9fbc-2e50c158ac50 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983e364f5564ed7854dff06a80f55d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:05.086261 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76908e82-8408-4ce5-9fbc-2e50c158ac50 service placement] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:05.086458 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76908e82-8408-4ce5-9fbc-2e50c158ac50 service placement] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:05.086731 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76908e82-8408-4ce5-9fbc-2e50c158ac50 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:05.088832 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-76908e82-8408-4ce5-9fbc-2e50c158ac50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:05.102887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76908e82-8408-4ce5-9fbc-2e50c158ac50 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:05.104509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76908e82-8408-4ce5-9fbc-2e50c158ac50 service placement] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:05.115876 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1301/2593] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:05.664962 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77f8ae-6a17-48e8-a6e8-d5b2da4c1d1d None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:05.665541 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77f8ae-6a17-48e8-a6e8-d5b2da4c1d1d None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:05.665659 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77f8ae-6a17-48e8-a6e8-d5b2da4c1d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:05.699358 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-bb77f8ae-6a17-48e8-a6e8-d5b2da4c1d1d None None] MFA Rules not processed for user `3ae62427d5914e67b5b4d0237ecccd06`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:05.704257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-bb77f8ae-6a17-48e8-a6e8-d5b2da4c1d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:05.722780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1293/2594] 10.222.0.58 () {58 vars in 967 bytes} [Wed Aug 24 09:53:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:05.735652 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76908e82-8408-4ce5-9fbc-2e50c158ac50 service placement] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:05.747183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76908e82-8408-4ce5-9fbc-2e50c158ac50 service placement] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:05.752983 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bcafd-0378-4ff2-ab3e-37418ce8bdeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2db35b94c84ec7bba96117d23baf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:05.753695 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bcafd-0378-4ff2-ab3e-37418ce8bdeb service swift] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:05.753975 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bcafd-0378-4ff2-ab3e-37418ce8bdeb service swift] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:05.754249 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bcafd-0378-4ff2-ab3e-37418ce8bdeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:05.762657 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bcafd-0378-4ff2-ab3e-37418ce8bdeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:05.764246 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bcafd-0378-4ff2-ab3e-37418ce8bdeb service swift] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:05.772942 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1302/2595] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 09:53:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:53:08.138419 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77f8ae-6a17-48e8-a6e8-d5b2da4c1d1d None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:08.154438 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77f8ae-6a17-48e8-a6e8-d5b2da4c1d1d None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:08.160228 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa700a-b6dd-4e23-bdae-67567546a0f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983e364f5564ed7854dff06a80f55d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:08.161060 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa700a-b6dd-4e23-bdae-67567546a0f1 service placement] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:08.161440 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa700a-b6dd-4e23-bdae-67567546a0f1 service placement] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:08.161820 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa700a-b6dd-4e23-bdae-67567546a0f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:08.163827 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-8caa700a-b6dd-4e23-bdae-67567546a0f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:08.179179 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa700a-b6dd-4e23-bdae-67567546a0f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:08.181361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa700a-b6dd-4e23-bdae-67567546a0f1 service placement] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:08.210449 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1294/2596] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:08.215837 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bcafd-0378-4ff2-ab3e-37418ce8bdeb service swift] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:08.223426 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f07bcafd-0378-4ff2-ab3e-37418ce8bdeb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:08.245660 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bcafd-0378-4ff2-ab3e-37418ce8bdeb service swift] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:08.252365 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f828c0-c320-4f8a-b2c5-fa66f50c56fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:08.254873 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f828c0-c320-4f8a-b2c5-fa66f50c56fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:08.255178 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f828c0-c320-4f8a-b2c5-fa66f50c56fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:08.255457 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f828c0-c320-4f8a-b2c5-fa66f50c56fe admin admin] PATH_INFO: `/v3/users/448c4e0626c7433b9ca21a13207cace4` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:08.257638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f828c0-c320-4f8a-b2c5-fa66f50c56fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=448c4e0626c7433b9ca21a13207cace4)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:08.259526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f828c0-c320-4f8a-b2c5-fa66f50c56fe admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:08.312671 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-76f828c0-c320-4f8a-b2c5-fa66f50c56fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448c4e0626c7433b9ca21a13207cace4'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:08.313516 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-76f828c0-c320-4f8a-b2c5-fa66f50c56fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448c4e0626c7433b9ca21a13207cace4'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:08.326813 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-76f828c0-c320-4f8a-b2c5-fa66f50c56fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448c4e0626c7433b9ca21a13207cace4'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:08.333357 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-76f828c0-c320-4f8a-b2c5-fa66f50c56fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448c4e0626c7433b9ca21a13207cace4'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:08.334732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:08.342732 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-76f828c0-c320-4f8a-b2c5-fa66f50c56fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448c4e0626c7433b9ca21a13207cace4'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:08.349907 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1303/2597] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:53:08 2022] DELETE /identity/v3/users/448c4e0626c7433b9ca21a13207cace4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:08.524512 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa700a-b6dd-4e23-bdae-67567546a0f1 service placement] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:08.536963 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa700a-b6dd-4e23-bdae-67567546a0f1 service placement] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:08.595402 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=100 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:08.611910 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5bb1a-7c8a-488d-a4be-90476e95d44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:08.612546 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5bb1a-7c8a-488d-a4be-90476e95d44d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:08.612823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5bb1a-7c8a-488d-a4be-90476e95d44d admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:08.613092 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5bb1a-7c8a-488d-a4be-90476e95d44d admin admin] PATH_INFO: `/v3/projects/03e5ba5dbd7244a7bad2d4ff5dfc5013` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:08.614274 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5bb1a-7c8a-488d-a4be-90476e95d44d admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e5ba5dbd7244a7bad2d4ff5dfc5013)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:08.616148 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5bb1a-7c8a-488d-a4be-90476e95d44d admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:08.664897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b4d5bb1a-7c8a-488d-a4be-90476e95d44d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e5ba5dbd7244a7bad2d4ff5dfc5013', 'request_id': 'req-b4d5bb1a-7c8a-488d-a4be-90476e95d44d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:08.673605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b4d5bb1a-7c8a-488d-a4be-90476e95d44d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e5ba5dbd7244a7bad2d4ff5dfc5013', 'request_id': 'req-b4d5bb1a-7c8a-488d-a4be-90476e95d44d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:08.680654 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b4d5bb1a-7c8a-488d-a4be-90476e95d44d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e5ba5dbd7244a7bad2d4ff5dfc5013', 'request_id': 'req-b4d5bb1a-7c8a-488d-a4be-90476e95d44d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:08.691778 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b4d5bb1a-7c8a-488d-a4be-90476e95d44d admin admin] The token cache is being invalidate because project 03e5ba5dbd7244a7bad2d4ff5dfc5013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:53:08.692104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b4d5bb1a-7c8a-488d-a4be-90476e95d44d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:08.692754 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-b4d5bb1a-7c8a-488d-a4be-90476e95d44d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:08.694291 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1295/2598] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:53:08 2022] DELETE /identity/v3/projects/03e5ba5dbd7244a7bad2d4ff5dfc5013 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:08.699130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f828c0-c320-4f8a-b2c5-fa66f50c56fe admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:08.700616 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-76f828c0-c320-4f8a-b2c5-fa66f50c56fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:08.715001 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f828c0-c320-4f8a-b2c5-fa66f50c56fe admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:08.773913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93dd9c-d713-4067-b906-d0f231e01f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:08.774549 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93dd9c-d713-4067-b906-d0f231e01f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:08.774830 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93dd9c-d713-4067-b906-d0f231e01f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:08.775108 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f93dd9c-d713-4067-b906-d0f231e01f3a admin admin] PATH_INFO: `/v3/users/8ed8205cf1854495af1786d49f042c34` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:08.776253 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93dd9c-d713-4067-b906-d0f231e01f3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed8205cf1854495af1786d49f042c34)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:08.778189 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f93dd9c-d713-4067-b906-d0f231e01f3a admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:08.830875 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2f93dd9c-d713-4067-b906-d0f231e01f3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed8205cf1854495af1786d49f042c34'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:08.830875 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2f93dd9c-d713-4067-b906-d0f231e01f3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed8205cf1854495af1786d49f042c34'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:08.851827 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2f93dd9c-d713-4067-b906-d0f231e01f3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed8205cf1854495af1786d49f042c34'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:08.862795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2f93dd9c-d713-4067-b906-d0f231e01f3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed8205cf1854495af1786d49f042c34'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:08.874640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-2f93dd9c-d713-4067-b906-d0f231e01f3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed8205cf1854495af1786d49f042c34'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:08.882461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1304/2599] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:53:08 2022] DELETE /identity/v3/users/8ed8205cf1854495af1786d49f042c34 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:09.072928 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5bb1a-7c8a-488d-a4be-90476e95d44d admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:09.074487 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b4d5bb1a-7c8a-488d-a4be-90476e95d44d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:09.094929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5bb1a-7c8a-488d-a4be-90476e95d44d admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:09.155254 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556a622-ed8a-4573-a2d9-a8a11dcf8416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:09.155912 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556a622-ed8a-4573-a2d9-a8a11dcf8416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:09.156147 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556a622-ed8a-4573-a2d9-a8a11dcf8416 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:09.156469 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556a622-ed8a-4573-a2d9-a8a11dcf8416 admin admin] PATH_INFO: `/v3/projects/07b69bbf11d648a69a5f520617fee587` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:09.157991 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556a622-ed8a-4573-a2d9-a8a11dcf8416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07b69bbf11d648a69a5f520617fee587)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:09.160032 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556a622-ed8a-4573-a2d9-a8a11dcf8416 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:09.210544 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-8556a622-ed8a-4573-a2d9-a8a11dcf8416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07b69bbf11d648a69a5f520617fee587', 'request_id': 'req-8556a622-ed8a-4573-a2d9-a8a11dcf8416'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:09.218072 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-8556a622-ed8a-4573-a2d9-a8a11dcf8416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07b69bbf11d648a69a5f520617fee587', 'request_id': 'req-8556a622-ed8a-4573-a2d9-a8a11dcf8416'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:09.224933 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-8556a622-ed8a-4573-a2d9-a8a11dcf8416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07b69bbf11d648a69a5f520617fee587', 'request_id': 'req-8556a622-ed8a-4573-a2d9-a8a11dcf8416'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:09.235856 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-8556a622-ed8a-4573-a2d9-a8a11dcf8416 admin admin] The token cache is being invalidate because project 07b69bbf11d648a69a5f520617fee587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:53:09.236148 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-8556a622-ed8a-4573-a2d9-a8a11dcf8416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:09.236796 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-8556a622-ed8a-4573-a2d9-a8a11dcf8416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:09.238324 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1296/2600] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:53:09 2022] DELETE /identity/v3/projects/07b69bbf11d648a69a5f520617fee587 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:18.291838 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93dd9c-d713-4067-b906-d0f231e01f3a admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:18.293263 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2f93dd9c-d713-4067-b906-d0f231e01f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:18.369588 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:18.373567 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f93dd9c-d713-4067-b906-d0f231e01f3a admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:18.422284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fa7c2-8f5e-4502-b68f-712bd06a0dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:18.422879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fa7c2-8f5e-4502-b68f-712bd06a0dda service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:18.423154 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fa7c2-8f5e-4502-b68f-712bd06a0dda service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:18.423451 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fa7c2-8f5e-4502-b68f-712bd06a0dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:18.425158 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-679fa7c2-8f5e-4502-b68f-712bd06a0dda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:18.487201 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fa7c2-8f5e-4502-b68f-712bd06a0dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:18.488546 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fa7c2-8f5e-4502-b68f-712bd06a0dda service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:18.498998 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1305/2601] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:19.232435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=79,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:21.654193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556a622-ed8a-4573-a2d9-a8a11dcf8416 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:21.655695 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-8556a622-ed8a-4573-a2d9-a8a11dcf8416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:21.668624 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556a622-ed8a-4573-a2d9-a8a11dcf8416 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:21.674200 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7d066-b3fa-4a36-8000-f854d874c932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:21.674828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7d066-b3fa-4a36-8000-f854d874c932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:21.675110 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7d066-b3fa-4a36-8000-f854d874c932 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:21.675374 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7d066-b3fa-4a36-8000-f854d874c932 admin admin] PATH_INFO: `/v3/users/1b1b38b0aa504cd1ac7e851be5b6e266` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:21.676489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7d066-b3fa-4a36-8000-f854d874c932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b1b38b0aa504cd1ac7e851be5b6e266)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:21.678411 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7d066-b3fa-4a36-8000-f854d874c932 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:21.726145 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-5fe7d066-b3fa-4a36-8000-f854d874c932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b1b38b0aa504cd1ac7e851be5b6e266'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:21.726815 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-5fe7d066-b3fa-4a36-8000-f854d874c932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b1b38b0aa504cd1ac7e851be5b6e266'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:21.727426 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-5fe7d066-b3fa-4a36-8000-f854d874c932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b1b38b0aa504cd1ac7e851be5b6e266'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:21.739249 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-5fe7d066-b3fa-4a36-8000-f854d874c932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b1b38b0aa504cd1ac7e851be5b6e266'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:21.746659 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-5fe7d066-b3fa-4a36-8000-f854d874c932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b1b38b0aa504cd1ac7e851be5b6e266'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:21.759462 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1297/2602] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:53:21 2022] DELETE /identity/v3/users/1b1b38b0aa504cd1ac7e851be5b6e266 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:21.935145 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fa7c2-8f5e-4502-b68f-712bd06a0dda service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:21.947961 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fa7c2-8f5e-4502-b68f-712bd06a0dda service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:22.007400 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984f861-cbbf-4273-8723-18e4eee0011b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:22.008022 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984f861-cbbf-4273-8723-18e4eee0011b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:22.008300 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984f861-cbbf-4273-8723-18e4eee0011b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:22.008576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984f861-cbbf-4273-8723-18e4eee0011b admin admin] PATH_INFO: `/v3/projects/65b228befe8446fa82809a13ffd6bb2f` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:22.009783 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984f861-cbbf-4273-8723-18e4eee0011b admin admin] RBAC: Authorizing `identity:delete_project(project_id=65b228befe8446fa82809a13ffd6bb2f)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:22.011963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984f861-cbbf-4273-8723-18e4eee0011b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:22.070472 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-4984f861-cbbf-4273-8723-18e4eee0011b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65b228befe8446fa82809a13ffd6bb2f', 'request_id': 'req-4984f861-cbbf-4273-8723-18e4eee0011b'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:22.079175 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-4984f861-cbbf-4273-8723-18e4eee0011b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65b228befe8446fa82809a13ffd6bb2f', 'request_id': 'req-4984f861-cbbf-4273-8723-18e4eee0011b'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:22.080305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:22.087708 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-4984f861-cbbf-4273-8723-18e4eee0011b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65b228befe8446fa82809a13ffd6bb2f', 'request_id': 'req-4984f861-cbbf-4273-8723-18e4eee0011b'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:22.099755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-4984f861-cbbf-4273-8723-18e4eee0011b admin admin] The token cache is being invalidate because project 65b228befe8446fa82809a13ffd6bb2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:53:22.100041 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-4984f861-cbbf-4273-8723-18e4eee0011b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:22.100671 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-4984f861-cbbf-4273-8723-18e4eee0011b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:22.102172 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1306/2603] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:53:21 2022] DELETE /identity/v3/projects/65b228befe8446fa82809a13ffd6bb2f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:22.107063 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb55041-ac02-4a31-bc56-1155d5050dab None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:22.107454 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb55041-ac02-4a31-bc56-1155d5050dab None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:22.107788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb55041-ac02-4a31-bc56-1155d5050dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:22.164696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-4bb55041-ac02-4a31-bc56-1155d5050dab None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:22.165933 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-4bb55041-ac02-4a31-bc56-1155d5050dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:22.225477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1298/2604] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:22.233899 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e8ae4-2b6b-473d-b83c-5243fe10534e None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:22.234212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e8ae4-2b6b-473d-b83c-5243fe10534e None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:22.234488 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e8ae4-2b6b-473d-b83c-5243fe10534e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:22.258400 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-9c0e8ae4-2b6b-473d-b83c-5243fe10534e None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:22.259605 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-9c0e8ae4-2b6b-473d-b83c-5243fe10534e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:22.267955 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1307/2605] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:22.272233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb55041-ac02-4a31-bc56-1155d5050dab None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:22.282175 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb55041-ac02-4a31-bc56-1155d5050dab None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:22.286821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba15c50-c242-4503-a644-b91bf61ff1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:22.287416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba15c50-c242-4503-a644-b91bf61ff1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:22.287700 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba15c50-c242-4503-a644-b91bf61ff1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:22.287976 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba15c50-c242-4503-a644-b91bf61ff1f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:22.288619 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba15c50-c242-4503-a644-b91bf61ff1f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:22.288926 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba15c50-c242-4503-a644-b91bf61ff1f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:22.290548 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba15c50-c242-4503-a644-b91bf61ff1f1 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:22.302504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1299/2606] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:22.306746 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e8ae4-2b6b-473d-b83c-5243fe10534e None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:22.317039 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e8ae4-2b6b-473d-b83c-5243fe10534e None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:22.321915 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d5b26-0898-4446-854b-695b2a8b6d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:22.322517 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d5b26-0898-4446-854b-695b2a8b6d7d admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:22.322799 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d5b26-0898-4446-854b-695b2a8b6d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:22.323077 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d5b26-0898-4446-854b-695b2a8b6d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:22.323705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d5b26-0898-4446-854b-695b2a8b6d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:22.325693 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d5b26-0898-4446-854b-695b2a8b6d7d admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:22.352539 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1308/2607] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:53:22 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:22.357778 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba15c50-c242-4503-a644-b91bf61ff1f1 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:22.368466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba15c50-c242-4503-a644-b91bf61ff1f1 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:22.394151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:22.428632 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378092e-9361-4b72-b7b5-e5de37b7e8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:22.429306 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378092e-9361-4b72-b7b5-e5de37b7e8e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:22.429622 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378092e-9361-4b72-b7b5-e5de37b7e8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:22.429900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378092e-9361-4b72-b7b5-e5de37b7e8e5 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:22.430569 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378092e-9361-4b72-b7b5-e5de37b7e8e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:22.432457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378092e-9361-4b72-b7b5-e5de37b7e8e5 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:22.457616 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1300/2608] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:53:22 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:22.458756 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d5b26-0898-4446-854b-695b2a8b6d7d admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:22.470043 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d5b26-0898-4446-854b-695b2a8b6d7d admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:22.474644 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f7c31-ab16-45aa-a40c-e3104ae2c9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:22.475237 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f7c31-ab16-45aa-a40c-e3104ae2c9da admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:22.475513 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f7c31-ab16-45aa-a40c-e3104ae2c9da admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:22.475785 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f7c31-ab16-45aa-a40c-e3104ae2c9da admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:22.476454 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f7c31-ab16-45aa-a40c-e3104ae2c9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:22.478076 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f7c31-ab16-45aa-a40c-e3104ae2c9da admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:22.488733 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1309/2609] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:53:22.492766 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378092e-9361-4b72-b7b5-e5de37b7e8e5 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:22.503043 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378092e-9361-4b72-b7b5-e5de37b7e8e5 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:22.507745 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c6868-c757-4c33-8bbd-8cb579193c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:22.508342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c6868-c757-4c33-8bbd-8cb579193c6b admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:22.508626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c6868-c757-4c33-8bbd-8cb579193c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:22.508906 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c6868-c757-4c33-8bbd-8cb579193c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:22.509590 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c6868-c757-4c33-8bbd-8cb579193c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:22.511200 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c6868-c757-4c33-8bbd-8cb579193c6b admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:22.522076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1301/2610] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:53:22.526350 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f7c31-ab16-45aa-a40c-e3104ae2c9da admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:22.536815 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f7c31-ab16-45aa-a40c-e3104ae2c9da admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:22.541370 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7720e-8e59-4874-a586-02550b2e5ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:22.542048 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7720e-8e59-4874-a586-02550b2e5ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:22.542327 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7720e-8e59-4874-a586-02550b2e5ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:22.542603 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7720e-8e59-4874-a586-02550b2e5ec3 admin admin] PATH_INFO: `/v3/projects/a92cce7fc3e24348a34a829c0aab034d/users/83b2f36dc652485b8eca127f5adca68d/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:22.557184 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7720e-8e59-4874-a586-02550b2e5ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92cce7fc3e24348a34a829c0aab034d, user_id=83b2f36dc652485b8eca127f5adca68d, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:22.559887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7720e-8e59-4874-a586-02550b2e5ec3 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:22.572361 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1310/2611] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:53:22 2022] PUT /identity/v3/projects/a92cce7fc3e24348a34a829c0aab034d/users/83b2f36dc652485b8eca127f5adca68d/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:22.584118 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b2f17-19d3-4ba6-91eb-b2ce46c0e73c None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:22.584403 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b2f17-19d3-4ba6-91eb-b2ce46c0e73c None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:22.584678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b2f17-19d3-4ba6-91eb-b2ce46c0e73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:22.613101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-a48b2f17-19d3-4ba6-91eb-b2ce46c0e73c None None] MFA Rules not processed for user `83b2f36dc652485b8eca127f5adca68d`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:22.614345 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-a48b2f17-19d3-4ba6-91eb-b2ce46c0e73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:22.678024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1302/2612] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:53:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:22.682434 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7720e-8e59-4874-a586-02550b2e5ec3 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:22.743975 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7720e-8e59-4874-a586-02550b2e5ec3 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:22.748803 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f728206-840f-44dc-b968-b231d4a0c2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:22.749404 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f728206-840f-44dc-b968-b231d4a0c2b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:22.749713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f728206-840f-44dc-b968-b231d4a0c2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:22.749988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f728206-840f-44dc-b968-b231d4a0c2b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:22.750614 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f728206-840f-44dc-b968-b231d4a0c2b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:22.752508 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f728206-840f-44dc-b968-b231d4a0c2b3 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:22.779223 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1311/2613] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:53:22 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:22.783577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b2f17-19d3-4ba6-91eb-b2ce46c0e73c None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:22.794511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b2f17-19d3-4ba6-91eb-b2ce46c0e73c None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:22.853597 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c861ba1-def9-452b-9369-11f85ee551ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:22.854210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c861ba1-def9-452b-9369-11f85ee551ed admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:22.854491 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c861ba1-def9-452b-9369-11f85ee551ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:22.854766 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c861ba1-def9-452b-9369-11f85ee551ed admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:22.855507 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c861ba1-def9-452b-9369-11f85ee551ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:22.857451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c861ba1-def9-452b-9369-11f85ee551ed admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:22.879453 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1303/2614] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:53:22 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:22.883536 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f728206-840f-44dc-b968-b231d4a0c2b3 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:22.895007 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f728206-840f-44dc-b968-b231d4a0c2b3 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:22.900148 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4526b8d-0aab-4c63-abaf-35f4c67fc25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:22.900779 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4526b8d-0aab-4c63-abaf-35f4c67fc25b admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:22.901063 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4526b8d-0aab-4c63-abaf-35f4c67fc25b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:22.901342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4526b8d-0aab-4c63-abaf-35f4c67fc25b admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:22.902024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4526b8d-0aab-4c63-abaf-35f4c67fc25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:22.904554 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4526b8d-0aab-4c63-abaf-35f4c67fc25b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:22.916313 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1312/2615] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:53:22.921223 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c861ba1-def9-452b-9369-11f85ee551ed admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:22.931614 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c861ba1-def9-452b-9369-11f85ee551ed admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:22.936330 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d7932-f056-40c1-a01b-8b230b3e870f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:22.936980 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d7932-f056-40c1-a01b-8b230b3e870f admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:22.937264 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d7932-f056-40c1-a01b-8b230b3e870f admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:22.937668 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d7932-f056-40c1-a01b-8b230b3e870f admin admin] PATH_INFO: `/v3/projects/68e7d0d1b5844583a529a5bb88465bc9/users/7e31d24c1a2c4be1b90315e44c75b8c0/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:22.953120 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d7932-f056-40c1-a01b-8b230b3e870f admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e7d0d1b5844583a529a5bb88465bc9, user_id=7e31d24c1a2c4be1b90315e44c75b8c0, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:22.955780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d7932-f056-40c1-a01b-8b230b3e870f admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:22.970024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1304/2616] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:53:22 2022] PUT /identity/v3/projects/68e7d0d1b5844583a529a5bb88465bc9/users/7e31d24c1a2c4be1b90315e44c75b8c0/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:22.974363 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4526b8d-0aab-4c63-abaf-35f4c67fc25b admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:22.984437 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4526b8d-0aab-4c63-abaf-35f4c67fc25b admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:23.034666 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:23.043046 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274a9de-f519-44b1-8cb4-dd3bda2cf81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:23.043995 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274a9de-f519-44b1-8cb4-dd3bda2cf81b admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:23.045087 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274a9de-f519-44b1-8cb4-dd3bda2cf81b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:23.045376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274a9de-f519-44b1-8cb4-dd3bda2cf81b admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:23.046236 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274a9de-f519-44b1-8cb4-dd3bda2cf81b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:23.048081 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274a9de-f519-44b1-8cb4-dd3bda2cf81b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:23.057855 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1313/2617] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:53:23.062481 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d7932-f056-40c1-a01b-8b230b3e870f admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:23.068051 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:23.074553 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d7932-f056-40c1-a01b-8b230b3e870f admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:23.080125 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c33719-c94e-458b-8407-28bc6af0277d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:23.080776 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c33719-c94e-458b-8407-28bc6af0277d admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:23.081055 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c33719-c94e-458b-8407-28bc6af0277d admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:23.081352 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c33719-c94e-458b-8407-28bc6af0277d admin admin] PATH_INFO: `/v3/projects/68e7d0d1b5844583a529a5bb88465bc9/users/7e31d24c1a2c4be1b90315e44c75b8c0/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:23.083296 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c33719-c94e-458b-8407-28bc6af0277d admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e7d0d1b5844583a529a5bb88465bc9, user_id=7e31d24c1a2c4be1b90315e44c75b8c0, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:23.085952 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c33719-c94e-458b-8407-28bc6af0277d admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:23.096772 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1305/2618] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:53:23 2022] PUT /identity/v3/projects/68e7d0d1b5844583a529a5bb88465bc9/users/7e31d24c1a2c4be1b90315e44c75b8c0/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:53:23.107350 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb15709-6d1e-43fd-bdfb-f5cc38cbbe4b None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:23.107669 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb15709-6d1e-43fd-bdfb-f5cc38cbbe4b None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:23.107950 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb15709-6d1e-43fd-bdfb-f5cc38cbbe4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:23.134975 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-9eb15709-6d1e-43fd-bdfb-f5cc38cbbe4b None None] MFA Rules not processed for user `7e31d24c1a2c4be1b90315e44c75b8c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:23.136194 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-9eb15709-6d1e-43fd-bdfb-f5cc38cbbe4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:23.205608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1314/2619] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:53:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:23.217130 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c33719-c94e-458b-8407-28bc6af0277d admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:23.218857 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-50c33719-c94e-458b-8407-28bc6af0277d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:23.305164 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c33719-c94e-458b-8407-28bc6af0277d admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:23.309116 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f43eb-c867-48a6-ba28-8ab26a271fec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:23.310277 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f43eb-c867-48a6-ba28-8ab26a271fec service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:23.310608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f43eb-c867-48a6-ba28-8ab26a271fec service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:23.310888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f43eb-c867-48a6-ba28-8ab26a271fec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:23.367979 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f43eb-c867-48a6-ba28-8ab26a271fec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:23.369408 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f43eb-c867-48a6-ba28-8ab26a271fec service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:23.381486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1306/2620] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:25.940029 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb15709-6d1e-43fd-bdfb-f5cc38cbbe4b None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:25.949905 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb15709-6d1e-43fd-bdfb-f5cc38cbbe4b None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:25.954011 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3bc5b-8d08-440b-8985-889a653ff6d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:25.954605 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3bc5b-8d08-440b-8985-889a653ff6d2 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:25.954883 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3bc5b-8d08-440b-8985-889a653ff6d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:25.955156 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3bc5b-8d08-440b-8985-889a653ff6d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:25.964328 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3bc5b-8d08-440b-8985-889a653ff6d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:25.965776 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3bc5b-8d08-440b-8985-889a653ff6d2 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:25.975733 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1315/2621] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:33.375676 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=61,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:35.971495 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=44 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:38.483132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f43eb-c867-48a6-ba28-8ab26a271fec service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:38.545169 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f43eb-c867-48a6-ba28-8ab26a271fec service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:38.549632 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e4102-c166-425d-9ded-225399253875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:38.550248 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e4102-c166-425d-9ded-225399253875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:38.550521 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e4102-c166-425d-9ded-225399253875 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:38.550788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e4102-c166-425d-9ded-225399253875 admin admin] PATH_INFO: `/v3/users/83b2f36dc652485b8eca127f5adca68d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:38.551899 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e4102-c166-425d-9ded-225399253875 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83b2f36dc652485b8eca127f5adca68d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:38.553867 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e4102-c166-425d-9ded-225399253875 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:38.600567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-8d2e4102-c166-425d-9ded-225399253875 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83b2f36dc652485b8eca127f5adca68d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:38.601238 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-8d2e4102-c166-425d-9ded-225399253875 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83b2f36dc652485b8eca127f5adca68d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:38.601883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-8d2e4102-c166-425d-9ded-225399253875 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83b2f36dc652485b8eca127f5adca68d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:38.614525 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-8d2e4102-c166-425d-9ded-225399253875 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83b2f36dc652485b8eca127f5adca68d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:38.622615 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-8d2e4102-c166-425d-9ded-225399253875 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83b2f36dc652485b8eca127f5adca68d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:38.635200 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1307/2622] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:53:38 2022] DELETE /identity/v3/users/83b2f36dc652485b8eca127f5adca68d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:38.639678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7165b9-f7a4-40cd-8bc4-0543b184dab5 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:38.640185 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7165b9-f7a4-40cd-8bc4-0543b184dab5 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:38.640285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7165b9-f7a4-40cd-8bc4-0543b184dab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:38.658700 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-cf7165b9-f7a4-40cd-8bc4-0543b184dab5 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:38.659901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-cf7165b9-f7a4-40cd-8bc4-0543b184dab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:38.718787 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1316/2623] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:38.728498 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e4102-c166-425d-9ded-225399253875 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:38.729996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-8d2e4102-c166-425d-9ded-225399253875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:38.788200 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e4102-c166-425d-9ded-225399253875 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:38.791885 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d598f0-8ba7-4c77-aaa1-4a91b1414865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:38.792490 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d598f0-8ba7-4c77-aaa1-4a91b1414865 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:38.792766 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d598f0-8ba7-4c77-aaa1-4a91b1414865 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:38.793038 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d598f0-8ba7-4c77-aaa1-4a91b1414865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:38.802548 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d598f0-8ba7-4c77-aaa1-4a91b1414865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:38.803961 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d598f0-8ba7-4c77-aaa1-4a91b1414865 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:38.814102 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1308/2624] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:39.089081 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7165b9-f7a4-40cd-8bc4-0543b184dab5 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:39.091084 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-cf7165b9-f7a4-40cd-8bc4-0543b184dab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:39.105794 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7165b9-f7a4-40cd-8bc4-0543b184dab5 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:39.111104 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f0e3c-1b43-4bae-a8aa-30ae663239b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:39.111746 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f0e3c-1b43-4bae-a8aa-30ae663239b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:39.112025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f0e3c-1b43-4bae-a8aa-30ae663239b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:39.112303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f0e3c-1b43-4bae-a8aa-30ae663239b3 admin admin] PATH_INFO: `/v3/projects/a92cce7fc3e24348a34a829c0aab034d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:39.113428 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f0e3c-1b43-4bae-a8aa-30ae663239b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a92cce7fc3e24348a34a829c0aab034d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:39.115373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f0e3c-1b43-4bae-a8aa-30ae663239b3 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:39.164509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-524f0e3c-1b43-4bae-a8aa-30ae663239b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92cce7fc3e24348a34a829c0aab034d', 'request_id': 'req-524f0e3c-1b43-4bae-a8aa-30ae663239b3'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:39.171727 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-524f0e3c-1b43-4bae-a8aa-30ae663239b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92cce7fc3e24348a34a829c0aab034d', 'request_id': 'req-524f0e3c-1b43-4bae-a8aa-30ae663239b3'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:39.178210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-524f0e3c-1b43-4bae-a8aa-30ae663239b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92cce7fc3e24348a34a829c0aab034d', 'request_id': 'req-524f0e3c-1b43-4bae-a8aa-30ae663239b3'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:39.188941 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-524f0e3c-1b43-4bae-a8aa-30ae663239b3 admin admin] The token cache is being invalidate because project a92cce7fc3e24348a34a829c0aab034d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:53:39.189229 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-524f0e3c-1b43-4bae-a8aa-30ae663239b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:39.190025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-524f0e3c-1b43-4bae-a8aa-30ae663239b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:39.191511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1317/2625] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:53:39 2022] DELETE /identity/v3/projects/a92cce7fc3e24348a34a829c0aab034d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:39.195534 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d598f0-8ba7-4c77-aaa1-4a91b1414865 service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:39.205721 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d598f0-8ba7-4c77-aaa1-4a91b1414865 service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:39.224104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:39.268342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b21f5-203e-4adc-8a2b-b98cd1f9239c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:39.268890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b21f5-203e-4adc-8a2b-b98cd1f9239c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:39.269178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b21f5-203e-4adc-8a2b-b98cd1f9239c admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:39.269449 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b21f5-203e-4adc-8a2b-b98cd1f9239c admin admin] PATH_INFO: `/v3/users/7e31d24c1a2c4be1b90315e44c75b8c0` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:39.270603 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b21f5-203e-4adc-8a2b-b98cd1f9239c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e31d24c1a2c4be1b90315e44c75b8c0)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:39.272504 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b21f5-203e-4adc-8a2b-b98cd1f9239c admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:39.318712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-8d1b21f5-203e-4adc-8a2b-b98cd1f9239c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e31d24c1a2c4be1b90315e44c75b8c0'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:39.319357 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-8d1b21f5-203e-4adc-8a2b-b98cd1f9239c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e31d24c1a2c4be1b90315e44c75b8c0'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:39.319963 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-8d1b21f5-203e-4adc-8a2b-b98cd1f9239c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e31d24c1a2c4be1b90315e44c75b8c0'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:39.332323 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-8d1b21f5-203e-4adc-8a2b-b98cd1f9239c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e31d24c1a2c4be1b90315e44c75b8c0'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:39.340040 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-8d1b21f5-203e-4adc-8a2b-b98cd1f9239c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e31d24c1a2c4be1b90315e44c75b8c0'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:39.352578 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1309/2626] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:53:39 2022] DELETE /identity/v3/users/7e31d24c1a2c4be1b90315e44c75b8c0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:39.632470 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f0e3c-1b43-4bae-a8aa-30ae663239b3 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:39.634098 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-524f0e3c-1b43-4bae-a8aa-30ae663239b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:39.650079 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f0e3c-1b43-4bae-a8aa-30ae663239b3 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:39.707243 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46106e83-bf4c-4fdd-bf3d-88a94a09c26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:39.707889 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46106e83-bf4c-4fdd-bf3d-88a94a09c26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:39.708163 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46106e83-bf4c-4fdd-bf3d-88a94a09c26c admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:39.708432 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46106e83-bf4c-4fdd-bf3d-88a94a09c26c admin admin] PATH_INFO: `/v3/projects/68e7d0d1b5844583a529a5bb88465bc9` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:39.709610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46106e83-bf4c-4fdd-bf3d-88a94a09c26c admin admin] RBAC: Authorizing `identity:delete_project(project_id=68e7d0d1b5844583a529a5bb88465bc9)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:39.711487 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46106e83-bf4c-4fdd-bf3d-88a94a09c26c admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:39.743096 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:39.760876 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-46106e83-bf4c-4fdd-bf3d-88a94a09c26c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68e7d0d1b5844583a529a5bb88465bc9', 'request_id': 'req-46106e83-bf4c-4fdd-bf3d-88a94a09c26c'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:39.768343 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-46106e83-bf4c-4fdd-bf3d-88a94a09c26c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68e7d0d1b5844583a529a5bb88465bc9', 'request_id': 'req-46106e83-bf4c-4fdd-bf3d-88a94a09c26c'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:39.774466 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-46106e83-bf4c-4fdd-bf3d-88a94a09c26c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68e7d0d1b5844583a529a5bb88465bc9', 'request_id': 'req-46106e83-bf4c-4fdd-bf3d-88a94a09c26c'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:39.784856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-46106e83-bf4c-4fdd-bf3d-88a94a09c26c admin admin] The token cache is being invalidate because project 68e7d0d1b5844583a529a5bb88465bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:53:39.785142 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-46106e83-bf4c-4fdd-bf3d-88a94a09c26c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:39.785789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-46106e83-bf4c-4fdd-bf3d-88a94a09c26c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:39.787238 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1318/2627] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:53:39 2022] DELETE /identity/v3/projects/68e7d0d1b5844583a529a5bb88465bc9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:39.792888 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ef37e-1e02-4912-b079-44bb9a06aa38 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:39.793356 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ef37e-1e02-4912-b079-44bb9a06aa38 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:39.793636 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ef37e-1e02-4912-b079-44bb9a06aa38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:39.813836 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-828ef37e-1e02-4912-b079-44bb9a06aa38 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:39.814987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-828ef37e-1e02-4912-b079-44bb9a06aa38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:39.874616 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1310/2628] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:53:39.882685 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738a421-4fe3-4118-b87b-adee93716b14 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:39.882968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738a421-4fe3-4118-b87b-adee93716b14 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:39.883262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738a421-4fe3-4118-b87b-adee93716b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:39.902534 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-9738a421-4fe3-4118-b87b-adee93716b14 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:39.904419 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-9738a421-4fe3-4118-b87b-adee93716b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:39.912315 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1319/2629] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:39.916534 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ef37e-1e02-4912-b079-44bb9a06aa38 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:39.927088 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ef37e-1e02-4912-b079-44bb9a06aa38 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:39.931841 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb0dfc-d645-4563-b57f-a34685ce25ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:39.932445 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb0dfc-d645-4563-b57f-a34685ce25ed admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:39.932725 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb0dfc-d645-4563-b57f-a34685ce25ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:39.933000 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb0dfc-d645-4563-b57f-a34685ce25ed admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:39.933682 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb0dfc-d645-4563-b57f-a34685ce25ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:39.934038 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb0dfc-d645-4563-b57f-a34685ce25ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:39.935642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb0dfc-d645-4563-b57f-a34685ce25ed admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:39.947648 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1311/2630] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:39.951958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738a421-4fe3-4118-b87b-adee93716b14 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:39.961204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738a421-4fe3-4118-b87b-adee93716b14 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:39.966683 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc394d-2893-45d1-9ebb-5eac2447d74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:39.967266 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc394d-2893-45d1-9ebb-5eac2447d74e admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:39.967542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc394d-2893-45d1-9ebb-5eac2447d74e admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:39.967817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc394d-2893-45d1-9ebb-5eac2447d74e admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:39.968425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc394d-2893-45d1-9ebb-5eac2447d74e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:39.970321 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc394d-2893-45d1-9ebb-5eac2447d74e admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:39.997697 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1320/2631] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:53:39 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:40.001828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb0dfc-d645-4563-b57f-a34685ce25ed admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:40.012003 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb0dfc-d645-4563-b57f-a34685ce25ed admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:40.038625 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:40.071110 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef881168-fea9-4ec0-b6f0-6583d240b3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:40.071646 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef881168-fea9-4ec0-b6f0-6583d240b3fd admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:40.071929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef881168-fea9-4ec0-b6f0-6583d240b3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:40.072206 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef881168-fea9-4ec0-b6f0-6583d240b3fd admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:40.072840 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef881168-fea9-4ec0-b6f0-6583d240b3fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:40.075290 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef881168-fea9-4ec0-b6f0-6583d240b3fd admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:40.096356 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1312/2632] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:53:40 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:40.100547 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc394d-2893-45d1-9ebb-5eac2447d74e admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:40.111160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc394d-2893-45d1-9ebb-5eac2447d74e admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:40.115976 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68328639-a60c-448e-b627-21281d9475cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:40.116578 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68328639-a60c-448e-b627-21281d9475cc admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:40.116850 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68328639-a60c-448e-b627-21281d9475cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:40.117119 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68328639-a60c-448e-b627-21281d9475cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:40.117805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68328639-a60c-448e-b627-21281d9475cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:40.119394 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68328639-a60c-448e-b627-21281d9475cc admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:40.129159 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1321/2633] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:53:40.133061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef881168-fea9-4ec0-b6f0-6583d240b3fd admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:40.143485 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef881168-fea9-4ec0-b6f0-6583d240b3fd admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:40.148080 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cbb51-cc80-4c68-9d6c-5c8bd7b57270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:40.148663 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cbb51-cc80-4c68-9d6c-5c8bd7b57270 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:40.148942 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cbb51-cc80-4c68-9d6c-5c8bd7b57270 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:40.149214 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cbb51-cc80-4c68-9d6c-5c8bd7b57270 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:40.149889 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261cbb51-cc80-4c68-9d6c-5c8bd7b57270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:40.151448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261cbb51-cc80-4c68-9d6c-5c8bd7b57270 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:40.162639 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1313/2634] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:53:40.166789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68328639-a60c-448e-b627-21281d9475cc admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:40.177165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68328639-a60c-448e-b627-21281d9475cc admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:40.181881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0b488-e246-4a31-9aab-78f75271c1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:40.182511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0b488-e246-4a31-9aab-78f75271c1d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:40.182788 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0b488-e246-4a31-9aab-78f75271c1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:40.183061 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0b488-e246-4a31-9aab-78f75271c1d4 admin admin] PATH_INFO: `/v3/projects/8538340e57414d30a562e6f0276e59f0/users/25c924b12f9547259b6af79c60a322de/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:40.197276 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0b488-e246-4a31-9aab-78f75271c1d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8538340e57414d30a562e6f0276e59f0, user_id=25c924b12f9547259b6af79c60a322de, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:40.200481 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0b488-e246-4a31-9aab-78f75271c1d4 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:40.213788 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1322/2635] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:53:40 2022] PUT /identity/v3/projects/8538340e57414d30a562e6f0276e59f0/users/25c924b12f9547259b6af79c60a322de/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:53:40.226178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d604608-5289-4231-b5d3-cd7a105665c7 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:40.226449 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d604608-5289-4231-b5d3-cd7a105665c7 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:40.226737 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d604608-5289-4231-b5d3-cd7a105665c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:40.255969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-0d604608-5289-4231-b5d3-cd7a105665c7 None None] MFA Rules not processed for user `25c924b12f9547259b6af79c60a322de`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:40.257205 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-0d604608-5289-4231-b5d3-cd7a105665c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:40.449362 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1314/2636] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:53:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:40.454551 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0b488-e246-4a31-9aab-78f75271c1d4 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:40.516731 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0b488-e246-4a31-9aab-78f75271c1d4 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:40.521337 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f258935-0398-47d1-b140-5f03135c4f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:40.521964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f258935-0398-47d1-b140-5f03135c4f03 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:40.522237 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f258935-0398-47d1-b140-5f03135c4f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:40.522507 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f258935-0398-47d1-b140-5f03135c4f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:40.523132 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f258935-0398-47d1-b140-5f03135c4f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:40.525017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f258935-0398-47d1-b140-5f03135c4f03 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:40.551458 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1323/2637] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:53:40 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:40.555605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d604608-5289-4231-b5d3-cd7a105665c7 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:40.566806 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d604608-5289-4231-b5d3-cd7a105665c7 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:40.620721 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359c08e-ec53-4c96-80b2-92bb042d1423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:40.621317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359c08e-ec53-4c96-80b2-92bb042d1423 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:40.622152 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359c08e-ec53-4c96-80b2-92bb042d1423 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:40.622425 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359c08e-ec53-4c96-80b2-92bb042d1423 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:40.623030 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359c08e-ec53-4c96-80b2-92bb042d1423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:40.624916 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359c08e-ec53-4c96-80b2-92bb042d1423 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:40.645880 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1315/2638] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:53:40 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:40.649899 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f258935-0398-47d1-b140-5f03135c4f03 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:40.662027 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f258935-0398-47d1-b140-5f03135c4f03 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:40.668225 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965174bd-342e-48ab-a4f9-2a84eb1fedd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:40.668907 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965174bd-342e-48ab-a4f9-2a84eb1fedd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:40.669188 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965174bd-342e-48ab-a4f9-2a84eb1fedd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:40.669490 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965174bd-342e-48ab-a4f9-2a84eb1fedd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:40.670142 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965174bd-342e-48ab-a4f9-2a84eb1fedd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:40.671735 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965174bd-342e-48ab-a4f9-2a84eb1fedd2 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:40.682715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1324/2639] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:53:40.687420 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359c08e-ec53-4c96-80b2-92bb042d1423 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:40.697413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359c08e-ec53-4c96-80b2-92bb042d1423 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:40.702808 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc133d-cd58-495a-a315-4180517ff667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:40.703385 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc133d-cd58-495a-a315-4180517ff667 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:40.703665 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc133d-cd58-495a-a315-4180517ff667 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:40.703940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc133d-cd58-495a-a315-4180517ff667 admin admin] PATH_INFO: `/v3/projects/266bf469f0e3477db262f1acb489af4d/users/0164c7fddea7415e961c9b0749b68ef8/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:40.718757 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc133d-cd58-495a-a315-4180517ff667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=266bf469f0e3477db262f1acb489af4d, user_id=0164c7fddea7415e961c9b0749b68ef8, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:40.721379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc133d-cd58-495a-a315-4180517ff667 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:40.734849 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1316/2640] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:53:40 2022] PUT /identity/v3/projects/266bf469f0e3477db262f1acb489af4d/users/0164c7fddea7415e961c9b0749b68ef8/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:40.738768 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965174bd-342e-48ab-a4f9-2a84eb1fedd2 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:40.749431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965174bd-342e-48ab-a4f9-2a84eb1fedd2 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:40.769629 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:40.806922 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dfb59-9942-491f-87d0-c902e40cf440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:40.807524 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dfb59-9942-491f-87d0-c902e40cf440 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:40.807806 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dfb59-9942-491f-87d0-c902e40cf440 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:40.808083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dfb59-9942-491f-87d0-c902e40cf440 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:40.808715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12dfb59-9942-491f-87d0-c902e40cf440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:40.811192 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12dfb59-9942-491f-87d0-c902e40cf440 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:40.820668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1325/2641] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:53:40.825741 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc133d-cd58-495a-a315-4180517ff667 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:40.831154 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:40.837358 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc133d-cd58-495a-a315-4180517ff667 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:40.842986 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068757f4-26d9-4151-a926-17ec84a09140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:40.843640 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068757f4-26d9-4151-a926-17ec84a09140 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:40.843942 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068757f4-26d9-4151-a926-17ec84a09140 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:40.844216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068757f4-26d9-4151-a926-17ec84a09140 admin admin] PATH_INFO: `/v3/projects/266bf469f0e3477db262f1acb489af4d/users/0164c7fddea7415e961c9b0749b68ef8/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:40.846174 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068757f4-26d9-4151-a926-17ec84a09140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=266bf469f0e3477db262f1acb489af4d, user_id=0164c7fddea7415e961c9b0749b68ef8, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:40.848774 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068757f4-26d9-4151-a926-17ec84a09140 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:40.859702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1317/2642] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:53:40 2022] PUT /identity/v3/projects/266bf469f0e3477db262f1acb489af4d/users/0164c7fddea7415e961c9b0749b68ef8/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:40.869964 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2ada9-5b19-424c-b635-a351418e0c05 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:40.870334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2ada9-5b19-424c-b635-a351418e0c05 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:40.870674 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2ada9-5b19-424c-b635-a351418e0c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:40.898665 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-f1a2ada9-5b19-424c-b635-a351418e0c05 None None] MFA Rules not processed for user `0164c7fddea7415e961c9b0749b68ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:40.899864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f1a2ada9-5b19-424c-b635-a351418e0c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:40.967092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1326/2643] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:53:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:53:40.978216 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068757f4-26d9-4151-a926-17ec84a09140 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:40.979906 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-068757f4-26d9-4151-a926-17ec84a09140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:41.041596 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068757f4-26d9-4151-a926-17ec84a09140 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:41.045310 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9ca08-f11a-40cd-a5b5-cccebf252442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:41.045939 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9ca08-f11a-40cd-a5b5-cccebf252442 service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:41.046217 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9ca08-f11a-40cd-a5b5-cccebf252442 service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:41.046485 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9ca08-f11a-40cd-a5b5-cccebf252442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:41.055277 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9ca08-f11a-40cd-a5b5-cccebf252442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:41.056698 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9ca08-f11a-40cd-a5b5-cccebf252442 service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:41.066066 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1318/2644] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:41.147670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2ada9-5b19-424c-b635-a351418e0c05 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:41.157891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2ada9-5b19-424c-b635-a351418e0c05 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:41.161456 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b12d6d-f801-4a8d-8368-1a342247424f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:41.162078 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b12d6d-f801-4a8d-8368-1a342247424f service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:41.162356 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b12d6d-f801-4a8d-8368-1a342247424f service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:41.162631 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b12d6d-f801-4a8d-8368-1a342247424f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:41.220467 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b12d6d-f801-4a8d-8368-1a342247424f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:41.221826 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b12d6d-f801-4a8d-8368-1a342247424f service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:41.230925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1327/2645] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:45.935736 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9ca08-f11a-40cd-a5b5-cccebf252442 service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:45.997590 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9ca08-f11a-40cd-a5b5-cccebf252442 service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:46.002103 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16df69f-552a-4a80-86ea-dc055096d7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:46.002755 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16df69f-552a-4a80-86ea-dc055096d7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:46.003074 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16df69f-552a-4a80-86ea-dc055096d7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:46.003308 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16df69f-552a-4a80-86ea-dc055096d7c1 admin admin] PATH_INFO: `/v3/users/25c924b12f9547259b6af79c60a322de` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:46.004431 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16df69f-552a-4a80-86ea-dc055096d7c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25c924b12f9547259b6af79c60a322de)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:46.006442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16df69f-552a-4a80-86ea-dc055096d7c1 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:46.052353 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f16df69f-552a-4a80-86ea-dc055096d7c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25c924b12f9547259b6af79c60a322de'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:46.052943 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f16df69f-552a-4a80-86ea-dc055096d7c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25c924b12f9547259b6af79c60a322de'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:46.053597 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f16df69f-552a-4a80-86ea-dc055096d7c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25c924b12f9547259b6af79c60a322de'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:46.065357 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f16df69f-552a-4a80-86ea-dc055096d7c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25c924b12f9547259b6af79c60a322de'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:46.073703 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-f16df69f-552a-4a80-86ea-dc055096d7c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25c924b12f9547259b6af79c60a322de'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:46.086747 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1319/2646] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:53:45 2022] DELETE /identity/v3/users/25c924b12f9547259b6af79c60a322de => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:46.092140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b05fc4-85f2-45d7-b89c-56a724a556cf None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:46.092647 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b05fc4-85f2-45d7-b89c-56a724a556cf None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:46.092749 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b05fc4-85f2-45d7-b89c-56a724a556cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:46.110896 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-70b05fc4-85f2-45d7-b89c-56a724a556cf None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:46.112079 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-70b05fc4-85f2-45d7-b89c-56a724a556cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:46.151771 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:46.171261 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1328/2647] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:46.180969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16df69f-552a-4a80-86ea-dc055096d7c1 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:46.182380 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-f16df69f-552a-4a80-86ea-dc055096d7c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:46.196242 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:46.242860 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16df69f-552a-4a80-86ea-dc055096d7c1 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:46.246579 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abfb56-992e-4055-95a8-73f8d104db1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:46.247233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abfb56-992e-4055-95a8-73f8d104db1b service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:46.247508 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abfb56-992e-4055-95a8-73f8d104db1b service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:46.247809 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abfb56-992e-4055-95a8-73f8d104db1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:46.256964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abfb56-992e-4055-95a8-73f8d104db1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:46.258405 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abfb56-992e-4055-95a8-73f8d104db1b service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:46.268447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1320/2648] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:46.544628 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b05fc4-85f2-45d7-b89c-56a724a556cf None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:46.546536 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-70b05fc4-85f2-45d7-b89c-56a724a556cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:46.560913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b05fc4-85f2-45d7-b89c-56a724a556cf None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:46.565573 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3540507-ffea-431f-bf6c-f550dfcbc9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:46.566208 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3540507-ffea-431f-bf6c-f550dfcbc9d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:46.566486 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3540507-ffea-431f-bf6c-f550dfcbc9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:46.566756 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3540507-ffea-431f-bf6c-f550dfcbc9d9 admin admin] PATH_INFO: `/v3/projects/8538340e57414d30a562e6f0276e59f0` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:46.568580 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3540507-ffea-431f-bf6c-f550dfcbc9d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8538340e57414d30a562e6f0276e59f0)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:46.570989 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3540507-ffea-431f-bf6c-f550dfcbc9d9 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:46.620462 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-d3540507-ffea-431f-bf6c-f550dfcbc9d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8538340e57414d30a562e6f0276e59f0', 'request_id': 'req-d3540507-ffea-431f-bf6c-f550dfcbc9d9'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:46.628643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-d3540507-ffea-431f-bf6c-f550dfcbc9d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8538340e57414d30a562e6f0276e59f0', 'request_id': 'req-d3540507-ffea-431f-bf6c-f550dfcbc9d9'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:46.634875 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-d3540507-ffea-431f-bf6c-f550dfcbc9d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8538340e57414d30a562e6f0276e59f0', 'request_id': 'req-d3540507-ffea-431f-bf6c-f550dfcbc9d9'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:46.646281 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-d3540507-ffea-431f-bf6c-f550dfcbc9d9 admin admin] The token cache is being invalidate because project 8538340e57414d30a562e6f0276e59f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:53:46.646575 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-d3540507-ffea-431f-bf6c-f550dfcbc9d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:46.647238 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-d3540507-ffea-431f-bf6c-f550dfcbc9d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:46.648754 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1329/2649] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:53:46 2022] DELETE /identity/v3/projects/8538340e57414d30a562e6f0276e59f0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:46.652761 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abfb56-992e-4055-95a8-73f8d104db1b service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:46.662261 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abfb56-992e-4055-95a8-73f8d104db1b service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:46.717916 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb06551-a403-42fa-8ccc-846ef725a07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:46.718544 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb06551-a403-42fa-8ccc-846ef725a07d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:46.718826 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb06551-a403-42fa-8ccc-846ef725a07d admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:46.719106 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb06551-a403-42fa-8ccc-846ef725a07d admin admin] PATH_INFO: `/v3/users/0164c7fddea7415e961c9b0749b68ef8` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:46.720237 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb06551-a403-42fa-8ccc-846ef725a07d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0164c7fddea7415e961c9b0749b68ef8)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:46.722171 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb06551-a403-42fa-8ccc-846ef725a07d admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:46.768140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-0cb06551-a403-42fa-8ccc-846ef725a07d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0164c7fddea7415e961c9b0749b68ef8'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:46.768787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-0cb06551-a403-42fa-8ccc-846ef725a07d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0164c7fddea7415e961c9b0749b68ef8'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:46.769396 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-0cb06551-a403-42fa-8ccc-846ef725a07d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0164c7fddea7415e961c9b0749b68ef8'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:46.781191 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-0cb06551-a403-42fa-8ccc-846ef725a07d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0164c7fddea7415e961c9b0749b68ef8'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:46.788474 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-0cb06551-a403-42fa-8ccc-846ef725a07d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0164c7fddea7415e961c9b0749b68ef8'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:46.800440 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1321/2650] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:53:46 2022] DELETE /identity/v3/users/0164c7fddea7415e961c9b0749b68ef8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:47.065893 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3540507-ffea-431f-bf6c-f550dfcbc9d9 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:47.067389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-d3540507-ffea-431f-bf6c-f550dfcbc9d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:47.081640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3540507-ffea-431f-bf6c-f550dfcbc9d9 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:47.140863 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ea83b-bea6-4752-9585-c9a899eae2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:47.141574 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ea83b-bea6-4752-9585-c9a899eae2cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:47.141782 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ea83b-bea6-4752-9585-c9a899eae2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:47.142083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ea83b-bea6-4752-9585-c9a899eae2cd admin admin] PATH_INFO: `/v3/projects/266bf469f0e3477db262f1acb489af4d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:47.143196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ea83b-bea6-4752-9585-c9a899eae2cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=266bf469f0e3477db262f1acb489af4d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:47.145129 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ea83b-bea6-4752-9585-c9a899eae2cd admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:47.190583 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3c4ea83b-bea6-4752-9585-c9a899eae2cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '266bf469f0e3477db262f1acb489af4d', 'request_id': 'req-3c4ea83b-bea6-4752-9585-c9a899eae2cd'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:47.198551 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3c4ea83b-bea6-4752-9585-c9a899eae2cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '266bf469f0e3477db262f1acb489af4d', 'request_id': 'req-3c4ea83b-bea6-4752-9585-c9a899eae2cd'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:47.204775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3c4ea83b-bea6-4752-9585-c9a899eae2cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '266bf469f0e3477db262f1acb489af4d', 'request_id': 'req-3c4ea83b-bea6-4752-9585-c9a899eae2cd'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:47.211120 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:47.217071 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3c4ea83b-bea6-4752-9585-c9a899eae2cd admin admin] The token cache is being invalidate because project 266bf469f0e3477db262f1acb489af4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:53:47.217643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3c4ea83b-bea6-4752-9585-c9a899eae2cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:47.218731 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3c4ea83b-bea6-4752-9585-c9a899eae2cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:47.220514 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1330/2651] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:53:47 2022] DELETE /identity/v3/projects/266bf469f0e3477db262f1acb489af4d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:47.225640 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515f236-9eb0-4c0e-b81d-ebcef34a7048 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:47.226133 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515f236-9eb0-4c0e-b81d-ebcef34a7048 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:47.226257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515f236-9eb0-4c0e-b81d-ebcef34a7048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:47.247333 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-4515f236-9eb0-4c0e-b81d-ebcef34a7048 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:47.248549 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-4515f236-9eb0-4c0e-b81d-ebcef34a7048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:47.279900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:47.313182 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1322/2652] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:47.322435 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ba516-1c4c-4687-8b27-da19c9217522 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:47.322725 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ba516-1c4c-4687-8b27-da19c9217522 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:47.323003 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ba516-1c4c-4687-8b27-da19c9217522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:47.343046 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-199ba516-1c4c-4687-8b27-da19c9217522 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:47.344250 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-199ba516-1c4c-4687-8b27-da19c9217522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:47.352469 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1331/2653] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:47.357604 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515f236-9eb0-4c0e-b81d-ebcef34a7048 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:47.367253 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515f236-9eb0-4c0e-b81d-ebcef34a7048 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:47.372103 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ca417-7f13-43fd-8708-c3facf0fbbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:47.372698 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ca417-7f13-43fd-8708-c3facf0fbbdc admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:47.373015 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ca417-7f13-43fd-8708-c3facf0fbbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:47.373243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ca417-7f13-43fd-8708-c3facf0fbbdc admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:47.374124 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ca417-7f13-43fd-8708-c3facf0fbbdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:47.374439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ca417-7f13-43fd-8708-c3facf0fbbdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:47.376286 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ca417-7f13-43fd-8708-c3facf0fbbdc admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:47.388028 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1323/2654] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:47.392305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ba516-1c4c-4687-8b27-da19c9217522 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:47.401656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ba516-1c4c-4687-8b27-da19c9217522 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:47.406887 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb97e2-c20a-43ee-98b4-01490581b3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:47.407477 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb97e2-c20a-43ee-98b4-01490581b3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:47.407750 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb97e2-c20a-43ee-98b4-01490581b3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:47.408020 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb97e2-c20a-43ee-98b4-01490581b3f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:47.408646 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb97e2-c20a-43ee-98b4-01490581b3f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:47.410557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb97e2-c20a-43ee-98b4-01490581b3f4 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:47.438092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1332/2655] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:53:47 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:47.442268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ca417-7f13-43fd-8708-c3facf0fbbdc admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:47.452473 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ca417-7f13-43fd-8708-c3facf0fbbdc admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:47.508687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96533a-b792-4b75-b87b-30e3535cfd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:47.509278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96533a-b792-4b75-b87b-30e3535cfd5d admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:47.509604 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96533a-b792-4b75-b87b-30e3535cfd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:47.509902 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96533a-b792-4b75-b87b-30e3535cfd5d admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:47.510557 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96533a-b792-4b75-b87b-30e3535cfd5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:47.512623 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96533a-b792-4b75-b87b-30e3535cfd5d admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:47.534372 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1324/2656] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:53:47 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:47.538575 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb97e2-c20a-43ee-98b4-01490581b3f4 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:47.549890 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb97e2-c20a-43ee-98b4-01490581b3f4 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:47.554547 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e6bc3-dc38-4c9c-829a-c073b3beee89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:47.555141 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e6bc3-dc38-4c9c-829a-c073b3beee89 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:47.555410 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e6bc3-dc38-4c9c-829a-c073b3beee89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:47.555686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e6bc3-dc38-4c9c-829a-c073b3beee89 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:47.556316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e6bc3-dc38-4c9c-829a-c073b3beee89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:47.557940 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e6bc3-dc38-4c9c-829a-c073b3beee89 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:47.567984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1333/2657] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:53:47.571898 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96533a-b792-4b75-b87b-30e3535cfd5d admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:47.582594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96533a-b792-4b75-b87b-30e3535cfd5d admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:47.587153 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7360a-aef0-4cc7-a144-dd9b389c45af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:47.587717 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7360a-aef0-4cc7-a144-dd9b389c45af admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:47.587993 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7360a-aef0-4cc7-a144-dd9b389c45af admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:47.588513 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7360a-aef0-4cc7-a144-dd9b389c45af admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:47.589147 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7360a-aef0-4cc7-a144-dd9b389c45af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:47.591531 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7360a-aef0-4cc7-a144-dd9b389c45af admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:47.601827 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1325/2658] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:53:47.605825 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e6bc3-dc38-4c9c-829a-c073b3beee89 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:47.618978 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e6bc3-dc38-4c9c-829a-c073b3beee89 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:47.624189 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c1290-01b9-426c-bfd5-a9faeb2345c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:47.624846 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c1290-01b9-426c-bfd5-a9faeb2345c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:47.625121 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c1290-01b9-426c-bfd5-a9faeb2345c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:47.625393 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c1290-01b9-426c-bfd5-a9faeb2345c8 admin admin] PATH_INFO: `/v3/projects/e0b5c56c463d4dc1a0ebad955e19add0/users/dcf54d269c854e6b9614591b535d1cc8/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:47.640628 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c1290-01b9-426c-bfd5-a9faeb2345c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0b5c56c463d4dc1a0ebad955e19add0, user_id=dcf54d269c854e6b9614591b535d1cc8, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:47.643392 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c1290-01b9-426c-bfd5-a9faeb2345c8 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:47.656814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1334/2659] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:53:47 2022] PUT /identity/v3/projects/e0b5c56c463d4dc1a0ebad955e19add0/users/dcf54d269c854e6b9614591b535d1cc8/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:47.667113 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80fc10-d77b-4739-b983-84fdeec20c19 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:47.667465 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80fc10-d77b-4739-b983-84fdeec20c19 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:47.667675 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80fc10-d77b-4739-b983-84fdeec20c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:47.695830 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-2a80fc10-d77b-4739-b983-84fdeec20c19 None None] MFA Rules not processed for user `dcf54d269c854e6b9614591b535d1cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:47.697065 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-2a80fc10-d77b-4739-b983-84fdeec20c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:47.759808 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1326/2660] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:53:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:47.764902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c1290-01b9-426c-bfd5-a9faeb2345c8 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:47.826311 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c1290-01b9-426c-bfd5-a9faeb2345c8 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:47.830942 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4b4f5-e233-428c-b582-426b717f1f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:47.831536 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4b4f5-e233-428c-b582-426b717f1f3a admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:47.831814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4b4f5-e233-428c-b582-426b717f1f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:47.832086 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4b4f5-e233-428c-b582-426b717f1f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:47.832705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece4b4f5-e233-428c-b582-426b717f1f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:47.834616 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece4b4f5-e233-428c-b582-426b717f1f3a admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:47.861379 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1335/2661] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:53:47 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:47.865412 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80fc10-d77b-4739-b983-84fdeec20c19 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:47.876746 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80fc10-d77b-4739-b983-84fdeec20c19 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:47.902215 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:47.940497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ea0b2-4445-42e3-a34b-3b3aa541523b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:47.941030 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ea0b2-4445-42e3-a34b-3b3aa541523b admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:47.941309 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ea0b2-4445-42e3-a34b-3b3aa541523b admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:47.941622 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ea0b2-4445-42e3-a34b-3b3aa541523b admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:47.942259 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ea0b2-4445-42e3-a34b-3b3aa541523b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:47.944154 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ea0b2-4445-42e3-a34b-3b3aa541523b admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:47.966558 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1327/2662] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:53:47 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:47.970636 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4b4f5-e233-428c-b582-426b717f1f3a admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:47.980987 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4b4f5-e233-428c-b582-426b717f1f3a admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:47.985588 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823d0e3-c01a-4288-b8dd-6e4ed123f40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:47.986183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823d0e3-c01a-4288-b8dd-6e4ed123f40c admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:47.986461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823d0e3-c01a-4288-b8dd-6e4ed123f40c admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:47.986738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823d0e3-c01a-4288-b8dd-6e4ed123f40c admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:47.987388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823d0e3-c01a-4288-b8dd-6e4ed123f40c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:47.988968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823d0e3-c01a-4288-b8dd-6e4ed123f40c admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:48.000057 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1336/2663] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:53:48.004055 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ea0b2-4445-42e3-a34b-3b3aa541523b admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:48.014572 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ea0b2-4445-42e3-a34b-3b3aa541523b admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:48.019186 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315124ca-0858-410e-9ce9-3590a7fc6de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:48.019827 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315124ca-0858-410e-9ce9-3590a7fc6de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:48.020106 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315124ca-0858-410e-9ce9-3590a7fc6de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:48.020379 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315124ca-0858-410e-9ce9-3590a7fc6de5 admin admin] PATH_INFO: `/v3/projects/516731b390e44192bcd3dde0ca498c5f/users/3d62dd7d51634e858ae097f0554e3aa6/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:48.034794 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315124ca-0858-410e-9ce9-3590a7fc6de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=516731b390e44192bcd3dde0ca498c5f, user_id=3d62dd7d51634e858ae097f0554e3aa6, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:48.037402 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315124ca-0858-410e-9ce9-3590a7fc6de5 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:48.050296 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1328/2664] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:53:48 2022] PUT /identity/v3/projects/516731b390e44192bcd3dde0ca498c5f/users/3d62dd7d51634e858ae097f0554e3aa6/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:48.054294 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823d0e3-c01a-4288-b8dd-6e4ed123f40c admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:48.064864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823d0e3-c01a-4288-b8dd-6e4ed123f40c admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:48.120855 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0736c-fcf8-41e9-abac-60423ca21e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:48.122085 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0736c-fcf8-41e9-abac-60423ca21e11 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:48.122359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0736c-fcf8-41e9-abac-60423ca21e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:48.122631 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0736c-fcf8-41e9-abac-60423ca21e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:48.123269 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0736c-fcf8-41e9-abac-60423ca21e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:48.124858 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0736c-fcf8-41e9-abac-60423ca21e11 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:48.134657 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1337/2665] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:53:48.139435 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315124ca-0858-410e-9ce9-3590a7fc6de5 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:48.149579 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315124ca-0858-410e-9ce9-3590a7fc6de5 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:48.154972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b21c9-bf31-489e-b2f1-18404579876b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:48.155749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b21c9-bf31-489e-b2f1-18404579876b admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:48.156030 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b21c9-bf31-489e-b2f1-18404579876b admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:48.156306 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b21c9-bf31-489e-b2f1-18404579876b admin admin] PATH_INFO: `/v3/projects/516731b390e44192bcd3dde0ca498c5f/users/3d62dd7d51634e858ae097f0554e3aa6/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:48.158300 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b21c9-bf31-489e-b2f1-18404579876b admin admin] RBAC: Authorizing `identity:create_grant(project_id=516731b390e44192bcd3dde0ca498c5f, user_id=3d62dd7d51634e858ae097f0554e3aa6, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:48.160904 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b21c9-bf31-489e-b2f1-18404579876b admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:48.171078 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1329/2666] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:53:48 2022] PUT /identity/v3/projects/516731b390e44192bcd3dde0ca498c5f/users/3d62dd7d51634e858ae097f0554e3aa6/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:48.181223 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5e5c3-d1da-4bde-a117-719fddcb0c9c None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:48.181749 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5e5c3-d1da-4bde-a117-719fddcb0c9c None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:48.181847 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5e5c3-d1da-4bde-a117-719fddcb0c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:48.190881 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:48.213865 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-1db5e5c3-d1da-4bde-a117-719fddcb0c9c None None] MFA Rules not processed for user `3d62dd7d51634e858ae097f0554e3aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:48.215453 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-1db5e5c3-d1da-4bde-a117-719fddcb0c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:48.290245 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1338/2667] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:53:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:48.301777 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b21c9-bf31-489e-b2f1-18404579876b admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:48.303540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-dd6b21c9-bf31-489e-b2f1-18404579876b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:48.361729 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b21c9-bf31-489e-b2f1-18404579876b admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:48.365397 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62cfa3-53da-44b7-ae70-7161a322fbc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:48.366027 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62cfa3-53da-44b7-ae70-7161a322fbc7 service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:48.366306 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62cfa3-53da-44b7-ae70-7161a322fbc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:48.366578 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62cfa3-53da-44b7-ae70-7161a322fbc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:48.376159 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62cfa3-53da-44b7-ae70-7161a322fbc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:48.377612 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62cfa3-53da-44b7-ae70-7161a322fbc7 service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:48.388076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1330/2668] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:48.460127 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5e5c3-d1da-4bde-a117-719fddcb0c9c None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:48.470142 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5e5c3-d1da-4bde-a117-719fddcb0c9c None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:48.473772 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880390e-c7c5-4802-bcee-db78b4530d3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:48.474375 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880390e-c7c5-4802-bcee-db78b4530d3e service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:48.474655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880390e-c7c5-4802-bcee-db78b4530d3e service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:48.474930 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880390e-c7c5-4802-bcee-db78b4530d3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:48.531410 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880390e-c7c5-4802-bcee-db78b4530d3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:48.532892 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880390e-c7c5-4802-bcee-db78b4530d3e service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:48.542021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1339/2669] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:48.807142 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62cfa3-53da-44b7-ae70-7161a322fbc7 service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:48.869858 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62cfa3-53da-44b7-ae70-7161a322fbc7 service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:48.875779 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4a63c-5cb2-4e64-921d-c898da9c3e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:48.876403 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4a63c-5cb2-4e64-921d-c898da9c3e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:48.876684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4a63c-5cb2-4e64-921d-c898da9c3e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:48.876959 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4a63c-5cb2-4e64-921d-c898da9c3e09 admin admin] PATH_INFO: `/v3/users/dcf54d269c854e6b9614591b535d1cc8` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:48.878096 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4a63c-5cb2-4e64-921d-c898da9c3e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcf54d269c854e6b9614591b535d1cc8)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:48.879998 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4a63c-5cb2-4e64-921d-c898da9c3e09 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:48.907802 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:48.935397 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-0ab4a63c-5cb2-4e64-921d-c898da9c3e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcf54d269c854e6b9614591b535d1cc8'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:48.936065 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-0ab4a63c-5cb2-4e64-921d-c898da9c3e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcf54d269c854e6b9614591b535d1cc8'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:48.936673 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-0ab4a63c-5cb2-4e64-921d-c898da9c3e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcf54d269c854e6b9614591b535d1cc8'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:48.948691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-0ab4a63c-5cb2-4e64-921d-c898da9c3e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcf54d269c854e6b9614591b535d1cc8'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:48.956054 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-0ab4a63c-5cb2-4e64-921d-c898da9c3e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcf54d269c854e6b9614591b535d1cc8'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:48.968382 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1331/2670] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:53:48 2022] DELETE /identity/v3/users/dcf54d269c854e6b9614591b535d1cc8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:48.972988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c8bea-be58-440f-aa87-278cd6841631 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:48.973213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c8bea-be58-440f-aa87-278cd6841631 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:48.973514 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c8bea-be58-440f-aa87-278cd6841631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:48.991961 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-095c8bea-be58-440f-aa87-278cd6841631 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:48.993149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-095c8bea-be58-440f-aa87-278cd6841631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:49.049417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1340/2671] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:49.059749 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4a63c-5cb2-4e64-921d-c898da9c3e09 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:49.061266 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-0ab4a63c-5cb2-4e64-921d-c898da9c3e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:49.117956 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4a63c-5cb2-4e64-921d-c898da9c3e09 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:49.122133 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d99e7-5910-49d0-87ad-2960b2c5580d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:49.122727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d99e7-5910-49d0-87ad-2960b2c5580d service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:49.123006 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d99e7-5910-49d0-87ad-2960b2c5580d service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:49.123280 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d99e7-5910-49d0-87ad-2960b2c5580d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:49.132298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d99e7-5910-49d0-87ad-2960b2c5580d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:49.133742 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d99e7-5910-49d0-87ad-2960b2c5580d service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:49.143137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1332/2672] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:49.423957 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c8bea-be58-440f-aa87-278cd6841631 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:49.426332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-095c8bea-be58-440f-aa87-278cd6841631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:49.443718 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c8bea-be58-440f-aa87-278cd6841631 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:49.448420 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b772ba6-3478-477f-be19-da034176ae69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:49.449050 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b772ba6-3478-477f-be19-da034176ae69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:49.449361 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b772ba6-3478-477f-be19-da034176ae69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:49.449879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b772ba6-3478-477f-be19-da034176ae69 admin admin] PATH_INFO: `/v3/projects/e0b5c56c463d4dc1a0ebad955e19add0` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:49.451240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b772ba6-3478-477f-be19-da034176ae69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0b5c56c463d4dc1a0ebad955e19add0)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:49.453137 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b772ba6-3478-477f-be19-da034176ae69 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:49.479823 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:49.502769 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0b772ba6-3478-477f-be19-da034176ae69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0b5c56c463d4dc1a0ebad955e19add0', 'request_id': 'req-0b772ba6-3478-477f-be19-da034176ae69'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:49.510031 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0b772ba6-3478-477f-be19-da034176ae69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0b5c56c463d4dc1a0ebad955e19add0', 'request_id': 'req-0b772ba6-3478-477f-be19-da034176ae69'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:49.516528 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0b772ba6-3478-477f-be19-da034176ae69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0b5c56c463d4dc1a0ebad955e19add0', 'request_id': 'req-0b772ba6-3478-477f-be19-da034176ae69'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:49.526553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0b772ba6-3478-477f-be19-da034176ae69 admin admin] The token cache is being invalidate because project e0b5c56c463d4dc1a0ebad955e19add0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:53:49.526839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0b772ba6-3478-477f-be19-da034176ae69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:49.528089 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0b772ba6-3478-477f-be19-da034176ae69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:49.529621 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1341/2673] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:53:49 2022] DELETE /identity/v3/projects/e0b5c56c463d4dc1a0ebad955e19add0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:49.533602 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d99e7-5910-49d0-87ad-2960b2c5580d service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:49.543653 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d99e7-5910-49d0-87ad-2960b2c5580d service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:49.599747 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90990a28-1e2f-4c7e-b382-3c0cf146daf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:49.600366 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90990a28-1e2f-4c7e-b382-3c0cf146daf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:49.600646 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90990a28-1e2f-4c7e-b382-3c0cf146daf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:49.600921 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90990a28-1e2f-4c7e-b382-3c0cf146daf7 admin admin] PATH_INFO: `/v3/users/3d62dd7d51634e858ae097f0554e3aa6` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:49.602057 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90990a28-1e2f-4c7e-b382-3c0cf146daf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d62dd7d51634e858ae097f0554e3aa6)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:49.603954 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90990a28-1e2f-4c7e-b382-3c0cf146daf7 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:49.651703 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-90990a28-1e2f-4c7e-b382-3c0cf146daf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d62dd7d51634e858ae097f0554e3aa6'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:49.652903 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-90990a28-1e2f-4c7e-b382-3c0cf146daf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d62dd7d51634e858ae097f0554e3aa6'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:49.654319 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-90990a28-1e2f-4c7e-b382-3c0cf146daf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d62dd7d51634e858ae097f0554e3aa6'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:49.655623 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:49.669488 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-90990a28-1e2f-4c7e-b382-3c0cf146daf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d62dd7d51634e858ae097f0554e3aa6'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:49.677613 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-90990a28-1e2f-4c7e-b382-3c0cf146daf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d62dd7d51634e858ae097f0554e3aa6'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:49.690199 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1333/2674] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:53:49 2022] DELETE /identity/v3/users/3d62dd7d51634e858ae097f0554e3aa6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:49.962992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b772ba6-3478-477f-be19-da034176ae69 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:49.964749 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-0b772ba6-3478-477f-be19-da034176ae69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:49.982295 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b772ba6-3478-477f-be19-da034176ae69 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:50.039460 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05408e-88de-4668-9e5a-f6008bd5f9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:50.040007 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05408e-88de-4668-9e5a-f6008bd5f9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:50.040285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05408e-88de-4668-9e5a-f6008bd5f9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:50.040562 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05408e-88de-4668-9e5a-f6008bd5f9b4 admin admin] PATH_INFO: `/v3/projects/516731b390e44192bcd3dde0ca498c5f` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:50.041714 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05408e-88de-4668-9e5a-f6008bd5f9b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=516731b390e44192bcd3dde0ca498c5f)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:50.044124 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05408e-88de-4668-9e5a-f6008bd5f9b4 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:50.089982 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-cc05408e-88de-4668-9e5a-f6008bd5f9b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '516731b390e44192bcd3dde0ca498c5f', 'request_id': 'req-cc05408e-88de-4668-9e5a-f6008bd5f9b4'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:50.096886 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-cc05408e-88de-4668-9e5a-f6008bd5f9b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '516731b390e44192bcd3dde0ca498c5f', 'request_id': 'req-cc05408e-88de-4668-9e5a-f6008bd5f9b4'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:50.103031 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-cc05408e-88de-4668-9e5a-f6008bd5f9b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '516731b390e44192bcd3dde0ca498c5f', 'request_id': 'req-cc05408e-88de-4668-9e5a-f6008bd5f9b4'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:50.113822 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-cc05408e-88de-4668-9e5a-f6008bd5f9b4 admin admin] The token cache is being invalidate because project 516731b390e44192bcd3dde0ca498c5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:53:50.114114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-cc05408e-88de-4668-9e5a-f6008bd5f9b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:50.114760 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-cc05408e-88de-4668-9e5a-f6008bd5f9b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:53:50.116229 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1342/2675] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:53:49 2022] DELETE /identity/v3/projects/516731b390e44192bcd3dde0ca498c5f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:53:50.121919 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47a901-0667-4365-8efe-d898571e27c5 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:50.122243 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47a901-0667-4365-8efe-d898571e27c5 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:50.122520 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47a901-0667-4365-8efe-d898571e27c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:50.142256 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-da47a901-0667-4365-8efe-d898571e27c5 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:50.143459 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-da47a901-0667-4365-8efe-d898571e27c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:50.202077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1334/2676] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:53:50.209852 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb69bd-20d1-4ce2-a9ea-c80c5dbdf3ad None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:50.210140 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb69bd-20d1-4ce2-a9ea-c80c5dbdf3ad None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:50.210419 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb69bd-20d1-4ce2-a9ea-c80c5dbdf3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:50.231240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-1bdb69bd-20d1-4ce2-a9ea-c80c5dbdf3ad None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:50.232490 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-1bdb69bd-20d1-4ce2-a9ea-c80c5dbdf3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:50.240579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1343/2677] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:50.244854 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47a901-0667-4365-8efe-d898571e27c5 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:50.255213 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47a901-0667-4365-8efe-d898571e27c5 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:50.259783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd4bd6-c6bb-4aa3-8195-f1224f499c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:50.260378 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd4bd6-c6bb-4aa3-8195-f1224f499c43 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:50.260659 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd4bd6-c6bb-4aa3-8195-f1224f499c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:50.260934 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd4bd6-c6bb-4aa3-8195-f1224f499c43 admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:50.261614 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd4bd6-c6bb-4aa3-8195-f1224f499c43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:53:50.262499 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd4bd6-c6bb-4aa3-8195-f1224f499c43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:50.264071 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd4bd6-c6bb-4aa3-8195-f1224f499c43 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:50.275489 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1335/2678] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:53:50.279894 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb69bd-20d1-4ce2-a9ea-c80c5dbdf3ad None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:50.289137 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb69bd-20d1-4ce2-a9ea-c80c5dbdf3ad None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:50.294030 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f21cb3-57f9-43e3-8c11-83f8b4329a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:50.294557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f21cb3-57f9-43e3-8c11-83f8b4329a9e admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:50.294836 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f21cb3-57f9-43e3-8c11-83f8b4329a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:50.295107 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f21cb3-57f9-43e3-8c11-83f8b4329a9e admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:50.295730 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f21cb3-57f9-43e3-8c11-83f8b4329a9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:50.297698 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f21cb3-57f9-43e3-8c11-83f8b4329a9e admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:50.325479 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1344/2679] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:53:50 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:53:50.329646 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd4bd6-c6bb-4aa3-8195-f1224f499c43 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:50.339942 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd4bd6-c6bb-4aa3-8195-f1224f499c43 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:50.397829 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4e1cb-b3a5-4a1a-9495-44cfd17f79d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:50.398433 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4e1cb-b3a5-4a1a-9495-44cfd17f79d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:50.398731 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4e1cb-b3a5-4a1a-9495-44cfd17f79d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:50.398987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4e1cb-b3a5-4a1a-9495-44cfd17f79d8 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:50.399624 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4e1cb-b3a5-4a1a-9495-44cfd17f79d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:50.401592 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4e1cb-b3a5-4a1a-9495-44cfd17f79d8 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:50.422232 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1336/2680] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:53:50 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:53:50.426367 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f21cb3-57f9-43e3-8c11-83f8b4329a9e admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:50.438054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f21cb3-57f9-43e3-8c11-83f8b4329a9e admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:50.442640 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66820176-622c-4c7c-aff7-9e38648d66f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:50.443233 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66820176-622c-4c7c-aff7-9e38648d66f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:50.443511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66820176-622c-4c7c-aff7-9e38648d66f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:50.443783 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66820176-622c-4c7c-aff7-9e38648d66f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:50.444427 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66820176-622c-4c7c-aff7-9e38648d66f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:50.446249 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66820176-622c-4c7c-aff7-9e38648d66f7 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:50.456844 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1345/2681] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:53:50.460904 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4e1cb-b3a5-4a1a-9495-44cfd17f79d8 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:50.471305 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4e1cb-b3a5-4a1a-9495-44cfd17f79d8 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:50.475958 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de7ccf-dce5-47a8-9417-649ee5bf02a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:50.476546 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de7ccf-dce5-47a8-9417-649ee5bf02a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:50.476830 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de7ccf-dce5-47a8-9417-649ee5bf02a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:50.477106 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de7ccf-dce5-47a8-9417-649ee5bf02a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:50.477779 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de7ccf-dce5-47a8-9417-649ee5bf02a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:50.479348 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de7ccf-dce5-47a8-9417-649ee5bf02a5 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:50.490099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1337/2682] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:53:50.494264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66820176-622c-4c7c-aff7-9e38648d66f7 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:50.500293 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:50.506859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66820176-622c-4c7c-aff7-9e38648d66f7 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:50.513182 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe2f63-ddeb-45d5-9a13-6b47da92c512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:50.513864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe2f63-ddeb-45d5-9a13-6b47da92c512 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:50.514138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe2f63-ddeb-45d5-9a13-6b47da92c512 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:50.514409 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe2f63-ddeb-45d5-9a13-6b47da92c512 admin admin] PATH_INFO: `/v3/projects/15520478acd84c568c7b1cfa256b2746/users/c3beccc76efe43eca8a88506ac6ddbca/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:50.530098 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe2f63-ddeb-45d5-9a13-6b47da92c512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15520478acd84c568c7b1cfa256b2746, user_id=c3beccc76efe43eca8a88506ac6ddbca, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:50.532699 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe2f63-ddeb-45d5-9a13-6b47da92c512 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:50.545582 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1346/2683] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:53:50 2022] PUT /identity/v3/projects/15520478acd84c568c7b1cfa256b2746/users/c3beccc76efe43eca8a88506ac6ddbca/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:53:50.555863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83807b-ef6c-40d6-a48d-7c6a9f84955f None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:50.556325 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83807b-ef6c-40d6-a48d-7c6a9f84955f None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:50.556440 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83807b-ef6c-40d6-a48d-7c6a9f84955f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:50.583843 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-3c83807b-ef6c-40d6-a48d-7c6a9f84955f None None] MFA Rules not processed for user `c3beccc76efe43eca8a88506ac6ddbca`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:53:50.585058 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-3c83807b-ef6c-40d6-a48d-7c6a9f84955f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:50.603792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:50.653121 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1338/2684] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:53:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:53:50.664519 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe2f63-ddeb-45d5-9a13-6b47da92c512 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:50.666249 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-b6fe2f63-ddeb-45d5-9a13-6b47da92c512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:50.722651 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe2f63-ddeb-45d5-9a13-6b47da92c512 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:50.726271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ace34-0c35-4a44-b6fe-c0840a748a7c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51fe6dfa43d04cdeb0421d2613c8c2ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:50.726872 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ace34-0c35-4a44-b6fe-c0840a748a7c service glance] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:50.727151 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ace34-0c35-4a44-b6fe-c0840a748a7c service glance] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:50.727427 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ace34-0c35-4a44-b6fe-c0840a748a7c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:50.736199 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ace34-0c35-4a44-b6fe-c0840a748a7c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:50.737653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ace34-0c35-4a44-b6fe-c0840a748a7c service glance] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:50.747052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1347/2685] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:53:59.464171 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83807b-ef6c-40d6-a48d-7c6a9f84955f None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:53:59.465635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-3c83807b-ef6c-40d6-a48d-7c6a9f84955f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:59.537074 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83807b-ef6c-40d6-a48d-7c6a9f84955f None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:53:59.541987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876ae39-afae-4d86-8755-4358d3ac5bc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983e364f5564ed7854dff06a80f55d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:53:59.542701 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876ae39-afae-4d86-8755-4358d3ac5bc6 service placement] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:53:59.542879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876ae39-afae-4d86-8755-4358d3ac5bc6 service placement] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:53:59.543152 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876ae39-afae-4d86-8755-4358d3ac5bc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:53:59.544895 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-9876ae39-afae-4d86-8755-4358d3ac5bc6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:53:59.556514 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876ae39-afae-4d86-8755-4358d3ac5bc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:53:59.558695 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876ae39-afae-4d86-8755-4358d3ac5bc6 service placement] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:53:59.569621 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1339/2686] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:53:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:00.742532 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=35,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:09.418203 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ace34-0c35-4a44-b6fe-c0840a748a7c service glance] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:09.486684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ace34-0c35-4a44-b6fe-c0840a748a7c service glance] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:09.491359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b9193-b373-4815-8a20-d1140cc2e242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:09.491997 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9193-b373-4815-8a20-d1140cc2e242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:09.492281 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9193-b373-4815-8a20-d1140cc2e242 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:09.492560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b9193-b373-4815-8a20-d1140cc2e242 admin admin] PATH_INFO: `/v3/users/c3beccc76efe43eca8a88506ac6ddbca` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:09.493737 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b9193-b373-4815-8a20-d1140cc2e242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3beccc76efe43eca8a88506ac6ddbca)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:09.496102 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b9193-b373-4815-8a20-d1140cc2e242 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:09.545240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-574b9193-b373-4815-8a20-d1140cc2e242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3beccc76efe43eca8a88506ac6ddbca'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:09.546191 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-574b9193-b373-4815-8a20-d1140cc2e242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3beccc76efe43eca8a88506ac6ddbca'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:09.559679 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-574b9193-b373-4815-8a20-d1140cc2e242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3beccc76efe43eca8a88506ac6ddbca'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:09.564787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=50 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:09.567116 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-574b9193-b373-4815-8a20-d1140cc2e242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3beccc76efe43eca8a88506ac6ddbca'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:09.574660 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-574b9193-b373-4815-8a20-d1140cc2e242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3beccc76efe43eca8a88506ac6ddbca'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:09.580579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1348/2687] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:54:09 2022] DELETE /identity/v3/users/c3beccc76efe43eca8a88506ac6ddbca => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:54:09.585123 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac1cb2-a08e-46ba-b191-7c6b8204ea8a None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:09.585403 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac1cb2-a08e-46ba-b191-7c6b8204ea8a None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:09.585713 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac1cb2-a08e-46ba-b191-7c6b8204ea8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:09.605620 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-74ac1cb2-a08e-46ba-b191-7c6b8204ea8a None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:09.606867 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-74ac1cb2-a08e-46ba-b191-7c6b8204ea8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:09.665562 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1340/2688] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:09.675646 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b9193-b373-4815-8a20-d1140cc2e242 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:09.677113 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-574b9193-b373-4815-8a20-d1140cc2e242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:09.734564 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b9193-b373-4815-8a20-d1140cc2e242 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:09.738365 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85910e-76eb-4340-9558-ef04310b38d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:09.738968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85910e-76eb-4340-9558-ef04310b38d9 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:09.739245 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85910e-76eb-4340-9558-ef04310b38d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:09.739517 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85910e-76eb-4340-9558-ef04310b38d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:09.749053 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85910e-76eb-4340-9558-ef04310b38d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:09.750504 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85910e-76eb-4340-9558-ef04310b38d9 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:09.759851 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1349/2689] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:10.028918 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac1cb2-a08e-46ba-b191-7c6b8204ea8a None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:10.030391 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-74ac1cb2-a08e-46ba-b191-7c6b8204ea8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:10.043684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac1cb2-a08e-46ba-b191-7c6b8204ea8a None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:10.048539 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da4fe0-3d1e-42c6-b3ef-09aad49afa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:10.049731 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da4fe0-3d1e-42c6-b3ef-09aad49afa8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:10.050007 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da4fe0-3d1e-42c6-b3ef-09aad49afa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:10.050278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da4fe0-3d1e-42c6-b3ef-09aad49afa8e admin admin] PATH_INFO: `/v3/projects/15520478acd84c568c7b1cfa256b2746` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:10.051510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da4fe0-3d1e-42c6-b3ef-09aad49afa8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=15520478acd84c568c7b1cfa256b2746)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:10.053262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da4fe0-3d1e-42c6-b3ef-09aad49afa8e admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:10.101102 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a5da4fe0-3d1e-42c6-b3ef-09aad49afa8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15520478acd84c568c7b1cfa256b2746', 'request_id': 'req-a5da4fe0-3d1e-42c6-b3ef-09aad49afa8e'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:10.109210 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a5da4fe0-3d1e-42c6-b3ef-09aad49afa8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15520478acd84c568c7b1cfa256b2746', 'request_id': 'req-a5da4fe0-3d1e-42c6-b3ef-09aad49afa8e'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:10.120956 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a5da4fe0-3d1e-42c6-b3ef-09aad49afa8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15520478acd84c568c7b1cfa256b2746', 'request_id': 'req-a5da4fe0-3d1e-42c6-b3ef-09aad49afa8e'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:10.131613 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a5da4fe0-3d1e-42c6-b3ef-09aad49afa8e admin admin] The token cache is being invalidate because project 15520478acd84c568c7b1cfa256b2746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:54:10.132003 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a5da4fe0-3d1e-42c6-b3ef-09aad49afa8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:10.132654 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a5da4fe0-3d1e-42c6-b3ef-09aad49afa8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:10.134183 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1341/2690] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:54:10 2022] DELETE /identity/v3/projects/15520478acd84c568c7b1cfa256b2746 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:54:10.140324 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95507f-d239-4663-bbcf-af480b3c873f None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:10.140613 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95507f-d239-4663-bbcf-af480b3c873f None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:10.140891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95507f-d239-4663-bbcf-af480b3c873f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:10.160695 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-1d95507f-d239-4663-bbcf-af480b3c873f None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:10.162186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-1d95507f-d239-4663-bbcf-af480b3c873f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:10.178913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:10.224414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1350/2691] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:10.233067 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902f9d0-f36e-4954-8f9f-f0a784242f9f None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:10.233357 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902f9d0-f36e-4954-8f9f-f0a784242f9f None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:10.233669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902f9d0-f36e-4954-8f9f-f0a784242f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:10.254074 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-3902f9d0-f36e-4954-8f9f-f0a784242f9f None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:10.255300 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-3902f9d0-f36e-4954-8f9f-f0a784242f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:10.263885 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1342/2692] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:10.268141 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95507f-d239-4663-bbcf-af480b3c873f None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:10.278673 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95507f-d239-4663-bbcf-af480b3c873f None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:10.283219 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb625cc-49d1-4dca-8419-59655b6dec0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:10.283808 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb625cc-49d1-4dca-8419-59655b6dec0f admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:10.284084 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb625cc-49d1-4dca-8419-59655b6dec0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:10.284351 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb625cc-49d1-4dca-8419-59655b6dec0f admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:10.284987 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb625cc-49d1-4dca-8419-59655b6dec0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:54:10.285286 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb625cc-49d1-4dca-8419-59655b6dec0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:10.286884 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb625cc-49d1-4dca-8419-59655b6dec0f admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:10.298209 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1351/2693] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:54:10.302386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902f9d0-f36e-4954-8f9f-f0a784242f9f None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:10.311647 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902f9d0-f36e-4954-8f9f-f0a784242f9f None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:10.316196 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41d512-937f-4048-90d6-0ef444125c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:10.316779 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41d512-937f-4048-90d6-0ef444125c29 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:10.317050 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41d512-937f-4048-90d6-0ef444125c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:10.317317 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41d512-937f-4048-90d6-0ef444125c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:10.317972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41d512-937f-4048-90d6-0ef444125c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:10.319822 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41d512-937f-4048-90d6-0ef444125c29 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:10.357625 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1343/2694] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:54:10 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:54:10.361934 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb625cc-49d1-4dca-8419-59655b6dec0f admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:10.372837 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb625cc-49d1-4dca-8419-59655b6dec0f admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:10.432608 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883770c-84b9-4422-88ca-f94d1d61bcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:10.433265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883770c-84b9-4422-88ca-f94d1d61bcd0 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:10.433586 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883770c-84b9-4422-88ca-f94d1d61bcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:10.433866 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883770c-84b9-4422-88ca-f94d1d61bcd0 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:10.434502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883770c-84b9-4422-88ca-f94d1d61bcd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:10.436406 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883770c-84b9-4422-88ca-f94d1d61bcd0 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:10.450034 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41d512-937f-4048-90d6-0ef444125c29 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:10.451754 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-6b41d512-937f-4048-90d6-0ef444125c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:10.464974 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1352/2695] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:54:10 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:54:10.466167 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883770c-84b9-4422-88ca-f94d1d61bcd0 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:10.476225 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883770c-84b9-4422-88ca-f94d1d61bcd0 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:10.481180 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055a465-f921-41c1-9300-53110ed58e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:10.481876 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055a465-f921-41c1-9300-53110ed58e32 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:10.482161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055a465-f921-41c1-9300-53110ed58e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:10.482433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055a465-f921-41c1-9300-53110ed58e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:10.483060 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055a465-f921-41c1-9300-53110ed58e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:10.484642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055a465-f921-41c1-9300-53110ed58e32 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:10.496157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1353/2696] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:54:10.500015 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055a465-f921-41c1-9300-53110ed58e32 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:10.510641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055a465-f921-41c1-9300-53110ed58e32 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:10.514774 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41d512-937f-4048-90d6-0ef444125c29 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:10.515400 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e71e7a-8dc1-4368-b987-156c1d9c5d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:10.515985 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e71e7a-8dc1-4368-b987-156c1d9c5d29 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:10.516263 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e71e7a-8dc1-4368-b987-156c1d9c5d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:10.516537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e71e7a-8dc1-4368-b987-156c1d9c5d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:10.517165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e71e7a-8dc1-4368-b987-156c1d9c5d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:10.518523 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597d05d-c67f-4e9d-8c13-b2a2ba806f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:10.518759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e71e7a-8dc1-4368-b987-156c1d9c5d29 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:10.519135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597d05d-c67f-4e9d-8c13-b2a2ba806f24 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:10.519424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597d05d-c67f-4e9d-8c13-b2a2ba806f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:10.519682 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597d05d-c67f-4e9d-8c13-b2a2ba806f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:10.521479 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e597d05d-c67f-4e9d-8c13-b2a2ba806f24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:10.529078 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1354/2697] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:54:10.533087 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e71e7a-8dc1-4368-b987-156c1d9c5d29 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:10.542371 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597d05d-c67f-4e9d-8c13-b2a2ba806f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:10.544011 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597d05d-c67f-4e9d-8c13-b2a2ba806f24 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:10.545299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e71e7a-8dc1-4368-b987-156c1d9c5d29 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:10.548689 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:10.550830 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93badc00-3015-49ec-9e05-f96976b457b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:10.551659 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93badc00-3015-49ec-9e05-f96976b457b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:10.551958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93badc00-3015-49ec-9e05-f96976b457b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:10.552216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93badc00-3015-49ec-9e05-f96976b457b1 admin admin] PATH_INFO: `/v3/projects/444c8a8e2be741e7850559433a5ea33a/users/94ebd24a294849d6abd747293af67c50/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:10.556335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1344/2698] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:54:10.570454 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93badc00-3015-49ec-9e05-f96976b457b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=444c8a8e2be741e7850559433a5ea33a, user_id=94ebd24a294849d6abd747293af67c50, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:10.573419 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93badc00-3015-49ec-9e05-f96976b457b1 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:10.586710 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1355/2699] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:54:10 2022] PUT /identity/v3/projects/444c8a8e2be741e7850559433a5ea33a/users/94ebd24a294849d6abd747293af67c50/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:54:10.597949 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ea705-a43e-4298-a6f4-7e467e2043db None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:10.598445 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ea705-a43e-4298-a6f4-7e467e2043db None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:10.600646 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ea705-a43e-4298-a6f4-7e467e2043db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:10.630505 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-4f9ea705-a43e-4298-a6f4-7e467e2043db None None] MFA Rules not processed for user `94ebd24a294849d6abd747293af67c50`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:10.631760 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-4f9ea705-a43e-4298-a6f4-7e467e2043db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:10.697568 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1345/2700] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:54:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:10.708909 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93badc00-3015-49ec-9e05-f96976b457b1 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:10.710735 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-93badc00-3015-49ec-9e05-f96976b457b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:10.770466 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93badc00-3015-49ec-9e05-f96976b457b1 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:10.774053 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874ac84-b35f-4ca2-94d0-63a7c44cd86f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:10.774659 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874ac84-b35f-4ca2-94d0-63a7c44cd86f service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:10.774937 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874ac84-b35f-4ca2-94d0-63a7c44cd86f service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:10.775208 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874ac84-b35f-4ca2-94d0-63a7c44cd86f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:10.782866 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:10.785649 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874ac84-b35f-4ca2-94d0-63a7c44cd86f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:10.788433 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874ac84-b35f-4ca2-94d0-63a7c44cd86f service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:10.799426 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1356/2701] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:13.413341 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ea705-a43e-4298-a6f4-7e467e2043db None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:13.477516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ea705-a43e-4298-a6f4-7e467e2043db None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:13.482596 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1942fbb-d674-4a5b-b14b-9ee793d94537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:13.483219 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1942fbb-d674-4a5b-b14b-9ee793d94537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:13.483496 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1942fbb-d674-4a5b-b14b-9ee793d94537 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:13.483774 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1942fbb-d674-4a5b-b14b-9ee793d94537 admin admin] PATH_INFO: `/v3/users/94ebd24a294849d6abd747293af67c50` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:13.484889 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1942fbb-d674-4a5b-b14b-9ee793d94537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94ebd24a294849d6abd747293af67c50)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:13.486832 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1942fbb-d674-4a5b-b14b-9ee793d94537 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:13.562236 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a1942fbb-d674-4a5b-b14b-9ee793d94537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94ebd24a294849d6abd747293af67c50'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:13.563120 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a1942fbb-d674-4a5b-b14b-9ee793d94537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94ebd24a294849d6abd747293af67c50'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:13.563742 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a1942fbb-d674-4a5b-b14b-9ee793d94537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94ebd24a294849d6abd747293af67c50'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:13.590696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a1942fbb-d674-4a5b-b14b-9ee793d94537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94ebd24a294849d6abd747293af67c50'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:13.600801 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a1942fbb-d674-4a5b-b14b-9ee793d94537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94ebd24a294849d6abd747293af67c50'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:13.616718 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1346/2702] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:54:13 2022] DELETE /identity/v3/users/94ebd24a294849d6abd747293af67c50 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:54:13.621078 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429702c1-00a9-45f7-a0ac-e2f7247a2674 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:13.621617 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429702c1-00a9-45f7-a0ac-e2f7247a2674 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:13.621728 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429702c1-00a9-45f7-a0ac-e2f7247a2674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:13.649613 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-429702c1-00a9-45f7-a0ac-e2f7247a2674 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:13.651103 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-429702c1-00a9-45f7-a0ac-e2f7247a2674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:13.727072 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1357/2703] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:13.739412 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1942fbb-d674-4a5b-b14b-9ee793d94537 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:13.741027 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-a1942fbb-d674-4a5b-b14b-9ee793d94537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:13.752206 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:13.833924 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1942fbb-d674-4a5b-b14b-9ee793d94537 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:13.837712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50609c-b42c-4615-9d85-7d11ba2b6c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:13.838572 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50609c-b42c-4615-9d85-7d11ba2b6c9d service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:13.839559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50609c-b42c-4615-9d85-7d11ba2b6c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:13.839833 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50609c-b42c-4615-9d85-7d11ba2b6c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:13.850146 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50609c-b42c-4615-9d85-7d11ba2b6c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:13.851578 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50609c-b42c-4615-9d85-7d11ba2b6c9d service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:13.865162 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1347/2704] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:13.880891 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429702c1-00a9-45f7-a0ac-e2f7247a2674 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:13.883024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-429702c1-00a9-45f7-a0ac-e2f7247a2674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:13.899298 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429702c1-00a9-45f7-a0ac-e2f7247a2674 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:13.905765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a798c-c7ea-4b79-9ee8-451b5f29c977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:13.906422 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a798c-c7ea-4b79-9ee8-451b5f29c977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:13.906702 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a798c-c7ea-4b79-9ee8-451b5f29c977 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:13.906975 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a798c-c7ea-4b79-9ee8-451b5f29c977 admin admin] PATH_INFO: `/v3/users/6a42998888a34c099624c08e64013a13` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:13.908166 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a798c-c7ea-4b79-9ee8-451b5f29c977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a42998888a34c099624c08e64013a13)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:13.913939 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a798c-c7ea-4b79-9ee8-451b5f29c977 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:13.981668 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-698a798c-c7ea-4b79-9ee8-451b5f29c977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a42998888a34c099624c08e64013a13'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:13.982519 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-698a798c-c7ea-4b79-9ee8-451b5f29c977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a42998888a34c099624c08e64013a13'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:13.995759 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-698a798c-c7ea-4b79-9ee8-451b5f29c977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a42998888a34c099624c08e64013a13'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:14.005823 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-698a798c-c7ea-4b79-9ee8-451b5f29c977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a42998888a34c099624c08e64013a13'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:14.013984 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-698a798c-c7ea-4b79-9ee8-451b5f29c977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a42998888a34c099624c08e64013a13'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:14.020404 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1358/2705] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:54:13 2022] DELETE /identity/v3/users/6a42998888a34c099624c08e64013a13 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:54:14.170594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50609c-b42c-4615-9d85-7d11ba2b6c9d service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:14.172430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ca50609c-b42c-4615-9d85-7d11ba2b6c9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:14.197605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50609c-b42c-4615-9d85-7d11ba2b6c9d service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:14.209817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a798c-c7ea-4b79-9ee8-451b5f29c977 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:14.211538 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-698a798c-c7ea-4b79-9ee8-451b5f29c977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:14.266212 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f0869-b413-4822-a834-115ac4f7f54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:14.266595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f0869-b413-4822-a834-115ac4f7f54d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:14.266879 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f0869-b413-4822-a834-115ac4f7f54d admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:14.267156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f0869-b413-4822-a834-115ac4f7f54d admin admin] PATH_INFO: `/v3/projects/444c8a8e2be741e7850559433a5ea33a` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:14.268338 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f0869-b413-4822-a834-115ac4f7f54d admin admin] RBAC: Authorizing `identity:delete_project(project_id=444c8a8e2be741e7850559433a5ea33a)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:14.270276 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f0869-b413-4822-a834-115ac4f7f54d admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:14.294983 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a798c-c7ea-4b79-9ee8-451b5f29c977 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:14.306425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c641322-b3fd-491f-a5ca-bdbeced35757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:14.307101 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c641322-b3fd-491f-a5ca-bdbeced35757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:14.307380 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c641322-b3fd-491f-a5ca-bdbeced35757 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:14.308437 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c641322-b3fd-491f-a5ca-bdbeced35757 admin admin] PATH_INFO: `/v3/projects/c53ab7bed5a748e8be861f370e5693f4` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:14.309618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c641322-b3fd-491f-a5ca-bdbeced35757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c53ab7bed5a748e8be861f370e5693f4)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:14.311557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c641322-b3fd-491f-a5ca-bdbeced35757 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:14.321095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-de8f0869-b413-4822-a834-115ac4f7f54d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '444c8a8e2be741e7850559433a5ea33a', 'request_id': 'req-de8f0869-b413-4822-a834-115ac4f7f54d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:14.322939 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:14.329525 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-de8f0869-b413-4822-a834-115ac4f7f54d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '444c8a8e2be741e7850559433a5ea33a', 'request_id': 'req-de8f0869-b413-4822-a834-115ac4f7f54d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:14.336496 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-de8f0869-b413-4822-a834-115ac4f7f54d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '444c8a8e2be741e7850559433a5ea33a', 'request_id': 'req-de8f0869-b413-4822-a834-115ac4f7f54d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:14.349320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-de8f0869-b413-4822-a834-115ac4f7f54d admin admin] The token cache is being invalidate because project 444c8a8e2be741e7850559433a5ea33a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:54:14.349643 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-de8f0869-b413-4822-a834-115ac4f7f54d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:14.350278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-de8f0869-b413-4822-a834-115ac4f7f54d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:14.351771 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1348/2706] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:54:14 2022] DELETE /identity/v3/projects/444c8a8e2be741e7850559433a5ea33a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:54:14.356574 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd568cb-c554-473c-b97f-6e7863f44cf2 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:14.356858 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd568cb-c554-473c-b97f-6e7863f44cf2 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:14.357133 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd568cb-c554-473c-b97f-6e7863f44cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:14.373762 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-6c641322-b3fd-491f-a5ca-bdbeced35757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c53ab7bed5a748e8be861f370e5693f4', 'request_id': 'req-6c641322-b3fd-491f-a5ca-bdbeced35757'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:14.377876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-9dd568cb-c554-473c-b97f-6e7863f44cf2 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:14.379361 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-9dd568cb-c554-473c-b97f-6e7863f44cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:14.381647 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-6c641322-b3fd-491f-a5ca-bdbeced35757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c53ab7bed5a748e8be861f370e5693f4', 'request_id': 'req-6c641322-b3fd-491f-a5ca-bdbeced35757'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:14.388687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-6c641322-b3fd-491f-a5ca-bdbeced35757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c53ab7bed5a748e8be861f370e5693f4', 'request_id': 'req-6c641322-b3fd-491f-a5ca-bdbeced35757'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:14.399441 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-6c641322-b3fd-491f-a5ca-bdbeced35757 admin admin] The token cache is being invalidate because project c53ab7bed5a748e8be861f370e5693f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:54:14.399735 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-6c641322-b3fd-491f-a5ca-bdbeced35757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:14.400395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-6c641322-b3fd-491f-a5ca-bdbeced35757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:14.402195 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1359/2707] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:54:14 2022] DELETE /identity/v3/projects/c53ab7bed5a748e8be861f370e5693f4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:54:14.406809 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b09bcd-d4f7-4c38-bad6-bc86fa923c70 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:14.407092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b09bcd-d4f7-4c38-bad6-bc86fa923c70 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:14.407362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b09bcd-d4f7-4c38-bad6-bc86fa923c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:14.415508 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:14.427041 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-e9b09bcd-d4f7-4c38-bad6-bc86fa923c70 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:14.428411 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-e9b09bcd-d4f7-4c38-bad6-bc86fa923c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:14.443257 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1349/2708] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:54:14.452160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2504c11-37e5-4b26-9431-26b6929429f5 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:14.452451 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2504c11-37e5-4b26-9431-26b6929429f5 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:14.452733 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2504c11-37e5-4b26-9431-26b6929429f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:14.472037 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-b2504c11-37e5-4b26-9431-26b6929429f5 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:14.473252 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b2504c11-37e5-4b26-9431-26b6929429f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:14.481329 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1350/2709] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:54:14.485517 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2504c11-37e5-4b26-9431-26b6929429f5 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:14.492187 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1360/2710] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:54:14.494549 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2504c11-37e5-4b26-9431-26b6929429f5 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:14.499788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a91a89-9d9b-4eee-a750-7193726a1add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:14.500373 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a91a89-9d9b-4eee-a750-7193726a1add admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:14.500514 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e2909-4537-4051-94f1-463e9bc41cff None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:14.500716 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a91a89-9d9b-4eee-a750-7193726a1add admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:14.500854 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e2909-4537-4051-94f1-463e9bc41cff None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:14.500977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a91a89-9d9b-4eee-a750-7193726a1add admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:14.501083 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e2909-4537-4051-94f1-463e9bc41cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:14.501719 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a91a89-9d9b-4eee-a750-7193726a1add admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:54:14.502041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a91a89-9d9b-4eee-a750-7193726a1add admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:14.503588 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a91a89-9d9b-4eee-a750-7193726a1add admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:14.516234 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1351/2711] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:54:14.520550 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a91a89-9d9b-4eee-a750-7193726a1add admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:14.522498 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-771e2909-4537-4051-94f1-463e9bc41cff None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:14.523712 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-771e2909-4537-4051-94f1-463e9bc41cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:14.530920 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a91a89-9d9b-4eee-a750-7193726a1add admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:14.532025 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1361/2712] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:54:14.535466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29b204-9bff-40ff-bde6-4a2b0d5e1283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:14.536045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29b204-9bff-40ff-bde6-4a2b0d5e1283 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:14.536156 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e2909-4537-4051-94f1-463e9bc41cff None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:14.536320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29b204-9bff-40ff-bde6-4a2b0d5e1283 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:14.536589 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29b204-9bff-40ff-bde6-4a2b0d5e1283 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:14.537198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29b204-9bff-40ff-bde6-4a2b0d5e1283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:14.539086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29b204-9bff-40ff-bde6-4a2b0d5e1283 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:14.545508 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e2909-4537-4051-94f1-463e9bc41cff None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:14.550122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8030f84-0b63-4cf6-bca6-18e4a8dfa78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:14.550711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8030f84-0b63-4cf6-bca6-18e4a8dfa78e admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:14.550986 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8030f84-0b63-4cf6-bca6-18e4a8dfa78e admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:14.551261 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8030f84-0b63-4cf6-bca6-18e4a8dfa78e admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:14.551898 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8030f84-0b63-4cf6-bca6-18e4a8dfa78e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:54:14.552209 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8030f84-0b63-4cf6-bca6-18e4a8dfa78e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:14.553817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8030f84-0b63-4cf6-bca6-18e4a8dfa78e admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:14.567422 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1362/2713] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:54:14.569852 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1352/2714] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:54:14 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:54:14.572098 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8030f84-0b63-4cf6-bca6-18e4a8dfa78e admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:14.573877 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29b204-9bff-40ff-bde6-4a2b0d5e1283 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:14.582502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8030f84-0b63-4cf6-bca6-18e4a8dfa78e admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:14.637650 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29b204-9bff-40ff-bde6-4a2b0d5e1283 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:14.640256 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123aa73-0800-4242-b689-327b0ca49945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:14.640855 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123aa73-0800-4242-b689-327b0ca49945 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:14.641134 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123aa73-0800-4242-b689-327b0ca49945 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:14.641399 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123aa73-0800-4242-b689-327b0ca49945 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:14.642043 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123aa73-0800-4242-b689-327b0ca49945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:14.642668 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d98c5-a62b-47ad-8948-b04d1d862608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:14.643281 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d98c5-a62b-47ad-8948-b04d1d862608 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:14.643567 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d98c5-a62b-47ad-8948-b04d1d862608 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:14.643872 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d98c5-a62b-47ad-8948-b04d1d862608 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:14.643971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123aa73-0800-4242-b689-327b0ca49945 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:14.644528 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d98c5-a62b-47ad-8948-b04d1d862608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:14.646570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d98c5-a62b-47ad-8948-b04d1d862608 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:14.672737 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1363/2715] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:54:14 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:54:14.677935 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123aa73-0800-4242-b689-327b0ca49945 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:14.684059 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1353/2716] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:54:14 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:54:14.684262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:14.685437 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d98c5-a62b-47ad-8948-b04d1d862608 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:14.695259 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d98c5-a62b-47ad-8948-b04d1d862608 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:14.743785 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123aa73-0800-4242-b689-327b0ca49945 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:14.749308 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6884e29-64b8-4e99-a235-20ed70dd335b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:14.749953 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6884e29-64b8-4e99-a235-20ed70dd335b admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:14.750229 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6884e29-64b8-4e99-a235-20ed70dd335b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:14.750502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6884e29-64b8-4e99-a235-20ed70dd335b admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:14.751123 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6884e29-64b8-4e99-a235-20ed70dd335b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:14.753023 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6884e29-64b8-4e99-a235-20ed70dd335b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:14.754780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e5a8a-5960-4eb9-aafb-d8442824c298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:14.755377 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e5a8a-5960-4eb9-aafb-d8442824c298 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:14.755649 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e5a8a-5960-4eb9-aafb-d8442824c298 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:14.756031 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e5a8a-5960-4eb9-aafb-d8442824c298 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:14.756703 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e5a8a-5960-4eb9-aafb-d8442824c298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:14.758292 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e5a8a-5960-4eb9-aafb-d8442824c298 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:14.768826 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1354/2717] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:54:14.772864 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e5a8a-5960-4eb9-aafb-d8442824c298 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:14.777839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1364/2718] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:54:14 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:54:14.778889 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6884e29-64b8-4e99-a235-20ed70dd335b admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:14.782987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e5a8a-5960-4eb9-aafb-d8442824c298 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:14.787712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bf2e9-5ac3-474a-b0ab-114e80b2437c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:14.788298 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bf2e9-5ac3-474a-b0ab-114e80b2437c admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:14.788430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6884e29-64b8-4e99-a235-20ed70dd335b admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:14.788570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bf2e9-5ac3-474a-b0ab-114e80b2437c admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:14.788951 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bf2e9-5ac3-474a-b0ab-114e80b2437c admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:14.789620 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753bf2e9-5ac3-474a-b0ab-114e80b2437c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:14.791176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753bf2e9-5ac3-474a-b0ab-114e80b2437c admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:14.793760 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a37113-da6c-490a-b31a-bf1d2c4045ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:14.794355 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a37113-da6c-490a-b31a-bf1d2c4045ed admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:14.794634 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a37113-da6c-490a-b31a-bf1d2c4045ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:14.794909 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a37113-da6c-490a-b31a-bf1d2c4045ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:14.795595 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a37113-da6c-490a-b31a-bf1d2c4045ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:14.797480 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a37113-da6c-490a-b31a-bf1d2c4045ed admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:14.802454 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1355/2719] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:54:14.806595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bf2e9-5ac3-474a-b0ab-114e80b2437c admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:14.811598 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1365/2720] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:54:14.812547 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a37113-da6c-490a-b31a-bf1d2c4045ed admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:14.816972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bf2e9-5ac3-474a-b0ab-114e80b2437c admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:14.821675 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce6067-136a-4c4d-a81e-2904914d8bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:14.822199 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a37113-da6c-490a-b31a-bf1d2c4045ed admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:14.822309 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce6067-136a-4c4d-a81e-2904914d8bfd admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:14.822566 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce6067-136a-4c4d-a81e-2904914d8bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:14.822836 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce6067-136a-4c4d-a81e-2904914d8bfd admin admin] PATH_INFO: `/v3/projects/cbd14aa9c77d439a9c4ea4adc6086928/users/1a9540df5e5047a28439f813cda7f755/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:14.827209 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1a448-135a-4052-8387-a4b0eaab2f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:14.827799 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1a448-135a-4052-8387-a4b0eaab2f6d admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:14.828081 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1a448-135a-4052-8387-a4b0eaab2f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:14.828353 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1a448-135a-4052-8387-a4b0eaab2f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:14.829013 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1a448-135a-4052-8387-a4b0eaab2f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:14.830721 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1a448-135a-4052-8387-a4b0eaab2f6d admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:14.834295 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:14.838788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce6067-136a-4c4d-a81e-2904914d8bfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd14aa9c77d439a9c4ea4adc6086928, user_id=1a9540df5e5047a28439f813cda7f755, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:14.842088 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1366/2721] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:54:14.842328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce6067-136a-4c4d-a81e-2904914d8bfd admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:14.846157 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1a448-135a-4052-8387-a4b0eaab2f6d admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:14.856886 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1356/2722] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:54:14 2022] PUT /identity/v3/projects/cbd14aa9c77d439a9c4ea4adc6086928/users/1a9540df5e5047a28439f813cda7f755/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:54:14.857302 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1a448-135a-4052-8387-a4b0eaab2f6d admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:14.867787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6924610-3b8e-4940-9ccf-fdbcaa6d31af None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:14.868064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6924610-3b8e-4940-9ccf-fdbcaa6d31af None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:14.868333 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6924610-3b8e-4940-9ccf-fdbcaa6d31af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:14.904665 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-f6924610-3b8e-4940-9ccf-fdbcaa6d31af None None] MFA Rules not processed for user `1a9540df5e5047a28439f813cda7f755`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:14.905955 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-f6924610-3b8e-4940-9ccf-fdbcaa6d31af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:14.921715 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6a9be-44e3-4f3e-b61d-596da0f03cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:14.922386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6a9be-44e3-4f3e-b61d-596da0f03cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:14.922661 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6a9be-44e3-4f3e-b61d-596da0f03cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:14.922935 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6a9be-44e3-4f3e-b61d-596da0f03cc2 admin admin] PATH_INFO: `/v3/projects/dee0f95aab1a448c84d047c80d1fe9de/users/abee6130ef13424bb8ac4d7334407a78/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:14.940148 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6a9be-44e3-4f3e-b61d-596da0f03cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee0f95aab1a448c84d047c80d1fe9de, user_id=abee6130ef13424bb8ac4d7334407a78, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:14.942858 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6a9be-44e3-4f3e-b61d-596da0f03cc2 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:14.960448 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1367/2723] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:54:14 2022] PUT /identity/v3/projects/dee0f95aab1a448c84d047c80d1fe9de/users/abee6130ef13424bb8ac4d7334407a78/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:54:14.966491 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55952f9-8d76-4b48-a474-9b04b3ebcc7a None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:14.966841 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55952f9-8d76-4b48-a474-9b04b3ebcc7a None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:14.967183 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55952f9-8d76-4b48-a474-9b04b3ebcc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:14.981388 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1357/2724] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:54:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:14.989053 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-e55952f9-8d76-4b48-a474-9b04b3ebcc7a None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:14.990450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-e55952f9-8d76-4b48-a474-9b04b3ebcc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:14.992626 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6924610-3b8e-4940-9ccf-fdbcaa6d31af None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:14.994047 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-f6924610-3b8e-4940-9ccf-fdbcaa6d31af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:15.041584 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:15.052902 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6924610-3b8e-4940-9ccf-fdbcaa6d31af None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:15.054810 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1368/2725] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:54:15.064681 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55952f9-8d76-4b48-a474-9b04b3ebcc7a None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:15.065996 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-e55952f9-8d76-4b48-a474-9b04b3ebcc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:15.104071 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56abcd-04c9-42d3-a061-8da3376fb8aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:15.105244 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56abcd-04c9-42d3-a061-8da3376fb8aa service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:15.106193 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56abcd-04c9-42d3-a061-8da3376fb8aa service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:15.106478 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56abcd-04c9-42d3-a061-8da3376fb8aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:15.125265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55952f9-8d76-4b48-a474-9b04b3ebcc7a None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:15.129057 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e662a-0ea8-40e5-a52e-099071edd8be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:15.129698 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e662a-0ea8-40e5-a52e-099071edd8be service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:15.129978 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e662a-0ea8-40e5-a52e-099071edd8be service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:15.130253 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e662a-0ea8-40e5-a52e-099071edd8be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:15.139695 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e662a-0ea8-40e5-a52e-099071edd8be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:15.141252 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e662a-0ea8-40e5-a52e-099071edd8be service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:15.152301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1369/2726] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:54:15.158578 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:15.170418 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56abcd-04c9-42d3-a061-8da3376fb8aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:15.171999 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56abcd-04c9-42d3-a061-8da3376fb8aa service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:15.181599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1358/2727] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:54:15.207009 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e662a-0ea8-40e5-a52e-099071edd8be service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:15.218402 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e662a-0ea8-40e5-a52e-099071edd8be service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:15.223407 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36c7db-6fab-4d85-b3b5-5e292aafec96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:15.223866 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36c7db-6fab-4d85-b3b5-5e292aafec96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:15.224196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36c7db-6fab-4d85-b3b5-5e292aafec96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:15.224476 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36c7db-6fab-4d85-b3b5-5e292aafec96 admin admin] PATH_INFO: `/v3/users/1a9540df5e5047a28439f813cda7f755` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:15.226054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36c7db-6fab-4d85-b3b5-5e292aafec96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a9540df5e5047a28439f813cda7f755)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:15.228358 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36c7db-6fab-4d85-b3b5-5e292aafec96 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:15.283987 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-fd36c7db-6fab-4d85-b3b5-5e292aafec96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a9540df5e5047a28439f813cda7f755'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:15.284711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-fd36c7db-6fab-4d85-b3b5-5e292aafec96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a9540df5e5047a28439f813cda7f755'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:15.298432 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-fd36c7db-6fab-4d85-b3b5-5e292aafec96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a9540df5e5047a28439f813cda7f755'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:15.305789 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-fd36c7db-6fab-4d85-b3b5-5e292aafec96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a9540df5e5047a28439f813cda7f755'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:15.313107 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-fd36c7db-6fab-4d85-b3b5-5e292aafec96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a9540df5e5047a28439f813cda7f755'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:15.319549 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1370/2728] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:54:15 2022] DELETE /identity/v3/users/1a9540df5e5047a28439f813cda7f755 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:54:15.324751 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab81cb-c06c-434a-ac39-cd6b885300c0 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:15.325088 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab81cb-c06c-434a-ac39-cd6b885300c0 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:15.325447 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab81cb-c06c-434a-ac39-cd6b885300c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:15.346902 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-01ab81cb-c06c-434a-ac39-cd6b885300c0 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:15.348170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-01ab81cb-c06c-434a-ac39-cd6b885300c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:15.409918 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1359/2729] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:54:15.419856 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36c7db-6fab-4d85-b3b5-5e292aafec96 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:15.421917 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-fd36c7db-6fab-4d85-b3b5-5e292aafec96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:15.486420 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36c7db-6fab-4d85-b3b5-5e292aafec96 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:15.490489 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536621c8-aed7-4dc3-865f-0fcdabfcc624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:15.491109 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536621c8-aed7-4dc3-865f-0fcdabfcc624 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:15.491400 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536621c8-aed7-4dc3-865f-0fcdabfcc624 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:15.491665 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536621c8-aed7-4dc3-865f-0fcdabfcc624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:15.501519 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536621c8-aed7-4dc3-865f-0fcdabfcc624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:15.502988 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536621c8-aed7-4dc3-865f-0fcdabfcc624 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:15.513606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1371/2730] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:15.952299 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab81cb-c06c-434a-ac39-cd6b885300c0 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:15.954229 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-01ab81cb-c06c-434a-ac39-cd6b885300c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:15.980419 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab81cb-c06c-434a-ac39-cd6b885300c0 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:15.990537 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd4081f-04b9-4081-a279-24977fbb95d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:15.991546 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4081f-04b9-4081-a279-24977fbb95d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:15.992428 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4081f-04b9-4081-a279-24977fbb95d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:15.992926 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd4081f-04b9-4081-a279-24977fbb95d7 admin admin] PATH_INFO: `/v3/projects/cbd14aa9c77d439a9c4ea4adc6086928` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:15.994453 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4081f-04b9-4081-a279-24977fbb95d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbd14aa9c77d439a9c4ea4adc6086928)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:15.999483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd4081f-04b9-4081-a279-24977fbb95d7 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:16.067756 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2bd4081f-04b9-4081-a279-24977fbb95d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbd14aa9c77d439a9c4ea4adc6086928', 'request_id': 'req-2bd4081f-04b9-4081-a279-24977fbb95d7'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:16.076987 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2bd4081f-04b9-4081-a279-24977fbb95d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbd14aa9c77d439a9c4ea4adc6086928', 'request_id': 'req-2bd4081f-04b9-4081-a279-24977fbb95d7'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:16.085256 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2bd4081f-04b9-4081-a279-24977fbb95d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbd14aa9c77d439a9c4ea4adc6086928', 'request_id': 'req-2bd4081f-04b9-4081-a279-24977fbb95d7'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:16.098357 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2bd4081f-04b9-4081-a279-24977fbb95d7 admin admin] The token cache is being invalidate because project cbd14aa9c77d439a9c4ea4adc6086928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:54:16.098705 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2bd4081f-04b9-4081-a279-24977fbb95d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:16.099391 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-2bd4081f-04b9-4081-a279-24977fbb95d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:54:16.104881 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1360/2731] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:54:15 2022] DELETE /identity/v3/projects/cbd14aa9c77d439a9c4ea4adc6086928 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:54:16.107132 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df01070-e4e9-4775-8110-2e55600367fa None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:16.107641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df01070-e4e9-4775-8110-2e55600367fa None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:16.107880 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df01070-e4e9-4775-8110-2e55600367fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:16.130213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-9df01070-e4e9-4775-8110-2e55600367fa None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:16.131639 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-9df01070-e4e9-4775-8110-2e55600367fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:16.141796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:16.210366 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1372/2732] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:16.219028 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b5a21-8f05-4fee-8a9a-3d450deb6508 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:16.219371 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b5a21-8f05-4fee-8a9a-3d450deb6508 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:16.219594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b5a21-8f05-4fee-8a9a-3d450deb6508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:16.246624 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-b69b5a21-8f05-4fee-8a9a-3d450deb6508 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:16.247940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-b69b5a21-8f05-4fee-8a9a-3d450deb6508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:16.256762 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1361/2733] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:16.261632 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df01070-e4e9-4775-8110-2e55600367fa None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:16.274174 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df01070-e4e9-4775-8110-2e55600367fa None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:16.281226 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13fea0-e70c-496d-8390-bfd2a6460587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:16.281982 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13fea0-e70c-496d-8390-bfd2a6460587 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:16.282331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13fea0-e70c-496d-8390-bfd2a6460587 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:16.282703 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13fea0-e70c-496d-8390-bfd2a6460587 admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:16.283437 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13fea0-e70c-496d-8390-bfd2a6460587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:54:16.283813 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13fea0-e70c-496d-8390-bfd2a6460587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:16.285538 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13fea0-e70c-496d-8390-bfd2a6460587 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:16.303122 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1373/2734] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 09:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:54:16.304674 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b5a21-8f05-4fee-8a9a-3d450deb6508 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:16.317417 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b5a21-8f05-4fee-8a9a-3d450deb6508 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:16.324137 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cb127-fc12-42d5-9d9f-ff6b9e316fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:16.325260 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cb127-fc12-42d5-9d9f-ff6b9e316fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:16.325819 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cb127-fc12-42d5-9d9f-ff6b9e316fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:16.326254 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cb127-fc12-42d5-9d9f-ff6b9e316fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:16.327039 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111cb127-fc12-42d5-9d9f-ff6b9e316fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:16.329132 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111cb127-fc12-42d5-9d9f-ff6b9e316fa3 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:16.360528 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1362/2735] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:54:16 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:54:16.366822 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13fea0-e70c-496d-8390-bfd2a6460587 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:16.382384 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13fea0-e70c-496d-8390-bfd2a6460587 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:16.451218 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f58da9-b71b-42f8-937b-665dd8d062b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:16.452372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f58da9-b71b-42f8-937b-665dd8d062b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:16.452372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f58da9-b71b-42f8-937b-665dd8d062b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:16.452372 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f58da9-b71b-42f8-937b-665dd8d062b7 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:16.452999 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f58da9-b71b-42f8-937b-665dd8d062b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:16.454969 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f58da9-b71b-42f8-937b-665dd8d062b7 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:16.480334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1374/2736] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:54:16 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:54:16.484524 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cb127-fc12-42d5-9d9f-ff6b9e316fa3 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:16.497687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cb127-fc12-42d5-9d9f-ff6b9e316fa3 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:16.503345 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff7ef4-745a-4246-b4e2-50794853cbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:16.504195 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff7ef4-745a-4246-b4e2-50794853cbca admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:16.504605 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff7ef4-745a-4246-b4e2-50794853cbca admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:16.504946 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff7ef4-745a-4246-b4e2-50794853cbca admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:16.506219 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff7ef4-745a-4246-b4e2-50794853cbca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:16.507801 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff7ef4-745a-4246-b4e2-50794853cbca admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:16.520147 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1363/2737] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:54:16.524027 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f58da9-b71b-42f8-937b-665dd8d062b7 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:16.535740 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f58da9-b71b-42f8-937b-665dd8d062b7 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:16.542262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af35139-8742-4a44-91f4-a3c78c81ea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:16.542754 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af35139-8742-4a44-91f4-a3c78c81ea84 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:16.543050 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af35139-8742-4a44-91f4-a3c78c81ea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:16.543497 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af35139-8742-4a44-91f4-a3c78c81ea84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:16.544078 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af35139-8742-4a44-91f4-a3c78c81ea84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:16.545729 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af35139-8742-4a44-91f4-a3c78c81ea84 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:16.558932 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1375/2738] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:54:16.563015 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff7ef4-745a-4246-b4e2-50794853cbca admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:16.575272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff7ef4-745a-4246-b4e2-50794853cbca admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:16.592785 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10dd2f7-c57c-4e8b-8f66-2a3a4f48312b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:16.593530 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dd2f7-c57c-4e8b-8f66-2a3a4f48312b admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:16.593797 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dd2f7-c57c-4e8b-8f66-2a3a4f48312b admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:16.594077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dd2f7-c57c-4e8b-8f66-2a3a4f48312b admin admin] PATH_INFO: `/v3/projects/ceba910b7b534a98999093431d6dd0cb/users/8a1bd12fb1f64a6ba41f7dc58376fccb/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:16.618050 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10dd2f7-c57c-4e8b-8f66-2a3a4f48312b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceba910b7b534a98999093431d6dd0cb, user_id=8a1bd12fb1f64a6ba41f7dc58376fccb, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:16.622561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10dd2f7-c57c-4e8b-8f66-2a3a4f48312b admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:16.641496 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1364/2739] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:54:16 2022] PUT /identity/v3/projects/ceba910b7b534a98999093431d6dd0cb/users/8a1bd12fb1f64a6ba41f7dc58376fccb/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:54:16.646621 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06d816-c467-4fb3-9c86-22b735e52989 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:16.647038 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06d816-c467-4fb3-9c86-22b735e52989 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:16.647389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06d816-c467-4fb3-9c86-22b735e52989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:16.671054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-df06d816-c467-4fb3-9c86-22b735e52989 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:16.672395 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-df06d816-c467-4fb3-9c86-22b735e52989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:16.748282 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1376/2740] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:54:16.758941 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10dd2f7-c57c-4e8b-8f66-2a3a4f48312b admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:16.760937 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e10dd2f7-c57c-4e8b-8f66-2a3a4f48312b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:16.775367 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:16.849642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10dd2f7-c57c-4e8b-8f66-2a3a4f48312b admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:16.855850 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a56055-3989-4b38-bbaf-c6e89172389e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:16.856490 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a56055-3989-4b38-bbaf-c6e89172389e service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:16.856801 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a56055-3989-4b38-bbaf-c6e89172389e service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:16.857077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a56055-3989-4b38-bbaf-c6e89172389e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:16.869510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a56055-3989-4b38-bbaf-c6e89172389e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:16.871074 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a56055-3989-4b38-bbaf-c6e89172389e service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:16.905491 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1365/2741] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:21.028023 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5f512-96e4-4214-b7e9-701448a52128 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:21.028536 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5f512-96e4-4214-b7e9-701448a52128 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:21.029575 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5f512-96e4-4214-b7e9-701448a52128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:21.067902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-eaf5f512-96e4-4214-b7e9-701448a52128 None None] MFA Rules not processed for user `abee6130ef13424bb8ac4d7334407a78`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:21.069260 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-eaf5f512-96e4-4214-b7e9-701448a52128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:21.085320 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:21.195664 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1377/2742] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:54:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:21.212536 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a56055-3989-4b38-bbaf-c6e89172389e service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:21.217762 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-c1a56055-3989-4b38-bbaf-c6e89172389e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:21.366885 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a56055-3989-4b38-bbaf-c6e89172389e service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:21.377973 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed0396-b563-4001-a865-b69ec912bf91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:21.378642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed0396-b563-4001-a865-b69ec912bf91 service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:21.378932 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed0396-b563-4001-a865-b69ec912bf91 service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:21.379203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed0396-b563-4001-a865-b69ec912bf91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:21.391977 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed0396-b563-4001-a865-b69ec912bf91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:21.393268 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed0396-b563-4001-a865-b69ec912bf91 service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:21.420907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1366/2743] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:22.909700 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e04a14-d221-42f8-a85c-4afb7412a09c None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:22.910175 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e04a14-d221-42f8-a85c-4afb7412a09c None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:22.910287 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e04a14-d221-42f8-a85c-4afb7412a09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:22.977579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-25e04a14-d221-42f8-a85c-4afb7412a09c None None] MFA Rules not processed for user `8a1bd12fb1f64a6ba41f7dc58376fccb`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:22.980556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-25e04a14-d221-42f8-a85c-4afb7412a09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:23.123376 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed0396-b563-4001-a865-b69ec912bf91 service nova] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:23.123961 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1378/2744] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:54:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:23.136143 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed0396-b563-4001-a865-b69ec912bf91 service nova] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:23.152444 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b97f8-7595-447a-bb68-86dec839d557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:23.153573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b97f8-7595-447a-bb68-86dec839d557 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:23.155095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b97f8-7595-447a-bb68-86dec839d557 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:23.155533 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b97f8-7595-447a-bb68-86dec839d557 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:23.157236 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b97f8-7595-447a-bb68-86dec839d557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:23.160454 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b97f8-7595-447a-bb68-86dec839d557 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:23.200207 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907340b-80f9-4db4-9a57-b516ee493648 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:23.200754 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907340b-80f9-4db4-9a57-b516ee493648 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:23.201200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907340b-80f9-4db4-9a57-b516ee493648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:23.225560 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1367/2745] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 09:54:23 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:54:23.230088 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b97f8-7595-447a-bb68-86dec839d557 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:23.230266 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-6907340b-80f9-4db4-9a57-b516ee493648 None None] MFA Rules not processed for user `abee6130ef13424bb8ac4d7334407a78`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:23.231524 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-6907340b-80f9-4db4-9a57-b516ee493648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:23.303119 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:23.308898 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1379/2746] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:54:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:23.311392 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b97f8-7595-447a-bb68-86dec839d557 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:23.317474 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a22b5d-5721-4c9d-8a13-6cd9c011a40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:23.318200 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a22b5d-5721-4c9d-8a13-6cd9c011a40e admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:23.318544 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a22b5d-5721-4c9d-8a13-6cd9c011a40e admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:23.319149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a22b5d-5721-4c9d-8a13-6cd9c011a40e admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:23.319971 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a22b5d-5721-4c9d-8a13-6cd9c011a40e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:23.321559 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a22b5d-5721-4c9d-8a13-6cd9c011a40e admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:23.357599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1368/2747] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 09:54:23 2022] POST /identity/v3/users => generated 298 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:54:23.359814 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907340b-80f9-4db4-9a57-b516ee493648 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:23.371901 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907340b-80f9-4db4-9a57-b516ee493648 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:23.378840 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9f26c-d19d-4200-ad9f-9bd1fa54f3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:23.379966 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9f26c-d19d-4200-ad9f-9bd1fa54f3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:23.379966 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9f26c-d19d-4200-ad9f-9bd1fa54f3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:23.380252 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9f26c-d19d-4200-ad9f-9bd1fa54f3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:23.381055 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9f26c-d19d-4200-ad9f-9bd1fa54f3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:23.390484 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9f26c-d19d-4200-ad9f-9bd1fa54f3b3 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:23.405678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1380/2748] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:54:23.409098 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a22b5d-5721-4c9d-8a13-6cd9c011a40e admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:23.426149 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a22b5d-5721-4c9d-8a13-6cd9c011a40e admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:23.432769 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347feb0-622d-4cf0-b037-6bfabf40a308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:23.433727 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347feb0-622d-4cf0-b037-6bfabf40a308 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:23.434233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347feb0-622d-4cf0-b037-6bfabf40a308 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:23.434698 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347feb0-622d-4cf0-b037-6bfabf40a308 admin admin] PATH_INFO: `/v3/projects/c128b7d80c8d4ea5be7a58aff1bf4893/users/9840d87e28474e2e8caa50d30c14ea85/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:23.469184 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347feb0-622d-4cf0-b037-6bfabf40a308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c128b7d80c8d4ea5be7a58aff1bf4893, user_id=9840d87e28474e2e8caa50d30c14ea85, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:23.474618 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347feb0-622d-4cf0-b037-6bfabf40a308 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:23.509438 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1369/2749] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:54:23 2022] PUT /identity/v3/projects/c128b7d80c8d4ea5be7a58aff1bf4893/users/9840d87e28474e2e8caa50d30c14ea85/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:54:23.511992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9f26c-d19d-4200-ad9f-9bd1fa54f3b3 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:23.522223 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9f26c-d19d-4200-ad9f-9bd1fa54f3b3 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:23.562839 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=100 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:23.595365 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6c612-50fe-401b-b8a6-c674b07cd67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:23.595995 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6c612-50fe-401b-b8a6-c674b07cd67e admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:23.596283 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6c612-50fe-401b-b8a6-c674b07cd67e admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:23.596564 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6c612-50fe-401b-b8a6-c674b07cd67e admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:23.597238 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6c612-50fe-401b-b8a6-c674b07cd67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:23.598878 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6c612-50fe-401b-b8a6-c674b07cd67e admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:23.615105 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1381/2750] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 09:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:54:23.616516 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347feb0-622d-4cf0-b037-6bfabf40a308 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:23.629014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347feb0-622d-4cf0-b037-6bfabf40a308 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:23.634214 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe53aac-ddff-4937-822d-137579d6b67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:23.635010 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe53aac-ddff-4937-822d-137579d6b67f admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:23.635194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe53aac-ddff-4937-822d-137579d6b67f admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:23.636473 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe53aac-ddff-4937-822d-137579d6b67f admin admin] PATH_INFO: `/v3/projects/c128b7d80c8d4ea5be7a58aff1bf4893/users/9840d87e28474e2e8caa50d30c14ea85/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:23.638769 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe53aac-ddff-4937-822d-137579d6b67f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c128b7d80c8d4ea5be7a58aff1bf4893, user_id=9840d87e28474e2e8caa50d30c14ea85, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:23.641660 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe53aac-ddff-4937-822d-137579d6b67f admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:23.657256 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1370/2751] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 09:54:23 2022] PUT /identity/v3/projects/c128b7d80c8d4ea5be7a58aff1bf4893/users/9840d87e28474e2e8caa50d30c14ea85/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:54:30.318998 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c3839-6215-40ca-a5fb-13455f5886ad None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:30.319553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c3839-6215-40ca-a5fb-13455f5886ad None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:30.319553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c3839-6215-40ca-a5fb-13455f5886ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:30.347912 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-ba2c3839-6215-40ca-a5fb-13455f5886ad None None] MFA Rules not processed for user `9840d87e28474e2e8caa50d30c14ea85`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:30.349109 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-ba2c3839-6215-40ca-a5fb-13455f5886ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:30.416900 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1382/2752] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:54:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:30.428564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe53aac-ddff-4937-822d-137579d6b67f admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:30.430287 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-5fe53aac-ddff-4937-822d-137579d6b67f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:30.491441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe53aac-ddff-4937-822d-137579d6b67f admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:30.495347 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291be432-c04a-4027-b6c9-49a7a10066dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51fe6dfa43d04cdeb0421d2613c8c2ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:30.495986 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291be432-c04a-4027-b6c9-49a7a10066dc service glance] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:30.496266 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291be432-c04a-4027-b6c9-49a7a10066dc service glance] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:30.496542 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291be432-c04a-4027-b6c9-49a7a10066dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:30.555202 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291be432-c04a-4027-b6c9-49a7a10066dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:30.556634 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291be432-c04a-4027-b6c9-49a7a10066dc service glance] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:30.566158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1371/2753] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:30.693455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b0f27-87f6-45de-a35a-d72661eb108e None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:30.693773 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b0f27-87f6-45de-a35a-d72661eb108e None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:30.694056 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b0f27-87f6-45de-a35a-d72661eb108e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:30.715725 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-395b0f27-87f6-45de-a35a-d72661eb108e None None] MFA Rules not processed for user `3ae62427d5914e67b5b4d0237ecccd06`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:30.716942 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-395b0f27-87f6-45de-a35a-d72661eb108e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:30.772796 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1383/2754] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 09:54:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:30.819698 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291be432-c04a-4027-b6c9-49a7a10066dc service glance] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:30.821096 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-291be432-c04a-4027-b6c9-49a7a10066dc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:30.887385 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:30.892279 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291be432-c04a-4027-b6c9-49a7a10066dc service glance] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:30.898461 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd98d9-f80e-42d4-8877-eab34466a15d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2db35b94c84ec7bba96117d23baf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:30.899037 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd98d9-f80e-42d4-8877-eab34466a15d service swift] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:30.899314 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd98d9-f80e-42d4-8877-eab34466a15d service swift] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:30.899583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd98d9-f80e-42d4-8877-eab34466a15d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:30.908616 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd98d9-f80e-42d4-8877-eab34466a15d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:30.910227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd98d9-f80e-42d4-8877-eab34466a15d service swift] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:30.918768 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1372/2755] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 09:54:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:54:40.086699 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee0024-6e70-4c38-840d-62cb4110307e None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:40.087197 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee0024-6e70-4c38-840d-62cb4110307e None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:40.087316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee0024-6e70-4c38-840d-62cb4110307e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:40.108751 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-f4ee0024-6e70-4c38-840d-62cb4110307e None None] MFA Rules not processed for user `8a1bd12fb1f64a6ba41f7dc58376fccb`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:40.110271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f4ee0024-6e70-4c38-840d-62cb4110307e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:40.117359 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1384/2756] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:54:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:40.914890 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=4 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:41.967079 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bda19-d41a-4293-a376-a9e3fd8833c3 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:41.967666 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bda19-d41a-4293-a376-a9e3fd8833c3 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:41.967666 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bda19-d41a-4293-a376-a9e3fd8833c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:41.986821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-cf8bda19-d41a-4293-a376-a9e3fd8833c3 None None] MFA Rules not processed for user `3ae62427d5914e67b5b4d0237ecccd06`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:54:41.988030 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-cf8bda19-d41a-4293-a376-a9e3fd8833c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:41.996116 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1373/2757] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 09:54:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:54:42.008159 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee0024-6e70-4c38-840d-62cb4110307e None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:42.021224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee0024-6e70-4c38-840d-62cb4110307e None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:42.027770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529a969-9acb-47c4-9954-431bf3e2e78a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2db35b94c84ec7bba96117d23baf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:42.028386 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529a969-9acb-47c4-9954-431bf3e2e78a service swift] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:42.028673 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529a969-9acb-47c4-9954-431bf3e2e78a service swift] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:42.028953 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529a969-9acb-47c4-9954-431bf3e2e78a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:42.037790 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529a969-9acb-47c4-9954-431bf3e2e78a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:42.039394 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529a969-9acb-47c4-9954-431bf3e2e78a service swift] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:42.048349 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1385/2758] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 09:54:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:54:51.981165 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:52.044956 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=82 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:53.578273 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bda19-d41a-4293-a376-a9e3fd8833c3 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:53.579835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-cf8bda19-d41a-4293-a376-a9e3fd8833c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:53.638935 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bda19-d41a-4293-a376-a9e3fd8833c3 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:53.642668 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b20d5-ae96-4f4c-ade9-539e93d90f0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:53.643262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b20d5-ae96-4f4c-ade9-539e93d90f0b service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:53.643544 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b20d5-ae96-4f4c-ade9-539e93d90f0b service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:53.643820 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b20d5-ae96-4f4c-ade9-539e93d90f0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:53.645583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e11b20d5-ae96-4f4c-ade9-539e93d90f0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:53.716604 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b20d5-ae96-4f4c-ade9-539e93d90f0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:53.718057 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b20d5-ae96-4f4c-ade9-539e93d90f0b service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:53.729325 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1374/2759] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:54:54.913345 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529a969-9acb-47c4-9954-431bf3e2e78a service swift] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:54:54.924230 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529a969-9acb-47c4-9954-431bf3e2e78a service swift] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:54:54.928070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e484c8b-1dec-4a2d-a750-0e98c0da75c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:54:54.928670 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e484c8b-1dec-4a2d-a750-0e98c0da75c6 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:54:54.928946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e484c8b-1dec-4a2d-a750-0e98c0da75c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:54:54.929217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e484c8b-1dec-4a2d-a750-0e98c0da75c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:54:54.931607 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-4e484c8b-1dec-4a2d-a750-0e98c0da75c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:54:54.945537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e484c8b-1dec-4a2d-a750-0e98c0da75c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:54:54.947538 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e484c8b-1dec-4a2d-a750-0e98c0da75c6 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:54:54.958440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1386/2760] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:54:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:55:03.724052 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=54 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:04.953576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=6 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:07.018839 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b20d5-ae96-4f4c-ade9-539e93d90f0b service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:55:07.028343 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b20d5-ae96-4f4c-ade9-539e93d90f0b service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:55:07.032025 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edcb91-a226-42cd-a38e-23e2cd0cbb01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:55:07.032623 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edcb91-a226-42cd-a38e-23e2cd0cbb01 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:07.032903 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edcb91-a226-42cd-a38e-23e2cd0cbb01 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:07.033178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edcb91-a226-42cd-a38e-23e2cd0cbb01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:07.043344 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edcb91-a226-42cd-a38e-23e2cd0cbb01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:55:07.044790 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edcb91-a226-42cd-a38e-23e2cd0cbb01 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:55:07.054229 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1375/2761] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:55:07 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:55:17.050116 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=6 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:55:59.786982 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be6156-2c4d-4eae-9eb1-ff045fbd6f46 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:55:59.787596 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be6156-2c4d-4eae-9eb1-ff045fbd6f46 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:55:59.787596 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be6156-2c4d-4eae-9eb1-ff045fbd6f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:55:59.807598 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-35be6156-2c4d-4eae-9eb1-ff045fbd6f46 None None] MFA Rules not processed for user `abee6130ef13424bb8ac4d7334407a78`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:55:59.808811 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-35be6156-2c4d-4eae-9eb1-ff045fbd6f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:55:59.862424 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1387/2762] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:55:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:56:00.169711 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edcb91-a226-42cd-a38e-23e2cd0cbb01 service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:56:00.178390 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edcb91-a226-42cd-a38e-23e2cd0cbb01 service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:56:00.182606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405841f-d309-4c18-926f-8161edbc42ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:56:00.183196 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405841f-d309-4c18-926f-8161edbc42ec service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:00.183480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405841f-d309-4c18-926f-8161edbc42ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:00.183755 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405841f-d309-4c18-926f-8161edbc42ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:00.185483 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7405841f-d309-4c18-926f-8161edbc42ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:00.195430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405841f-d309-4c18-926f-8161edbc42ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:56:00.196821 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405841f-d309-4c18-926f-8161edbc42ec service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:56:00.204724 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1376/2763] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:56:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:56:00.535600 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be6156-2c4d-4eae-9eb1-ff045fbd6f46 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:56:00.537080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-35be6156-2c4d-4eae-9eb1-ff045fbd6f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:00.617055 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be6156-2c4d-4eae-9eb1-ff045fbd6f46 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:56:00.622149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5e27a-2e01-40dd-8c49-78b25de51196 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983e364f5564ed7854dff06a80f55d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:56:00.622752 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5e27a-2e01-40dd-8c49-78b25de51196 service placement] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:00.623036 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5e27a-2e01-40dd-8c49-78b25de51196 service placement] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:00.623309 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5e27a-2e01-40dd-8c49-78b25de51196 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:00.625037 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-c1a5e27a-2e01-40dd-8c49-78b25de51196 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:00.636587 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5e27a-2e01-40dd-8c49-78b25de51196 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:56:00.638182 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5e27a-2e01-40dd-8c49-78b25de51196 service placement] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:56:00.648264 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1388/2764] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:56:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:56:01.104038 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405841f-d309-4c18-926f-8161edbc42ec service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:56:01.113266 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405841f-d309-4c18-926f-8161edbc42ec service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:56:01.117221 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c0cda-f95a-4ddb-ab07-c1398af77bfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:56:01.117880 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c0cda-f95a-4ddb-ab07-c1398af77bfd service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:01.118211 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c0cda-f95a-4ddb-ab07-c1398af77bfd service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:01.118485 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c0cda-f95a-4ddb-ab07-c1398af77bfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:01.120252 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-609c0cda-f95a-4ddb-ab07-c1398af77bfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:01.131071 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c0cda-f95a-4ddb-ab07-c1398af77bfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:56:01.133170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c0cda-f95a-4ddb-ab07-c1398af77bfd service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:56:01.141273 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1377/2765] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:56:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:56:09.824269 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5e27a-2e01-40dd-8c49-78b25de51196 service placement] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:56:09.839518 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5e27a-2e01-40dd-8c49-78b25de51196 service placement] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:56:09.845241 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600795c0-240f-47ac-a18f-2ce6a881d0c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:56:09.846044 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600795c0-240f-47ac-a18f-2ce6a881d0c7 service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:09.846327 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600795c0-240f-47ac-a18f-2ce6a881d0c7 service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:09.846605 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600795c0-240f-47ac-a18f-2ce6a881d0c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:09.848368 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-600795c0-240f-47ac-a18f-2ce6a881d0c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:09.862987 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600795c0-240f-47ac-a18f-2ce6a881d0c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:56:09.865398 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600795c0-240f-47ac-a18f-2ce6a881d0c7 service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:56:09.880485 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1389/2766] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:56:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:56:11.137577 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=12 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:56:13.334703 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c0cda-f95a-4ddb-ab07-c1398af77bfd service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:56:13.336479 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-609c0cda-f95a-4ddb-ab07-c1398af77bfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:13.352968 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c0cda-f95a-4ddb-ab07-c1398af77bfd service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:56:13.358609 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b502da2-801a-43c4-8cf9-f61ad031f356 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:56:13.359227 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b502da2-801a-43c4-8cf9-f61ad031f356 service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:56:13.359510 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b502da2-801a-43c4-8cf9-f61ad031f356 service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:56:13.359787 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b502da2-801a-43c4-8cf9-f61ad031f356 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:56:13.361650 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-6b502da2-801a-43c4-8cf9-f61ad031f356 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:56:13.375348 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b502da2-801a-43c4-8cf9-f61ad031f356 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:56:13.376957 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b502da2-801a-43c4-8cf9-f61ad031f356 service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:56:13.388949 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1378/2767] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:56:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:56:19.875564 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=63 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:56:23.383927 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=6 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:57:31.333354 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600795c0-240f-47ac-a18f-2ce6a881d0c7 service nova] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:57:31.347735 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600795c0-240f-47ac-a18f-2ce6a881d0c7 service nova] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:57:31.358008 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd611f-12bb-4339-b476-8d79478bc2c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:57:31.358488 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd611f-12bb-4339-b476-8d79478bc2c6 service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:31.358764 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd611f-12bb-4339-b476-8d79478bc2c6 service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:31.359032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd611f-12bb-4339-b476-8d79478bc2c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:31.360908 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-96dd611f-12bb-4339-b476-8d79478bc2c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:57:31.375307 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd611f-12bb-4339-b476-8d79478bc2c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:57:31.377007 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd611f-12bb-4339-b476-8d79478bc2c6 service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:57:31.394213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1390/2768] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:57:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:57:40.954002 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1806527-6e4b-494f-bd73-c7f0407138e4 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:40.954553 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1806527-6e4b-494f-bd73-c7f0407138e4 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:40.954553 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1806527-6e4b-494f-bd73-c7f0407138e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:40.974085 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-c1806527-6e4b-494f-bd73-c7f0407138e4 None None] MFA Rules not processed for user `abee6130ef13424bb8ac4d7334407a78`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:57:40.975269 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-c1806527-6e4b-494f-bd73-c7f0407138e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:57:40.982158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1379/2769] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:57:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:57:41.385244 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=6 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:57:50.968722 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:57:54.661815 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826a332-1497-4041-bd5d-c6d1d574c252 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:54.662346 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826a332-1497-4041-bd5d-c6d1d574c252 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:54.662502 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826a332-1497-4041-bd5d-c6d1d574c252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:54.715509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-8826a332-1497-4041-bd5d-c6d1d574c252 None None] MFA Rules not processed for user `3ae62427d5914e67b5b4d0237ecccd06`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:57:54.716676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-8826a332-1497-4041-bd5d-c6d1d574c252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:57:54.733533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1391/2770] 10.222.0.58 () {58 vars in 967 bytes} [Wed Aug 24 09:57:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:57:54.777091 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1806527-6e4b-494f-bd73-c7f0407138e4 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:57:54.800213 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1806527-6e4b-494f-bd73-c7f0407138e4 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:57:54.805314 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29585f27-530b-4e40-8f8c-03623924685e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2db35b94c84ec7bba96117d23baf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:57:54.805960 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29585f27-530b-4e40-8f8c-03623924685e service swift] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:57:54.806239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29585f27-530b-4e40-8f8c-03623924685e service swift] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:57:54.806511 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29585f27-530b-4e40-8f8c-03623924685e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:57:54.815250 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29585f27-530b-4e40-8f8c-03623924685e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:57:54.816817 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29585f27-530b-4e40-8f8c-03623924685e service swift] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:57:54.825270 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1380/2771] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 09:57:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 09:58:01.557291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826a332-1497-4041-bd5d-c6d1d574c252 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:01.630285 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826a332-1497-4041-bd5d-c6d1d574c252 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:01.634921 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c7587-5766-4c7c-a344-fc5ed87abf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:01.635560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c7587-5766-4c7c-a344-fc5ed87abf0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:01.635843 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c7587-5766-4c7c-a344-fc5ed87abf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:01.636120 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c7587-5766-4c7c-a344-fc5ed87abf0b admin admin] PATH_INFO: `/v3/users/8a1bd12fb1f64a6ba41f7dc58376fccb` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:01.637376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c7587-5766-4c7c-a344-fc5ed87abf0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a1bd12fb1f64a6ba41f7dc58376fccb)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:01.639350 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c7587-5766-4c7c-a344-fc5ed87abf0b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:01.684756 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b14c7587-5766-4c7c-a344-fc5ed87abf0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a1bd12fb1f64a6ba41f7dc58376fccb'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:58:01.685408 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b14c7587-5766-4c7c-a344-fc5ed87abf0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a1bd12fb1f64a6ba41f7dc58376fccb'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:58:01.697505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b14c7587-5766-4c7c-a344-fc5ed87abf0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a1bd12fb1f64a6ba41f7dc58376fccb'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:58:01.705685 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b14c7587-5766-4c7c-a344-fc5ed87abf0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a1bd12fb1f64a6ba41f7dc58376fccb'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:58:01.712972 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b14c7587-5766-4c7c-a344-fc5ed87abf0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a1bd12fb1f64a6ba41f7dc58376fccb'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:58:01.718841 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1392/2772] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:58:01 2022] DELETE /identity/v3/users/8a1bd12fb1f64a6ba41f7dc58376fccb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:58:01.891666 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29585f27-530b-4e40-8f8c-03623924685e service swift] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:01.903213 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29585f27-530b-4e40-8f8c-03623924685e service swift] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:01.962409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661af31-ad02-4183-b912-380c2dba8f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:01.963037 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661af31-ad02-4183-b912-380c2dba8f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:01.963314 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661af31-ad02-4183-b912-380c2dba8f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:01.963589 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661af31-ad02-4183-b912-380c2dba8f80 admin admin] PATH_INFO: `/v3/projects/ceba910b7b534a98999093431d6dd0cb` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:01.964697 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661af31-ad02-4183-b912-380c2dba8f80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceba910b7b534a98999093431d6dd0cb)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:01.966618 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661af31-ad02-4183-b912-380c2dba8f80 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:02.011996 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c661af31-ad02-4183-b912-380c2dba8f80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceba910b7b534a98999093431d6dd0cb', 'request_id': 'req-c661af31-ad02-4183-b912-380c2dba8f80'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:58:02.020526 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c661af31-ad02-4183-b912-380c2dba8f80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceba910b7b534a98999093431d6dd0cb', 'request_id': 'req-c661af31-ad02-4183-b912-380c2dba8f80'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:58:02.026814 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c661af31-ad02-4183-b912-380c2dba8f80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceba910b7b534a98999093431d6dd0cb', 'request_id': 'req-c661af31-ad02-4183-b912-380c2dba8f80'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:58:02.036963 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c661af31-ad02-4183-b912-380c2dba8f80 admin admin] The token cache is being invalidate because project ceba910b7b534a98999093431d6dd0cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:58:02.037259 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c661af31-ad02-4183-b912-380c2dba8f80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:58:02.037940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-c661af31-ad02-4183-b912-380c2dba8f80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:58:02.039442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1381/2773] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:58:01 2022] DELETE /identity/v3/projects/ceba910b7b534a98999093431d6dd0cb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:58:02.043633 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c7587-5766-4c7c-a344-fc5ed87abf0b admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:02.045055 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-b14c7587-5766-4c7c-a344-fc5ed87abf0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:02.058325 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c7587-5766-4c7c-a344-fc5ed87abf0b admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:02.097615 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:58:02.121248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb9dcb-71c4-431b-aba3-2393d1b6322f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:02.121960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb9dcb-71c4-431b-aba3-2393d1b6322f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:02.122270 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb9dcb-71c4-431b-aba3-2393d1b6322f admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:02.122574 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb9dcb-71c4-431b-aba3-2393d1b6322f admin admin] PATH_INFO: `/v3/users/9840d87e28474e2e8caa50d30c14ea85` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:02.123755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb9dcb-71c4-431b-aba3-2393d1b6322f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9840d87e28474e2e8caa50d30c14ea85)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:02.125703 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb9dcb-71c4-431b-aba3-2393d1b6322f admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:02.171758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-9cdb9dcb-71c4-431b-aba3-2393d1b6322f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9840d87e28474e2e8caa50d30c14ea85'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:58:02.172332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-9cdb9dcb-71c4-431b-aba3-2393d1b6322f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9840d87e28474e2e8caa50d30c14ea85'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:58:02.184672 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-9cdb9dcb-71c4-431b-aba3-2393d1b6322f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9840d87e28474e2e8caa50d30c14ea85'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:58:02.192795 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-9cdb9dcb-71c4-431b-aba3-2393d1b6322f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9840d87e28474e2e8caa50d30c14ea85'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:58:02.199786 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-9cdb9dcb-71c4-431b-aba3-2393d1b6322f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9840d87e28474e2e8caa50d30c14ea85'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:58:02.206336 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1393/2774] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 09:58:02 2022] DELETE /identity/v3/users/9840d87e28474e2e8caa50d30c14ea85 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:58:02.379200 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661af31-ad02-4183-b912-380c2dba8f80 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:58:02.381003 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-c661af31-ad02-4183-b912-380c2dba8f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:58:02.398047 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661af31-ad02-4183-b912-380c2dba8f80 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:58:02.454876 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640148a2-2a26-4e81-b3e2-1ce08c4509d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:58:02.455463 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640148a2-2a26-4e81-b3e2-1ce08c4509d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:58:02.455759 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640148a2-2a26-4e81-b3e2-1ce08c4509d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:58:02.456014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640148a2-2a26-4e81-b3e2-1ce08c4509d6 admin admin] PATH_INFO: `/v3/projects/c128b7d80c8d4ea5be7a58aff1bf4893` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:58:02.457135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640148a2-2a26-4e81-b3e2-1ce08c4509d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c128b7d80c8d4ea5be7a58aff1bf4893)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:58:02.459174 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640148a2-2a26-4e81-b3e2-1ce08c4509d6 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:58:02.469625 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:58:02.507540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-640148a2-2a26-4e81-b3e2-1ce08c4509d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c128b7d80c8d4ea5be7a58aff1bf4893', 'request_id': 'req-640148a2-2a26-4e81-b3e2-1ce08c4509d6'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:58:02.513957 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-640148a2-2a26-4e81-b3e2-1ce08c4509d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c128b7d80c8d4ea5be7a58aff1bf4893', 'request_id': 'req-640148a2-2a26-4e81-b3e2-1ce08c4509d6'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:58:02.520965 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-640148a2-2a26-4e81-b3e2-1ce08c4509d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c128b7d80c8d4ea5be7a58aff1bf4893', 'request_id': 'req-640148a2-2a26-4e81-b3e2-1ce08c4509d6'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:58:02.531294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-640148a2-2a26-4e81-b3e2-1ce08c4509d6 admin admin] The token cache is being invalidate because project c128b7d80c8d4ea5be7a58aff1bf4893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:58:02.531584 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-640148a2-2a26-4e81-b3e2-1ce08c4509d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:58:02.532213 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-640148a2-2a26-4e81-b3e2-1ce08c4509d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:58:02.534240 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1382/2775] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 09:58:02 2022] DELETE /identity/v3/projects/c128b7d80c8d4ea5be7a58aff1bf4893 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:58:12.202503 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:58:12.528325 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:59:01.447537 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb9dcb-71c4-431b-aba3-2393d1b6322f admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:59:01.448942 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-9cdb9dcb-71c4-431b-aba3-2393d1b6322f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:59:01.518047 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb9dcb-71c4-431b-aba3-2393d1b6322f admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:59:01.576620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b8e46-1a33-463d-94b9-1042badd0d4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983e364f5564ed7854dff06a80f55d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:59:01.577913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b8e46-1a33-463d-94b9-1042badd0d4f service placement] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:01.578203 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b8e46-1a33-463d-94b9-1042badd0d4f service placement] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:01.578483 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b8e46-1a33-463d-94b9-1042badd0d4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:01.580269 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-365b8e46-1a33-463d-94b9-1042badd0d4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:59:01.591841 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b8e46-1a33-463d-94b9-1042badd0d4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:59:01.594225 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b8e46-1a33-463d-94b9-1042badd0d4f service placement] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:59:01.604158 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1394/2776] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:59:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:59:11.599911 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=58 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:59:21.272183 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640148a2-2a26-4e81-b3e2-1ce08c4509d6 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:59:21.273827 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-640148a2-2a26-4e81-b3e2-1ce08c4509d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:59:21.331575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640148a2-2a26-4e81-b3e2-1ce08c4509d6 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:59:21.335412 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3baff3-ae22-4dc2-ae4c-af260a93021d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:59:21.336064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3baff3-ae22-4dc2-ae4c-af260a93021d service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:21.336342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3baff3-ae22-4dc2-ae4c-af260a93021d service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:21.336614 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3baff3-ae22-4dc2-ae4c-af260a93021d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:21.338389 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-3a3baff3-ae22-4dc2-ae4c-af260a93021d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:59:21.401920 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3baff3-ae22-4dc2-ae4c-af260a93021d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:59:21.403272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3baff3-ae22-4dc2-ae4c-af260a93021d service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:59:21.412744 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1383/2777] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 09:59:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:59:22.719525 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e1538-89f1-4d1c-9c7e-c5c06840579c None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:59:22.720029 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e1538-89f1-4d1c-9c7e-c5c06840579c None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:59:22.720130 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e1538-89f1-4d1c-9c7e-c5c06840579c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:59:22.739088 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-eb2e1538-89f1-4d1c-9c7e-c5c06840579c None None] MFA Rules not processed for user `abee6130ef13424bb8ac4d7334407a78`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:59:22.740297 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-eb2e1538-89f1-4d1c-9c7e-c5c06840579c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:59:22.747200 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1395/2778] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 09:59:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:59:31.408711 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=48 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:59:32.734340 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:00:49.499537 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3baff3-ae22-4dc2-ae4c-af260a93021d service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:49.500924 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-3a3baff3-ae22-4dc2-ae4c-af260a93021d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:49.562492 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3baff3-ae22-4dc2-ae4c-af260a93021d service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:49.566294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8754a-7fde-4550-b135-f9b5eecd4be8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:49.566900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8754a-7fde-4550-b135-f9b5eecd4be8 service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:49.567182 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8754a-7fde-4550-b135-f9b5eecd4be8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:49.567460 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8754a-7fde-4550-b135-f9b5eecd4be8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:49.569222 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-94c8754a-7fde-4550-b135-f9b5eecd4be8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:49.640460 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8754a-7fde-4550-b135-f9b5eecd4be8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:49.641913 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8754a-7fde-4550-b135-f9b5eecd4be8 service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:49.652744 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1384/2779] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:52.259927 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e1538-89f1-4d1c-9c7e-c5c06840579c None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:00:52.261437 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-eb2e1538-89f1-4d1c-9c7e-c5c06840579c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:52.274310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e1538-89f1-4d1c-9c7e-c5c06840579c None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:00:52.277932 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688f0cd-3cd4-4cc0-a24c-d67609fea33d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:00:52.278531 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688f0cd-3cd4-4cc0-a24c-d67609fea33d service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:00:52.278817 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688f0cd-3cd4-4cc0-a24c-d67609fea33d service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:00:52.279158 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688f0cd-3cd4-4cc0-a24c-d67609fea33d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:00:52.281061 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-6688f0cd-3cd4-4cc0-a24c-d67609fea33d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:00:52.294690 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688f0cd-3cd4-4cc0-a24c-d67609fea33d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:00:52.296848 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688f0cd-3cd4-4cc0-a24c-d67609fea33d service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:00:52.308091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1396/2780] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:00:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:00:59.648006 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=54 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:02.302959 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=6 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:02.858870 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8754a-7fde-4550-b135-f9b5eecd4be8 service cinder] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:02.860349 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-94c8754a-7fde-4550-b135-f9b5eecd4be8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:02.871588 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8754a-7fde-4550-b135-f9b5eecd4be8 service cinder] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:02.875141 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2a344-6d1f-4d1b-9794-07d04326c46d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:02.875723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2a344-6d1f-4d1b-9794-07d04326c46d service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:02.875992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2a344-6d1f-4d1b-9794-07d04326c46d service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:02.876263 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2a344-6d1f-4d1b-9794-07d04326c46d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:02.877931 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-80b2a344-6d1f-4d1b-9794-07d04326c46d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:02.940589 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2a344-6d1f-4d1b-9794-07d04326c46d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:02.942049 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2a344-6d1f-4d1b-9794-07d04326c46d service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:02.951313 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1385/2781] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:05.789283 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688f0cd-3cd4-4cc0-a24c-d67609fea33d service cinder] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:05.790761 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-6688f0cd-3cd4-4cc0-a24c-d67609fea33d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:05.810720 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688f0cd-3cd4-4cc0-a24c-d67609fea33d service cinder] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:05.817048 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8f216-a8ac-4ab2-bfb6-4565d78a929d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983e364f5564ed7854dff06a80f55d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:05.817703 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8f216-a8ac-4ab2-bfb6-4565d78a929d service placement] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:05.817987 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8f216-a8ac-4ab2-bfb6-4565d78a929d service placement] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:05.818261 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8f216-a8ac-4ab2-bfb6-4565d78a929d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:05.820092 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-5ce8f216-a8ac-4ab2-bfb6-4565d78a929d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:05.834880 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8f216-a8ac-4ab2-bfb6-4565d78a929d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:05.837017 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8f216-a8ac-4ab2-bfb6-4565d78a929d service placement] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:05.850755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1397/2782] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:05.864392 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2a344-6d1f-4d1b-9794-07d04326c46d service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:05.865886 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-80b2a344-6d1f-4d1b-9794-07d04326c46d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:05.887233 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2a344-6d1f-4d1b-9794-07d04326c46d service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:05.892671 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72786549-ad43-452d-9269-e6f726093b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:05.893313 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72786549-ad43-452d-9269-e6f726093b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:05.893630 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72786549-ad43-452d-9269-e6f726093b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:05.893937 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72786549-ad43-452d-9269-e6f726093b6a admin admin] PATH_INFO: `/v3/users/abee6130ef13424bb8ac4d7334407a78` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:05.895086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72786549-ad43-452d-9269-e6f726093b6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=abee6130ef13424bb8ac4d7334407a78)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:05.897017 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72786549-ad43-452d-9269-e6f726093b6a admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:05.951239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-72786549-ad43-452d-9269-e6f726093b6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abee6130ef13424bb8ac4d7334407a78'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:05.952012 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-72786549-ad43-452d-9269-e6f726093b6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abee6130ef13424bb8ac4d7334407a78'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:05.952734 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-72786549-ad43-452d-9269-e6f726093b6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abee6130ef13424bb8ac4d7334407a78'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:05.965545 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-72786549-ad43-452d-9269-e6f726093b6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abee6130ef13424bb8ac4d7334407a78'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:05.973608 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-72786549-ad43-452d-9269-e6f726093b6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abee6130ef13424bb8ac4d7334407a78'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:05.985972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1386/2783] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:05 2022] DELETE /identity/v3/users/abee6130ef13424bb8ac4d7334407a78 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:06.159747 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8f216-a8ac-4ab2-bfb6-4565d78a929d service placement] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:06.170423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8f216-a8ac-4ab2-bfb6-4565d78a929d service placement] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:06.229031 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4310bb-2af0-4cb9-b179-45dfdb9eb571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:06.229708 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4310bb-2af0-4cb9-b179-45dfdb9eb571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:06.229986 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4310bb-2af0-4cb9-b179-45dfdb9eb571 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:06.230260 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4310bb-2af0-4cb9-b179-45dfdb9eb571 admin admin] PATH_INFO: `/v3/projects/dee0f95aab1a448c84d047c80d1fe9de` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:06.231397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4310bb-2af0-4cb9-b179-45dfdb9eb571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dee0f95aab1a448c84d047c80d1fe9de)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:06.233270 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4310bb-2af0-4cb9-b179-45dfdb9eb571 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:06.280452 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3e4310bb-2af0-4cb9-b179-45dfdb9eb571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dee0f95aab1a448c84d047c80d1fe9de', 'request_id': 'req-3e4310bb-2af0-4cb9-b179-45dfdb9eb571'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:06.287217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3e4310bb-2af0-4cb9-b179-45dfdb9eb571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dee0f95aab1a448c84d047c80d1fe9de', 'request_id': 'req-3e4310bb-2af0-4cb9-b179-45dfdb9eb571'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:06.293573 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3e4310bb-2af0-4cb9-b179-45dfdb9eb571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dee0f95aab1a448c84d047c80d1fe9de', 'request_id': 'req-3e4310bb-2af0-4cb9-b179-45dfdb9eb571'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:06.304013 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3e4310bb-2af0-4cb9-b179-45dfdb9eb571 admin admin] The token cache is being invalidate because project dee0f95aab1a448c84d047c80d1fe9de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:06.304302 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3e4310bb-2af0-4cb9-b179-45dfdb9eb571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:06.304938 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-3e4310bb-2af0-4cb9-b179-45dfdb9eb571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:06.306471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1398/2784] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:06 2022] DELETE /identity/v3/projects/dee0f95aab1a448c84d047c80d1fe9de => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:06.311425 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c7e9b-501c-44b4-87d3-40071ad9dde9 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:06.311713 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c7e9b-501c-44b4-87d3-40071ad9dde9 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:06.311992 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c7e9b-501c-44b4-87d3-40071ad9dde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:06.332594 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-d28c7e9b-501c-44b4-87d3-40071ad9dde9 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:06.333832 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-d28c7e9b-501c-44b4-87d3-40071ad9dde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:06.392585 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1387/2785] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:06.400577 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad399a3-7148-4b9e-ad36-fad180bf0de5 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:06.400861 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad399a3-7148-4b9e-ad36-fad180bf0de5 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:06.401138 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad399a3-7148-4b9e-ad36-fad180bf0de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:06.422008 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-2ad399a3-7148-4b9e-ad36-fad180bf0de5 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:06.423263 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-2ad399a3-7148-4b9e-ad36-fad180bf0de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:06.431206 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1399/2786] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:06.435293 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c7e9b-501c-44b4-87d3-40071ad9dde9 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:06.445794 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c7e9b-501c-44b4-87d3-40071ad9dde9 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:06.450505 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc5cbc-af74-407a-86c1-9bf56ffd7891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:06.451101 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc5cbc-af74-407a-86c1-9bf56ffd7891 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:06.451378 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc5cbc-af74-407a-86c1-9bf56ffd7891 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:06.451651 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc5cbc-af74-407a-86c1-9bf56ffd7891 admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:06.452296 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc5cbc-af74-407a-86c1-9bf56ffd7891 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:01:06.452599 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc5cbc-af74-407a-86c1-9bf56ffd7891 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:06.455032 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc5cbc-af74-407a-86c1-9bf56ffd7891 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:06.456568 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:06.472396 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1388/2787] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 10:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:01:06.473577 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad399a3-7148-4b9e-ad36-fad180bf0de5 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:06.482872 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad399a3-7148-4b9e-ad36-fad180bf0de5 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:06.488034 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d61fe9-c6f8-4943-984c-0b7daaccc8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:06.488629 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d61fe9-c6f8-4943-984c-0b7daaccc8b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:06.488904 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d61fe9-c6f8-4943-984c-0b7daaccc8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:06.489173 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d61fe9-c6f8-4943-984c-0b7daaccc8b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:06.489907 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d61fe9-c6f8-4943-984c-0b7daaccc8b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:06.491775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d61fe9-c6f8-4943-984c-0b7daaccc8b4 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:06.527222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1400/2788] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 10:01:06 2022] POST /identity/v3/projects => generated 403 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:06.532203 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc5cbc-af74-407a-86c1-9bf56ffd7891 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:06.542074 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc5cbc-af74-407a-86c1-9bf56ffd7891 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:06.598017 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8de65-9ec8-4edb-990b-7d63f228d59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:06.598617 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8de65-9ec8-4edb-990b-7d63f228d59d admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:06.598897 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8de65-9ec8-4edb-990b-7d63f228d59d admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:06.599173 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8de65-9ec8-4edb-990b-7d63f228d59d admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:06.599801 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8de65-9ec8-4edb-990b-7d63f228d59d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:06.601720 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8de65-9ec8-4edb-990b-7d63f228d59d admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:06.621944 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1389/2789] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 10:01:06 2022] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:06.626185 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d61fe9-c6f8-4943-984c-0b7daaccc8b4 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:06.636505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d61fe9-c6f8-4943-984c-0b7daaccc8b4 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:06.641858 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b391d0-23b3-4642-9c64-b30723f60eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:06.642495 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b391d0-23b3-4642-9c64-b30723f60eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:06.642782 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b391d0-23b3-4642-9c64-b30723f60eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:06.643066 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b391d0-23b3-4642-9c64-b30723f60eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:06.643708 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b391d0-23b3-4642-9c64-b30723f60eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:06.645363 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b391d0-23b3-4642-9c64-b30723f60eb2 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:06.655758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1401/2790] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:06.660120 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8de65-9ec8-4edb-990b-7d63f228d59d admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:06.670072 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8de65-9ec8-4edb-990b-7d63f228d59d admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:06.674702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a53c1-5c57-4bbb-bdfd-5916b894ca40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:06.675287 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a53c1-5c57-4bbb-bdfd-5916b894ca40 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:06.675582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a53c1-5c57-4bbb-bdfd-5916b894ca40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:06.675840 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a53c1-5c57-4bbb-bdfd-5916b894ca40 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:06.676475 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a53c1-5c57-4bbb-bdfd-5916b894ca40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:06.678124 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a53c1-5c57-4bbb-bdfd-5916b894ca40 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:06.688771 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1390/2791] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:06.692777 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b391d0-23b3-4642-9c64-b30723f60eb2 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:06.703726 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b391d0-23b3-4642-9c64-b30723f60eb2 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:06.708699 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf41d6-abde-4dec-bc2a-91066e97ba9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:06.709340 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf41d6-abde-4dec-bc2a-91066e97ba9b admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:06.709656 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf41d6-abde-4dec-bc2a-91066e97ba9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:06.709933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf41d6-abde-4dec-bc2a-91066e97ba9b admin admin] PATH_INFO: `/v3/projects/9e31991209db44dc871af391b9576ff5/users/531a977dd72c4e6bb59acd37aee747d6/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:06.725778 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf41d6-abde-4dec-bc2a-91066e97ba9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e31991209db44dc871af391b9576ff5, user_id=531a977dd72c4e6bb59acd37aee747d6, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:06.728420 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf41d6-abde-4dec-bc2a-91066e97ba9b admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:06.741517 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1402/2792] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:06 2022] PUT /identity/v3/projects/9e31991209db44dc871af391b9576ff5/users/531a977dd72c4e6bb59acd37aee747d6/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:06.746753 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f038b77-78a3-4f42-ae88-761601a3d3e1 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:06.747061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f038b77-78a3-4f42-ae88-761601a3d3e1 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:06.747337 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f038b77-78a3-4f42-ae88-761601a3d3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:06.766472 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-6f038b77-78a3-4f42-ae88-761601a3d3e1 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:06.767681 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-6f038b77-78a3-4f42-ae88-761601a3d3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:06.825848 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1391/2793] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:06.836171 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf41d6-abde-4dec-bc2a-91066e97ba9b admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:06.837960 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-11bf41d6-abde-4dec-bc2a-91066e97ba9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:06.845295 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:06.897562 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf41d6-abde-4dec-bc2a-91066e97ba9b admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:06.901241 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059bd7b-37fc-4c0c-8baf-cafc3d5553ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:06.901868 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059bd7b-37fc-4c0c-8baf-cafc3d5553ce service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:06.902145 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059bd7b-37fc-4c0c-8baf-cafc3d5553ce service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:06.902414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059bd7b-37fc-4c0c-8baf-cafc3d5553ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:06.912305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059bd7b-37fc-4c0c-8baf-cafc3d5553ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:06.913738 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059bd7b-37fc-4c0c-8baf-cafc3d5553ce service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:06.923560 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1403/2794] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:07.525201 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d1c20-0160-49ab-9d0a-e93a3db674eb None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:07.525757 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d1c20-0160-49ab-9d0a-e93a3db674eb None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:07.525872 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d1c20-0160-49ab-9d0a-e93a3db674eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:07.555448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-752d1c20-0160-49ab-9d0a-e93a3db674eb None None] MFA Rules not processed for user `531a977dd72c4e6bb59acd37aee747d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:07.556755 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-752d1c20-0160-49ab-9d0a-e93a3db674eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:07.626078 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1392/2795] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:07 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:07.630556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059bd7b-37fc-4c0c-8baf-cafc3d5553ce service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:07.640545 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059bd7b-37fc-4c0c-8baf-cafc3d5553ce service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:07.645902 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a8ecc-7f45-4b2c-b692-6baed2a7bdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:07.646521 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a8ecc-7f45-4b2c-b692-6baed2a7bdd7 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:07.646797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a8ecc-7f45-4b2c-b692-6baed2a7bdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:07.647065 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a8ecc-7f45-4b2c-b692-6baed2a7bdd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:07.647677 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a8ecc-7f45-4b2c-b692-6baed2a7bdd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:07.649664 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a8ecc-7f45-4b2c-b692-6baed2a7bdd7 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:07.680461 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1404/2796] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 10:01:07 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:01:07.681908 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d1c20-0160-49ab-9d0a-e93a3db674eb None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:07.687546 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:07.700759 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d1c20-0160-49ab-9d0a-e93a3db674eb None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:07.761205 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb859d2d-60e6-4060-b9ef-d3462b946b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:07.761852 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859d2d-60e6-4060-b9ef-d3462b946b89 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:07.762135 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859d2d-60e6-4060-b9ef-d3462b946b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:07.762409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859d2d-60e6-4060-b9ef-d3462b946b89 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:07.763051 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb859d2d-60e6-4060-b9ef-d3462b946b89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:07.764960 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb859d2d-60e6-4060-b9ef-d3462b946b89 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:07.787684 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1393/2797] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 10:01:07 2022] POST /identity/v3/users => generated 308 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:01:07.791722 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a8ecc-7f45-4b2c-b692-6baed2a7bdd7 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:07.802675 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a8ecc-7f45-4b2c-b692-6baed2a7bdd7 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:07.807257 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa7fe7-d2be-463d-82b8-78251c61f588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:07.807851 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa7fe7-d2be-463d-82b8-78251c61f588 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:07.808125 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa7fe7-d2be-463d-82b8-78251c61f588 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:07.808396 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa7fe7-d2be-463d-82b8-78251c61f588 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:07.809026 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa7fe7-d2be-463d-82b8-78251c61f588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:07.810634 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa7fe7-d2be-463d-82b8-78251c61f588 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:07.821238 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1405/2798] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:07.825313 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb859d2d-60e6-4060-b9ef-d3462b946b89 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:07.835675 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb859d2d-60e6-4060-b9ef-d3462b946b89 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:07.840391 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a1e16-168c-4222-89e9-9aa288cedd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:07.841037 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a1e16-168c-4222-89e9-9aa288cedd8c admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:07.841320 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a1e16-168c-4222-89e9-9aa288cedd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:07.841642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a1e16-168c-4222-89e9-9aa288cedd8c admin admin] PATH_INFO: `/v3/projects/012a75225e474cd3b5e93f41862960dc/users/663fd8be3abf4222bf28dc395d44cdd1/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:07.857993 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a1e16-168c-4222-89e9-9aa288cedd8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=012a75225e474cd3b5e93f41862960dc, user_id=663fd8be3abf4222bf28dc395d44cdd1, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:07.861616 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a1e16-168c-4222-89e9-9aa288cedd8c admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:07.876386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1394/2799] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:07 2022] PUT /identity/v3/projects/012a75225e474cd3b5e93f41862960dc/users/663fd8be3abf4222bf28dc395d44cdd1/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:01:07.880404 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa7fe7-d2be-463d-82b8-78251c61f588 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:07.894620 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa7fe7-d2be-463d-82b8-78251c61f588 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:07.952968 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024b916-885d-4b61-9d0c-03eae5f0638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:07.953455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024b916-885d-4b61-9d0c-03eae5f0638d admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:07.953770 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024b916-885d-4b61-9d0c-03eae5f0638d admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:07.954049 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024b916-885d-4b61-9d0c-03eae5f0638d admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:07.954685 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d024b916-885d-4b61-9d0c-03eae5f0638d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:07.956298 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d024b916-885d-4b61-9d0c-03eae5f0638d admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:07.966213 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1406/2800] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:07.971050 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a1e16-168c-4222-89e9-9aa288cedd8c admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:07.981675 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a1e16-168c-4222-89e9-9aa288cedd8c admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:07.986815 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b2fff-2c4f-45b5-896a-143143023a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:07.987457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b2fff-2c4f-45b5-896a-143143023a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:07.987736 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b2fff-2c4f-45b5-896a-143143023a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:07.988014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b2fff-2c4f-45b5-896a-143143023a2a admin admin] PATH_INFO: `/v3/projects/012a75225e474cd3b5e93f41862960dc/users/663fd8be3abf4222bf28dc395d44cdd1/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:07.989971 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b2fff-2c4f-45b5-896a-143143023a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=012a75225e474cd3b5e93f41862960dc, user_id=663fd8be3abf4222bf28dc395d44cdd1, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:07.992578 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b2fff-2c4f-45b5-896a-143143023a2a admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:08.004597 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1395/2801] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:07 2022] PUT /identity/v3/projects/012a75225e474cd3b5e93f41862960dc/users/663fd8be3abf4222bf28dc395d44cdd1/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:08.613340 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54513214-131b-42e2-88f5-8c210a07e02b None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:08.613667 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54513214-131b-42e2-88f5-8c210a07e02b None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:08.614161 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54513214-131b-42e2-88f5-8c210a07e02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:08.642973 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-54513214-131b-42e2-88f5-8c210a07e02b None None] MFA Rules not processed for user `663fd8be3abf4222bf28dc395d44cdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:08.644565 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-54513214-131b-42e2-88f5-8c210a07e02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:08.707800 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:08.718251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1407/2802] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:08 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:09.173797 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b2fff-2c4f-45b5-896a-143143023a2a admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:09.175720 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ca1b2fff-2c4f-45b5-896a-143143023a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:09.253008 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b2fff-2c4f-45b5-896a-143143023a2a admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:09.257961 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530de311-77e1-4d79-b2b9-680e0f2fb248 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983e364f5564ed7854dff06a80f55d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:09.258558 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530de311-77e1-4d79-b2b9-680e0f2fb248 service placement] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:09.258875 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530de311-77e1-4d79-b2b9-680e0f2fb248 service placement] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:09.259144 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530de311-77e1-4d79-b2b9-680e0f2fb248 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:09.260885 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-530de311-77e1-4d79-b2b9-680e0f2fb248 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:09.272656 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530de311-77e1-4d79-b2b9-680e0f2fb248 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:09.274262 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530de311-77e1-4d79-b2b9-680e0f2fb248 service placement] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:09.285641 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1396/2803] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:09.756676 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54513214-131b-42e2-88f5-8c210a07e02b None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:09.824471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54513214-131b-42e2-88f5-8c210a07e02b None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:09.829692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bbf0e-1f29-4333-a0b8-6632c5441c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:09.830316 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bbf0e-1f29-4333-a0b8-6632c5441c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:09.830590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bbf0e-1f29-4333-a0b8-6632c5441c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:09.830860 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bbf0e-1f29-4333-a0b8-6632c5441c5f admin admin] PATH_INFO: `/v3/users/531a977dd72c4e6bb59acd37aee747d6` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:09.832215 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3bbf0e-1f29-4333-a0b8-6632c5441c5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=531a977dd72c4e6bb59acd37aee747d6)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:09.834133 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3bbf0e-1f29-4333-a0b8-6632c5441c5f admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:09.879408 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-6f3bbf0e-1f29-4333-a0b8-6632c5441c5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '531a977dd72c4e6bb59acd37aee747d6'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:09.880054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-6f3bbf0e-1f29-4333-a0b8-6632c5441c5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '531a977dd72c4e6bb59acd37aee747d6'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:09.893274 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-6f3bbf0e-1f29-4333-a0b8-6632c5441c5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '531a977dd72c4e6bb59acd37aee747d6'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:09.899967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-6f3bbf0e-1f29-4333-a0b8-6632c5441c5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '531a977dd72c4e6bb59acd37aee747d6'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:09.907225 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-6f3bbf0e-1f29-4333-a0b8-6632c5441c5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '531a977dd72c4e6bb59acd37aee747d6'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:09.913110 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1408/2804] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:09 2022] DELETE /identity/v3/users/531a977dd72c4e6bb59acd37aee747d6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:10.095089 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530de311-77e1-4d79-b2b9-680e0f2fb248 service placement] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:10.106800 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530de311-77e1-4d79-b2b9-680e0f2fb248 service placement] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:10.149962 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:10.166292 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b072b-f7f9-4cc3-8840-c87e0036b18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:10.166923 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b072b-f7f9-4cc3-8840-c87e0036b18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:10.167204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b072b-f7f9-4cc3-8840-c87e0036b18c admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:10.167480 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b072b-f7f9-4cc3-8840-c87e0036b18c admin admin] PATH_INFO: `/v3/projects/9e31991209db44dc871af391b9576ff5` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:10.168607 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b072b-f7f9-4cc3-8840-c87e0036b18c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e31991209db44dc871af391b9576ff5)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:10.170539 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b072b-f7f9-4cc3-8840-c87e0036b18c admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:10.216170 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-334b072b-f7f9-4cc3-8840-c87e0036b18c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e31991209db44dc871af391b9576ff5', 'request_id': 'req-334b072b-f7f9-4cc3-8840-c87e0036b18c'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.224702 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-334b072b-f7f9-4cc3-8840-c87e0036b18c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e31991209db44dc871af391b9576ff5', 'request_id': 'req-334b072b-f7f9-4cc3-8840-c87e0036b18c'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.231064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-334b072b-f7f9-4cc3-8840-c87e0036b18c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e31991209db44dc871af391b9576ff5', 'request_id': 'req-334b072b-f7f9-4cc3-8840-c87e0036b18c'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.242448 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-334b072b-f7f9-4cc3-8840-c87e0036b18c admin admin] The token cache is being invalidate because project 9e31991209db44dc871af391b9576ff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:10.242741 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-334b072b-f7f9-4cc3-8840-c87e0036b18c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.243407 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-334b072b-f7f9-4cc3-8840-c87e0036b18c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.245179 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1397/2805] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:10 2022] DELETE /identity/v3/projects/9e31991209db44dc871af391b9576ff5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:10.248859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bbf0e-1f29-4333-a0b8-6632c5441c5f admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:10.250337 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-6f3bbf0e-1f29-4333-a0b8-6632c5441c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:10.263857 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bbf0e-1f29-4333-a0b8-6632c5441c5f admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:10.321428 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258ed0c-ce32-4ffa-985f-5309f93f7ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:10.322078 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258ed0c-ce32-4ffa-985f-5309f93f7ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:10.322355 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258ed0c-ce32-4ffa-985f-5309f93f7ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:10.322626 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258ed0c-ce32-4ffa-985f-5309f93f7ec6 admin admin] PATH_INFO: `/v3/users/663fd8be3abf4222bf28dc395d44cdd1` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:10.323746 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258ed0c-ce32-4ffa-985f-5309f93f7ec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=663fd8be3abf4222bf28dc395d44cdd1)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:10.325671 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258ed0c-ce32-4ffa-985f-5309f93f7ec6 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:10.342271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:10.372117 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b258ed0c-ce32-4ffa-985f-5309f93f7ec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '663fd8be3abf4222bf28dc395d44cdd1'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.372765 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b258ed0c-ce32-4ffa-985f-5309f93f7ec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '663fd8be3abf4222bf28dc395d44cdd1'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.384924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b258ed0c-ce32-4ffa-985f-5309f93f7ec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '663fd8be3abf4222bf28dc395d44cdd1'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.392085 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b258ed0c-ce32-4ffa-985f-5309f93f7ec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '663fd8be3abf4222bf28dc395d44cdd1'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.399176 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-b258ed0c-ce32-4ffa-985f-5309f93f7ec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '663fd8be3abf4222bf28dc395d44cdd1'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.405101 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1409/2806] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:10 2022] DELETE /identity/v3/users/663fd8be3abf4222bf28dc395d44cdd1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:10.578747 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b072b-f7f9-4cc3-8840-c87e0036b18c admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:10.580547 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-334b072b-f7f9-4cc3-8840-c87e0036b18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:10.595541 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b072b-f7f9-4cc3-8840-c87e0036b18c admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:10.655305 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e195ac2-d518-47d0-89ac-af9f23304636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:10.655862 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e195ac2-d518-47d0-89ac-af9f23304636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:10.656146 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e195ac2-d518-47d0-89ac-af9f23304636 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:10.656424 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e195ac2-d518-47d0-89ac-af9f23304636 admin admin] PATH_INFO: `/v3/projects/012a75225e474cd3b5e93f41862960dc` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:10.657588 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e195ac2-d518-47d0-89ac-af9f23304636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=012a75225e474cd3b5e93f41862960dc)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:10.659502 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e195ac2-d518-47d0-89ac-af9f23304636 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:10.707439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-8e195ac2-d518-47d0-89ac-af9f23304636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '012a75225e474cd3b5e93f41862960dc', 'request_id': 'req-8e195ac2-d518-47d0-89ac-af9f23304636'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.714360 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-8e195ac2-d518-47d0-89ac-af9f23304636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '012a75225e474cd3b5e93f41862960dc', 'request_id': 'req-8e195ac2-d518-47d0-89ac-af9f23304636'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.720863 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-8e195ac2-d518-47d0-89ac-af9f23304636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '012a75225e474cd3b5e93f41862960dc', 'request_id': 'req-8e195ac2-d518-47d0-89ac-af9f23304636'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.731074 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-8e195ac2-d518-47d0-89ac-af9f23304636 admin admin] The token cache is being invalidate because project 012a75225e474cd3b5e93f41862960dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:10.731363 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-8e195ac2-d518-47d0-89ac-af9f23304636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.731997 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-8e195ac2-d518-47d0-89ac-af9f23304636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:10.733497 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1398/2807] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:10 2022] DELETE /identity/v3/projects/012a75225e474cd3b5e93f41862960dc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:10.738599 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac218642-9dda-47de-8905-455936d8b448 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:10.738942 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac218642-9dda-47de-8905-455936d8b448 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:10.739223 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac218642-9dda-47de-8905-455936d8b448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:10.760706 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-ac218642-9dda-47de-8905-455936d8b448 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:10.761939 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-ac218642-9dda-47de-8905-455936d8b448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:10.821484 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1410/2808] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:10.829713 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2384c-ecbe-46e7-8449-fd97ee1b8384 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:10.829999 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2384c-ecbe-46e7-8449-fd97ee1b8384 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:10.830274 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2384c-ecbe-46e7-8449-fd97ee1b8384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:10.839188 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:10.851899 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-ebb2384c-ecbe-46e7-8449-fd97ee1b8384 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:10.853314 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ebb2384c-ecbe-46e7-8449-fd97ee1b8384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:10.861255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1399/2809] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:10.865516 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac218642-9dda-47de-8905-455936d8b448 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:10.876103 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac218642-9dda-47de-8905-455936d8b448 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:10.880692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182e724-3f07-4c13-8f25-8567bc6ad2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:10.881291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182e724-3f07-4c13-8f25-8567bc6ad2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:10.881605 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182e724-3f07-4c13-8f25-8567bc6ad2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:10.881910 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182e724-3f07-4c13-8f25-8567bc6ad2a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:10.882559 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182e724-3f07-4c13-8f25-8567bc6ad2a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:01:10.882863 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182e724-3f07-4c13-8f25-8567bc6ad2a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:10.884436 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182e724-3f07-4c13-8f25-8567bc6ad2a9 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:10.896565 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1411/2810] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 10:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:01:10.900776 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2384c-ecbe-46e7-8449-fd97ee1b8384 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:10.910827 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2384c-ecbe-46e7-8449-fd97ee1b8384 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:10.915418 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13db1e-0840-43c5-a784-255e12e1375b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:10.916004 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13db1e-0840-43c5-a784-255e12e1375b admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:10.916284 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13db1e-0840-43c5-a784-255e12e1375b admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:10.916561 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13db1e-0840-43c5-a784-255e12e1375b admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:10.917183 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13db1e-0840-43c5-a784-255e12e1375b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:10.919104 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13db1e-0840-43c5-a784-255e12e1375b admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:10.946573 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1400/2811] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 10:01:10 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:10.954557 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182e724-3f07-4c13-8f25-8567bc6ad2a9 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:10.965198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182e724-3f07-4c13-8f25-8567bc6ad2a9 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:11.021824 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213403da-af21-4a62-a5b7-4fa16339e8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:11.022430 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213403da-af21-4a62-a5b7-4fa16339e8ef admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.022705 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213403da-af21-4a62-a5b7-4fa16339e8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.022978 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213403da-af21-4a62-a5b7-4fa16339e8ef admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.023606 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213403da-af21-4a62-a5b7-4fa16339e8ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:11.025536 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213403da-af21-4a62-a5b7-4fa16339e8ef admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:11.045538 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1412/2812] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 10:01:10 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:11.050381 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13db1e-0840-43c5-a784-255e12e1375b admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:11.060652 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13db1e-0840-43c5-a784-255e12e1375b admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:11.065801 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7de326-ac7b-4813-8905-d8c0c7fea0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:11.066395 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7de326-ac7b-4813-8905-d8c0c7fea0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.066674 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7de326-ac7b-4813-8905-d8c0c7fea0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.066947 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7de326-ac7b-4813-8905-d8c0c7fea0a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.067579 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7de326-ac7b-4813-8905-d8c0c7fea0a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:11.069160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7de326-ac7b-4813-8905-d8c0c7fea0a8 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:11.084691 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1401/2813] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:11.088618 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213403da-af21-4a62-a5b7-4fa16339e8ef admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:11.098931 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213403da-af21-4a62-a5b7-4fa16339e8ef admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:11.103642 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705928b-240e-4969-9b99-6d8eaa10c09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:11.104240 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705928b-240e-4969-9b99-6d8eaa10c09c admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.104526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705928b-240e-4969-9b99-6d8eaa10c09c admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.104890 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705928b-240e-4969-9b99-6d8eaa10c09c admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.105584 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705928b-240e-4969-9b99-6d8eaa10c09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:11.107168 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705928b-240e-4969-9b99-6d8eaa10c09c admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:11.112975 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:11.119299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1413/2814] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:11.123241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7de326-ac7b-4813-8905-d8c0c7fea0a8 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:11.133857 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7de326-ac7b-4813-8905-d8c0c7fea0a8 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:11.138674 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81614a61-8eb8-48a7-b5ae-1b7a90d3c0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:11.139324 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81614a61-8eb8-48a7-b5ae-1b7a90d3c0f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.139606 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81614a61-8eb8-48a7-b5ae-1b7a90d3c0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.139881 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81614a61-8eb8-48a7-b5ae-1b7a90d3c0f2 admin admin] PATH_INFO: `/v3/projects/c2d6e3a9eaf141d59dfebcdd796047a7/users/df689e92de0949289f2537eb273a244f/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.154179 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81614a61-8eb8-48a7-b5ae-1b7a90d3c0f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d6e3a9eaf141d59dfebcdd796047a7, user_id=df689e92de0949289f2537eb273a244f, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:11.157700 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81614a61-8eb8-48a7-b5ae-1b7a90d3c0f2 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:11.170024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1402/2815] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:11 2022] PUT /identity/v3/projects/c2d6e3a9eaf141d59dfebcdd796047a7/users/df689e92de0949289f2537eb273a244f/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:01:11.181165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1711aae-7b58-4359-b040-0462ef72ff81 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.181450 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1711aae-7b58-4359-b040-0462ef72ff81 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.181758 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1711aae-7b58-4359-b040-0462ef72ff81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.209485 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-a1711aae-7b58-4359-b040-0462ef72ff81 None None] MFA Rules not processed for user `df689e92de0949289f2537eb273a244f`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:11.210700 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a1711aae-7b58-4359-b040-0462ef72ff81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:11.274771 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1414/2816] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:11.279345 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81614a61-8eb8-48a7-b5ae-1b7a90d3c0f2 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:11.341372 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81614a61-8eb8-48a7-b5ae-1b7a90d3c0f2 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:11.346404 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bc650-bd6e-40c1-95e4-174d28592449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:11.347001 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bc650-bd6e-40c1-95e4-174d28592449 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.347285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bc650-bd6e-40c1-95e4-174d28592449 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.347583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bc650-bd6e-40c1-95e4-174d28592449 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.348192 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bc650-bd6e-40c1-95e4-174d28592449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:11.350140 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bc650-bd6e-40c1-95e4-174d28592449 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:11.377432 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1403/2817] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 10:01:11 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:01:11.381534 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1711aae-7b58-4359-b040-0462ef72ff81 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:11.392953 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1711aae-7b58-4359-b040-0462ef72ff81 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:11.448906 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6639f0-78e2-4164-aa3a-96dd6ec7af79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:11.449439 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6639f0-78e2-4164-aa3a-96dd6ec7af79 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.449746 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6639f0-78e2-4164-aa3a-96dd6ec7af79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.450021 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6639f0-78e2-4164-aa3a-96dd6ec7af79 admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.450660 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6639f0-78e2-4164-aa3a-96dd6ec7af79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:11.452576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6639f0-78e2-4164-aa3a-96dd6ec7af79 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:11.474760 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1415/2818] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 10:01:11 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:11.478830 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bc650-bd6e-40c1-95e4-174d28592449 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:11.490030 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bc650-bd6e-40c1-95e4-174d28592449 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:11.494677 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14e528-5d9e-43ad-8fc4-4b08d3c52029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:11.495275 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14e528-5d9e-43ad-8fc4-4b08d3c52029 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.495558 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14e528-5d9e-43ad-8fc4-4b08d3c52029 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.495835 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14e528-5d9e-43ad-8fc4-4b08d3c52029 admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.496473 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14e528-5d9e-43ad-8fc4-4b08d3c52029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:11.498133 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14e528-5d9e-43ad-8fc4-4b08d3c52029 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:11.508708 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1404/2819] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:11.512855 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6639f0-78e2-4164-aa3a-96dd6ec7af79 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:11.522990 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6639f0-78e2-4164-aa3a-96dd6ec7af79 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:11.527644 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dcdfe-99cb-40d2-bade-4dccb0eafc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:11.528291 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dcdfe-99cb-40d2-bade-4dccb0eafc0a admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.528570 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dcdfe-99cb-40d2-bade-4dccb0eafc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.528845 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dcdfe-99cb-40d2-bade-4dccb0eafc0a admin admin] PATH_INFO: `/v3/projects/8e376161828e4708aba4526eaedd27d5/users/c049cd5d8f634abdaec27f1fe368d302/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.543980 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dcdfe-99cb-40d2-bade-4dccb0eafc0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e376161828e4708aba4526eaedd27d5, user_id=c049cd5d8f634abdaec27f1fe368d302, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:11.547195 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dcdfe-99cb-40d2-bade-4dccb0eafc0a admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:11.560023 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1416/2820] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:11 2022] PUT /identity/v3/projects/8e376161828e4708aba4526eaedd27d5/users/c049cd5d8f634abdaec27f1fe368d302/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:11.563984 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14e528-5d9e-43ad-8fc4-4b08d3c52029 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:11.574037 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14e528-5d9e-43ad-8fc4-4b08d3c52029 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:11.630926 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de3139-0721-4c76-a66a-bf675b38be8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:11.631528 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de3139-0721-4c76-a66a-bf675b38be8a admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.631839 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de3139-0721-4c76-a66a-bf675b38be8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.632114 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de3139-0721-4c76-a66a-bf675b38be8a admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.632750 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de3139-0721-4c76-a66a-bf675b38be8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:11.634373 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de3139-0721-4c76-a66a-bf675b38be8a admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:11.644006 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1405/2821] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:11.648152 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dcdfe-99cb-40d2-bade-4dccb0eafc0a admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:11.659096 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dcdfe-99cb-40d2-bade-4dccb0eafc0a admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:11.663750 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828d241-6740-4bf9-b480-5593b5e9f2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:11.664397 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828d241-6740-4bf9-b480-5593b5e9f2c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.664678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828d241-6740-4bf9-b480-5593b5e9f2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.664953 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828d241-6740-4bf9-b480-5593b5e9f2c9 admin admin] PATH_INFO: `/v3/projects/8e376161828e4708aba4526eaedd27d5/users/c049cd5d8f634abdaec27f1fe368d302/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.666920 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828d241-6740-4bf9-b480-5593b5e9f2c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e376161828e4708aba4526eaedd27d5, user_id=c049cd5d8f634abdaec27f1fe368d302, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:11.669561 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828d241-6740-4bf9-b480-5593b5e9f2c9 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:11.680591 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1417/2822] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:11 2022] PUT /identity/v3/projects/8e376161828e4708aba4526eaedd27d5/users/c049cd5d8f634abdaec27f1fe368d302/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:11.692026 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf15e49-8f10-429d-ba38-189e0d4a64ed None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.692308 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf15e49-8f10-429d-ba38-189e0d4a64ed None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.692580 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf15e49-8f10-429d-ba38-189e0d4a64ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.713117 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:11.721770 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-ecf15e49-8f10-429d-ba38-189e0d4a64ed None None] MFA Rules not processed for user `c049cd5d8f634abdaec27f1fe368d302`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:11.722995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ecf15e49-8f10-429d-ba38-189e0d4a64ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:11.792669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1406/2823] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:11.804894 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828d241-6740-4bf9-b480-5593b5e9f2c9 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:11.806725 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-4828d241-6740-4bf9-b480-5593b5e9f2c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:11.852982 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:11.865797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828d241-6740-4bf9-b480-5593b5e9f2c9 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:11.869482 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860cef7-9a1d-4901-b821-08dc2495e4f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:11.870081 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860cef7-9a1d-4901-b821-08dc2495e4f1 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.870361 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860cef7-9a1d-4901-b821-08dc2495e4f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.870636 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860cef7-9a1d-4901-b821-08dc2495e4f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:11.880332 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860cef7-9a1d-4901-b821-08dc2495e4f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:11.881774 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860cef7-9a1d-4901-b821-08dc2495e4f1 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:11.891149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1418/2824] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:11.967299 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf15e49-8f10-429d-ba38-189e0d4a64ed None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:11.976900 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf15e49-8f10-429d-ba38-189e0d4a64ed None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:11.980788 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3be05-a6d4-42a2-b854-374d0f7b3b9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:11.981416 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3be05-a6d4-42a2-b854-374d0f7b3b9a service cinder] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:11.981712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3be05-a6d4-42a2-b854-374d0f7b3b9a service cinder] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:11.981989 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3be05-a6d4-42a2-b854-374d0f7b3b9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:12.039743 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef3be05-a6d4-42a2-b854-374d0f7b3b9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:12.041158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef3be05-a6d4-42a2-b854-374d0f7b3b9a service cinder] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:12.051901 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1407/2825] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:14.762310 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860cef7-9a1d-4901-b821-08dc2495e4f1 service cinder] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:14.824643 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860cef7-9a1d-4901-b821-08dc2495e4f1 service cinder] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:14.829304 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791e202-8fc7-406b-ae72-dc7797601188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:14.829967 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791e202-8fc7-406b-ae72-dc7797601188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:14.830247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791e202-8fc7-406b-ae72-dc7797601188 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:14.830526 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791e202-8fc7-406b-ae72-dc7797601188 admin admin] PATH_INFO: `/v3/users/df689e92de0949289f2537eb273a244f` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:14.831914 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791e202-8fc7-406b-ae72-dc7797601188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df689e92de0949289f2537eb273a244f)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:14.833859 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791e202-8fc7-406b-ae72-dc7797601188 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:14.879944 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0791e202-8fc7-406b-ae72-dc7797601188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df689e92de0949289f2537eb273a244f'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:14.880590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0791e202-8fc7-406b-ae72-dc7797601188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df689e92de0949289f2537eb273a244f'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:14.892495 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0791e202-8fc7-406b-ae72-dc7797601188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df689e92de0949289f2537eb273a244f'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:14.899393 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0791e202-8fc7-406b-ae72-dc7797601188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df689e92de0949289f2537eb273a244f'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:14.906482 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-0791e202-8fc7-406b-ae72-dc7797601188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df689e92de0949289f2537eb273a244f'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:14.912708 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1419/2826] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:14 2022] DELETE /identity/v3/users/df689e92de0949289f2537eb273a244f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:14.917196 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a6a74-4bfe-48b3-96d5-849ffd83fc9d None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:14.917705 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a6a74-4bfe-48b3-96d5-849ffd83fc9d None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:14.917805 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a6a74-4bfe-48b3-96d5-849ffd83fc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:14.938086 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-005a6a74-4bfe-48b3-96d5-849ffd83fc9d None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:14.939297 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-005a6a74-4bfe-48b3-96d5-849ffd83fc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:14.997895 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1408/2827] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:15.008321 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791e202-8fc7-406b-ae72-dc7797601188 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:15.009799 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-0791e202-8fc7-406b-ae72-dc7797601188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:15.067717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791e202-8fc7-406b-ae72-dc7797601188 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:15.071506 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f39b5-9019-4572-a02b-eee62c357483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:15.072103 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f39b5-9019-4572-a02b-eee62c357483 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:15.072379 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f39b5-9019-4572-a02b-eee62c357483 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:15.072649 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f39b5-9019-4572-a02b-eee62c357483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:15.081917 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f39b5-9019-4572-a02b-eee62c357483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:15.083339 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f39b5-9019-4572-a02b-eee62c357483 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:15.092622 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1420/2828] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:15.363452 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a6a74-4bfe-48b3-96d5-849ffd83fc9d None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:15.364914 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-005a6a74-4bfe-48b3-96d5-849ffd83fc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:15.378549 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a6a74-4bfe-48b3-96d5-849ffd83fc9d None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:15.383348 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48c026-f991-4441-b7c2-41c00d793670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:15.384133 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48c026-f991-4441-b7c2-41c00d793670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:15.385231 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48c026-f991-4441-b7c2-41c00d793670 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:15.385907 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48c026-f991-4441-b7c2-41c00d793670 admin admin] PATH_INFO: `/v3/projects/c2d6e3a9eaf141d59dfebcdd796047a7` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:15.387076 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc48c026-f991-4441-b7c2-41c00d793670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2d6e3a9eaf141d59dfebcdd796047a7)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:15.388995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc48c026-f991-4441-b7c2-41c00d793670 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:15.425129 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:15.439477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cc48c026-f991-4441-b7c2-41c00d793670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2d6e3a9eaf141d59dfebcdd796047a7', 'request_id': 'req-cc48c026-f991-4441-b7c2-41c00d793670'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:15.446575 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cc48c026-f991-4441-b7c2-41c00d793670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2d6e3a9eaf141d59dfebcdd796047a7', 'request_id': 'req-cc48c026-f991-4441-b7c2-41c00d793670'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:15.452985 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cc48c026-f991-4441-b7c2-41c00d793670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2d6e3a9eaf141d59dfebcdd796047a7', 'request_id': 'req-cc48c026-f991-4441-b7c2-41c00d793670'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:15.463748 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cc48c026-f991-4441-b7c2-41c00d793670 admin admin] The token cache is being invalidate because project c2d6e3a9eaf141d59dfebcdd796047a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:15.464032 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cc48c026-f991-4441-b7c2-41c00d793670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:15.464650 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-cc48c026-f991-4441-b7c2-41c00d793670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:15.466156 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1409/2829] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:15 2022] DELETE /identity/v3/projects/c2d6e3a9eaf141d59dfebcdd796047a7 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:15.470723 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f39b5-9019-4572-a02b-eee62c357483 service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:15.480383 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f39b5-9019-4572-a02b-eee62c357483 service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:15.484547 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:15.540723 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dba2d8-ddf1-4ebf-bee8-b588f8507c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:15.541350 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dba2d8-ddf1-4ebf-bee8-b588f8507c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:15.541661 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dba2d8-ddf1-4ebf-bee8-b588f8507c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:15.541940 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dba2d8-ddf1-4ebf-bee8-b588f8507c57 admin admin] PATH_INFO: `/v3/users/c049cd5d8f634abdaec27f1fe368d302` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:15.543070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dba2d8-ddf1-4ebf-bee8-b588f8507c57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c049cd5d8f634abdaec27f1fe368d302)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:15.544975 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dba2d8-ddf1-4ebf-bee8-b588f8507c57 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:15.592506 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-38dba2d8-ddf1-4ebf-bee8-b588f8507c57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c049cd5d8f634abdaec27f1fe368d302'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:15.593986 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-38dba2d8-ddf1-4ebf-bee8-b588f8507c57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c049cd5d8f634abdaec27f1fe368d302'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:15.606440 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-38dba2d8-ddf1-4ebf-bee8-b588f8507c57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c049cd5d8f634abdaec27f1fe368d302'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:15.613848 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-38dba2d8-ddf1-4ebf-bee8-b588f8507c57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c049cd5d8f634abdaec27f1fe368d302'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:15.620919 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-38dba2d8-ddf1-4ebf-bee8-b588f8507c57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c049cd5d8f634abdaec27f1fe368d302'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:15.626816 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1421/2830] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:15 2022] DELETE /identity/v3/users/c049cd5d8f634abdaec27f1fe368d302 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:15.907545 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48c026-f991-4441-b7c2-41c00d793670 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:15.909231 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-cc48c026-f991-4441-b7c2-41c00d793670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:15.922471 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48c026-f991-4441-b7c2-41c00d793670 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:15.981093 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bccf3fa-9aa1-4718-9bdf-7c3219d12149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:15.981678 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bccf3fa-9aa1-4718-9bdf-7c3219d12149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:15.981963 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bccf3fa-9aa1-4718-9bdf-7c3219d12149 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:15.982238 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bccf3fa-9aa1-4718-9bdf-7c3219d12149 admin admin] PATH_INFO: `/v3/projects/8e376161828e4708aba4526eaedd27d5` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:15.983382 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bccf3fa-9aa1-4718-9bdf-7c3219d12149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e376161828e4708aba4526eaedd27d5)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:15.985648 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bccf3fa-9aa1-4718-9bdf-7c3219d12149 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:16.033045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-7bccf3fa-9aa1-4718-9bdf-7c3219d12149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e376161828e4708aba4526eaedd27d5', 'request_id': 'req-7bccf3fa-9aa1-4718-9bdf-7c3219d12149'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:16.040266 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-7bccf3fa-9aa1-4718-9bdf-7c3219d12149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e376161828e4708aba4526eaedd27d5', 'request_id': 'req-7bccf3fa-9aa1-4718-9bdf-7c3219d12149'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:16.046514 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-7bccf3fa-9aa1-4718-9bdf-7c3219d12149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e376161828e4708aba4526eaedd27d5', 'request_id': 'req-7bccf3fa-9aa1-4718-9bdf-7c3219d12149'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:16.056780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-7bccf3fa-9aa1-4718-9bdf-7c3219d12149 admin admin] The token cache is being invalidate because project 8e376161828e4708aba4526eaedd27d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82884) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:16.057069 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-7bccf3fa-9aa1-4718-9bdf-7c3219d12149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:16.057732 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-7bccf3fa-9aa1-4718-9bdf-7c3219d12149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:16.059204 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1410/2831] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:15 2022] DELETE /identity/v3/projects/8e376161828e4708aba4526eaedd27d5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:16.064924 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad5061-bc38-4904-a955-f07235308820 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:16.065419 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad5061-bc38-4904-a955-f07235308820 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:16.065542 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad5061-bc38-4904-a955-f07235308820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:16.085678 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-a3ad5061-bc38-4904-a955-f07235308820 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:16.086909 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a3ad5061-bc38-4904-a955-f07235308820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:16.145418 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1422/2832] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:16.153173 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa0828-9637-4735-85a0-c70fa01b3e97 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:16.153457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa0828-9637-4735-85a0-c70fa01b3e97 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:16.153869 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa0828-9637-4735-85a0-c70fa01b3e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:16.173282 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-d1fa0828-9637-4735-85a0-c70fa01b3e97 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:16.174532 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-d1fa0828-9637-4735-85a0-c70fa01b3e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:16.182457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1411/2833] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:16.186779 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad5061-bc38-4904-a955-f07235308820 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:16.197513 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad5061-bc38-4904-a955-f07235308820 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:16.202317 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b4115-3275-43c3-aef8-785e295c8ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:16.203742 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b4115-3275-43c3-aef8-785e295c8ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:16.204023 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b4115-3275-43c3-aef8-785e295c8ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:16.204295 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b4115-3275-43c3-aef8-785e295c8ab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:16.204962 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b4115-3275-43c3-aef8-785e295c8ab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82885) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:01:16.205271 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b4115-3275-43c3-aef8-785e295c8ab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:16.207196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b4115-3275-43c3-aef8-785e295c8ab2 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:16.224737 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1423/2834] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 10:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:01:16.226305 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa0828-9637-4735-85a0-c70fa01b3e97 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:16.237106 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa0828-9637-4735-85a0-c70fa01b3e97 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:16.243316 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977e1c1-f687-4582-bc86-3d1af61328c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:16.243958 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977e1c1-f687-4582-bc86-3d1af61328c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:16.244238 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977e1c1-f687-4582-bc86-3d1af61328c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:16.244515 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977e1c1-f687-4582-bc86-3d1af61328c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:16.245198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977e1c1-f687-4582-bc86-3d1af61328c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:16.247187 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977e1c1-f687-4582-bc86-3d1af61328c8 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:16.278719 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1412/2835] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 10:01:16 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:16.284251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b4115-3275-43c3-aef8-785e295c8ab2 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:16.295152 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b4115-3275-43c3-aef8-785e295c8ab2 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:16.305992 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:16.357418 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a42254-c0dc-443e-9b05-d43047be3c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:16.358053 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a42254-c0dc-443e-9b05-d43047be3c9e admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:16.358329 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a42254-c0dc-443e-9b05-d43047be3c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:16.358598 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a42254-c0dc-443e-9b05-d43047be3c9e admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:16.359262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a42254-c0dc-443e-9b05-d43047be3c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:16.361269 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a42254-c0dc-443e-9b05-d43047be3c9e admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:16.381510 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1424/2836] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 10:01:16 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:16.385710 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977e1c1-f687-4582-bc86-3d1af61328c8 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:16.396640 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977e1c1-f687-4582-bc86-3d1af61328c8 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:16.401540 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433d4c9-82b6-4399-9151-0e3a5c13b8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:16.402157 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433d4c9-82b6-4399-9151-0e3a5c13b8ec admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:16.402440 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433d4c9-82b6-4399-9151-0e3a5c13b8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:16.402717 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433d4c9-82b6-4399-9151-0e3a5c13b8ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:16.403386 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433d4c9-82b6-4399-9151-0e3a5c13b8ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:16.405061 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433d4c9-82b6-4399-9151-0e3a5c13b8ec admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:16.415871 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1413/2837] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:16.419773 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a42254-c0dc-443e-9b05-d43047be3c9e admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:16.429826 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a42254-c0dc-443e-9b05-d43047be3c9e admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:16.434385 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b9149-622b-4cd6-90d6-26d3874d815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:16.434970 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b9149-622b-4cd6-90d6-26d3874d815c admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:16.435245 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b9149-622b-4cd6-90d6-26d3874d815c admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:16.435516 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b9149-622b-4cd6-90d6-26d3874d815c admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:16.436146 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b9149-622b-4cd6-90d6-26d3874d815c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:16.438013 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b9149-622b-4cd6-90d6-26d3874d815c admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:16.448385 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1425/2838] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:16.452396 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433d4c9-82b6-4399-9151-0e3a5c13b8ec admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:16.463312 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433d4c9-82b6-4399-9151-0e3a5c13b8ec admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:16.467968 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d0d67-2665-4a9e-a1ed-f6a089321473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:16.469151 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d0d67-2665-4a9e-a1ed-f6a089321473 admin admin] REQUEST_METHOD: `PUT` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:16.469430 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d0d67-2665-4a9e-a1ed-f6a089321473 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:16.469741 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d0d67-2665-4a9e-a1ed-f6a089321473 admin admin] PATH_INFO: `/v3/projects/f74c4b44e141459d9ad750cb8d28fad2/users/75f6aceac9af4dde9e647f9ef2205f2d/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:16.472799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:16.486946 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d0d67-2665-4a9e-a1ed-f6a089321473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f74c4b44e141459d9ad750cb8d28fad2, user_id=75f6aceac9af4dde9e647f9ef2205f2d, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:16.489665 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d0d67-2665-4a9e-a1ed-f6a089321473 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:16.502783 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1414/2839] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:16 2022] PUT /identity/v3/projects/f74c4b44e141459d9ad750cb8d28fad2/users/75f6aceac9af4dde9e647f9ef2205f2d/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:16.514311 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03d67d-f7fd-4ff9-acbb-838227dbb9f2 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:16.514593 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03d67d-f7fd-4ff9-acbb-838227dbb9f2 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:16.514869 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03d67d-f7fd-4ff9-acbb-838227dbb9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:16.542520 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-4f03d67d-f7fd-4ff9-acbb-838227dbb9f2 None None] MFA Rules not processed for user `75f6aceac9af4dde9e647f9ef2205f2d`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:16.543749 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-4f03d67d-f7fd-4ff9-acbb-838227dbb9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:16.606913 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1426/2840] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:16.614152 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d0d67-2665-4a9e-a1ed-f6a089321473 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:16.678668 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d0d67-2665-4a9e-a1ed-f6a089321473 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:16.683342 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f41df-7e45-473c-8d5a-54dc87133dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:16.683938 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f41df-7e45-473c-8d5a-54dc87133dff admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:16.684215 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f41df-7e45-473c-8d5a-54dc87133dff admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:16.684486 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f41df-7e45-473c-8d5a-54dc87133dff admin admin] PATH_INFO: `/v3/projects` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:16.685109 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f41df-7e45-473c-8d5a-54dc87133dff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:16.687057 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f41df-7e45-473c-8d5a-54dc87133dff admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:16.713008 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1415/2841] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 10:01:16 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:16.717393 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03d67d-f7fd-4ff9-acbb-838227dbb9f2 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:16.728722 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03d67d-f7fd-4ff9-acbb-838227dbb9f2 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:16.784467 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f755ba4-0af2-4e33-a149-df9dd525673d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:16.784982 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f755ba4-0af2-4e33-a149-df9dd525673d admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:16.785261 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f755ba4-0af2-4e33-a149-df9dd525673d admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:16.785568 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f755ba4-0af2-4e33-a149-df9dd525673d admin admin] PATH_INFO: `/v3/users` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:16.786184 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f755ba4-0af2-4e33-a149-df9dd525673d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:16.788091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f755ba4-0af2-4e33-a149-df9dd525673d admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:16.812186 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1427/2842] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 10:01:16 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 10:01:16.813247 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f41df-7e45-473c-8d5a-54dc87133dff admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:16.824025 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f41df-7e45-473c-8d5a-54dc87133dff admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:16.828768 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6a695-34f7-4a9d-984e-269acfbeb06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:16.829366 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6a695-34f7-4a9d-984e-269acfbeb06b admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:16.829681 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6a695-34f7-4a9d-984e-269acfbeb06b admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:16.829957 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6a695-34f7-4a9d-984e-269acfbeb06b admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:16.830631 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6a695-34f7-4a9d-984e-269acfbeb06b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:16.832492 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6a695-34f7-4a9d-984e-269acfbeb06b admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:16.843041 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1416/2843] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:16.847667 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f755ba4-0af2-4e33-a149-df9dd525673d admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:16.857655 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f755ba4-0af2-4e33-a149-df9dd525673d admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:16.863152 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662afcd-0f34-46d5-8f33-8df477ee7894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:16.863783 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662afcd-0f34-46d5-8f33-8df477ee7894 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:16.864064 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662afcd-0f34-46d5-8f33-8df477ee7894 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:16.864341 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662afcd-0f34-46d5-8f33-8df477ee7894 admin admin] PATH_INFO: `/v3/projects/0a9b7a093f26496a8f88d046da88a84e/users/9cd16c1cceec42149e9233281e5b45b6/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:16.872823 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:16.880381 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662afcd-0f34-46d5-8f33-8df477ee7894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a9b7a093f26496a8f88d046da88a84e, user_id=9cd16c1cceec42149e9233281e5b45b6, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:16.883041 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662afcd-0f34-46d5-8f33-8df477ee7894 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:16.895344 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1428/2844] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:16 2022] PUT /identity/v3/projects/0a9b7a093f26496a8f88d046da88a84e/users/9cd16c1cceec42149e9233281e5b45b6/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 10:01:16.899294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6a695-34f7-4a9d-984e-269acfbeb06b admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:16.910245 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6a695-34f7-4a9d-984e-269acfbeb06b admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:16.966642 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcb06f-cf15-4925-b6ff-ad9e87da821d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:16.967326 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcb06f-cf15-4925-b6ff-ad9e87da821d admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:16.967507 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcb06f-cf15-4925-b6ff-ad9e87da821d admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:16.967778 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcb06f-cf15-4925-b6ff-ad9e87da821d admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:16.968949 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcb06f-cf15-4925-b6ff-ad9e87da821d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:16.970549 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcb06f-cf15-4925-b6ff-ad9e87da821d admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:16.980008 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1417/2845] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:16.985076 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662afcd-0f34-46d5-8f33-8df477ee7894 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:16.995416 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662afcd-0f34-46d5-8f33-8df477ee7894 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:17.000153 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bfd68-c4c5-4697-8a87-017300c68e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:17.000805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bfd68-c4c5-4697-8a87-017300c68e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:17.001088 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bfd68-c4c5-4697-8a87-017300c68e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:17.001367 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bfd68-c4c5-4697-8a87-017300c68e04 admin admin] PATH_INFO: `/v3/projects/0a9b7a093f26496a8f88d046da88a84e/users/9cd16c1cceec42149e9233281e5b45b6/roles/cd2effe8340d4be08a28d3a40db6979d` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:17.003347 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bfd68-c4c5-4697-8a87-017300c68e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a9b7a093f26496a8f88d046da88a84e, user_id=9cd16c1cceec42149e9233281e5b45b6, role_id=cd2effe8340d4be08a28d3a40db6979d)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:17.006065 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bfd68-c4c5-4697-8a87-017300c68e04 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:17.016793 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1429/2846] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:16 2022] PUT /identity/v3/projects/0a9b7a093f26496a8f88d046da88a84e/users/9cd16c1cceec42149e9233281e5b45b6/roles/cd2effe8340d4be08a28d3a40db6979d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:17.079090 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b7d8a-c068-4a19-b1bd-2520f61e9929 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:17.079289 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b7d8a-c068-4a19-b1bd-2520f61e9929 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:17.079565 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b7d8a-c068-4a19-b1bd-2520f61e9929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:17.107831 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-0d1b7d8a-c068-4a19-b1bd-2520f61e9929 None None] MFA Rules not processed for user `9cd16c1cceec42149e9233281e5b45b6`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:17.109272 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-0d1b7d8a-c068-4a19-b1bd-2520f61e9929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:17.153393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:17.179057 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1418/2847] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:17.190306 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bfd68-c4c5-4697-8a87-017300c68e04 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:17.192114 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f14bfd68-c4c5-4697-8a87-017300c68e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:17.253077 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bfd68-c4c5-4697-8a87-017300c68e04 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:17.256748 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89fae9-b468-4da2-8a53-926340b14f7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:17.257350 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89fae9-b468-4da2-8a53-926340b14f7d service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:17.257658 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89fae9-b468-4da2-8a53-926340b14f7d service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:17.257931 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89fae9-b468-4da2-8a53-926340b14f7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:17.313833 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89fae9-b468-4da2-8a53-926340b14f7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:17.315471 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89fae9-b468-4da2-8a53-926340b14f7d service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:17.325070 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1430/2848] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:19.853556 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b7d8a-c068-4a19-b1bd-2520f61e9929 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:19.919371 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b7d8a-c068-4a19-b1bd-2520f61e9929 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:19.924546 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef21a4-682d-46f7-b071-2b5b9aff1409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:19.925171 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef21a4-682d-46f7-b071-2b5b9aff1409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:19.925449 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef21a4-682d-46f7-b071-2b5b9aff1409 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:19.925746 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef21a4-682d-46f7-b071-2b5b9aff1409 admin admin] PATH_INFO: `/v3/users/75f6aceac9af4dde9e647f9ef2205f2d` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:19.926870 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef21a4-682d-46f7-b071-2b5b9aff1409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75f6aceac9af4dde9e647f9ef2205f2d)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:19.928765 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef21a4-682d-46f7-b071-2b5b9aff1409 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:19.976367 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-43ef21a4-682d-46f7-b071-2b5b9aff1409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75f6aceac9af4dde9e647f9ef2205f2d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:19.977017 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-43ef21a4-682d-46f7-b071-2b5b9aff1409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75f6aceac9af4dde9e647f9ef2205f2d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:19.977672 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-43ef21a4-682d-46f7-b071-2b5b9aff1409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75f6aceac9af4dde9e647f9ef2205f2d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:19.990351 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-43ef21a4-682d-46f7-b071-2b5b9aff1409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75f6aceac9af4dde9e647f9ef2205f2d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:19.997945 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-43ef21a4-682d-46f7-b071-2b5b9aff1409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75f6aceac9af4dde9e647f9ef2205f2d'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:20.010255 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1419/2849] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:19 2022] DELETE /identity/v3/users/75f6aceac9af4dde9e647f9ef2205f2d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:20.015474 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c1769-917e-4f4a-86cd-5e26036bdb12 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:20.016012 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c1769-917e-4f4a-86cd-5e26036bdb12 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:20.016266 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c1769-917e-4f4a-86cd-5e26036bdb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:20.035785 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-495c1769-917e-4f4a-86cd-5e26036bdb12 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:20.037001 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-495c1769-917e-4f4a-86cd-5e26036bdb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:20.095911 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1431/2850] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:20.105590 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef21a4-682d-46f7-b071-2b5b9aff1409 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:20.107030 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-43ef21a4-682d-46f7-b071-2b5b9aff1409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:20.164062 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef21a4-682d-46f7-b071-2b5b9aff1409 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:20.167703 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78afa48-ed0a-4c23-aa83-0961c708d905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:20.168302 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78afa48-ed0a-4c23-aa83-0961c708d905 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:20.168581 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78afa48-ed0a-4c23-aa83-0961c708d905 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:20.168857 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78afa48-ed0a-4c23-aa83-0961c708d905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:20.177729 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78afa48-ed0a-4c23-aa83-0961c708d905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:20.179176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78afa48-ed0a-4c23-aa83-0961c708d905 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:20.189118 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1420/2851] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:20.456389 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c1769-917e-4f4a-86cd-5e26036bdb12 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:20.458192 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-495c1769-917e-4f4a-86cd-5e26036bdb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:20.470574 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c1769-917e-4f4a-86cd-5e26036bdb12 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:20.475573 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22c267-ae56-49dd-ac8a-98e6880dc063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:20.476349 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22c267-ae56-49dd-ac8a-98e6880dc063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:20.476632 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22c267-ae56-49dd-ac8a-98e6880dc063 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:20.476904 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22c267-ae56-49dd-ac8a-98e6880dc063 admin admin] PATH_INFO: `/v3/projects/f74c4b44e141459d9ad750cb8d28fad2` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:20.478126 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22c267-ae56-49dd-ac8a-98e6880dc063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f74c4b44e141459d9ad750cb8d28fad2)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:20.480052 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22c267-ae56-49dd-ac8a-98e6880dc063 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:20.505230 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:20.528494 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-fc22c267-ae56-49dd-ac8a-98e6880dc063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f74c4b44e141459d9ad750cb8d28fad2', 'request_id': 'req-fc22c267-ae56-49dd-ac8a-98e6880dc063'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:20.535807 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-fc22c267-ae56-49dd-ac8a-98e6880dc063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f74c4b44e141459d9ad750cb8d28fad2', 'request_id': 'req-fc22c267-ae56-49dd-ac8a-98e6880dc063'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:20.542194 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-fc22c267-ae56-49dd-ac8a-98e6880dc063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f74c4b44e141459d9ad750cb8d28fad2', 'request_id': 'req-fc22c267-ae56-49dd-ac8a-98e6880dc063'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:20.553198 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-fc22c267-ae56-49dd-ac8a-98e6880dc063 admin admin] The token cache is being invalidate because project f74c4b44e141459d9ad750cb8d28fad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:20.553511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-fc22c267-ae56-49dd-ac8a-98e6880dc063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:20.554149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-fc22c267-ae56-49dd-ac8a-98e6880dc063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:20.555632 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1432/2852] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:20 2022] DELETE /identity/v3/projects/f74c4b44e141459d9ad750cb8d28fad2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:20.559595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78afa48-ed0a-4c23-aa83-0961c708d905 service neutron] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:20.565014 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:20.571336 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78afa48-ed0a-4c23-aa83-0961c708d905 service neutron] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:20.628126 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639985b5-ca38-4a8b-b586-2568cb1b8dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:20.628659 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639985b5-ca38-4a8b-b586-2568cb1b8dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:20.628937 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639985b5-ca38-4a8b-b586-2568cb1b8dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:20.629209 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639985b5-ca38-4a8b-b586-2568cb1b8dc2 admin admin] PATH_INFO: `/v3/users/9cd16c1cceec42149e9233281e5b45b6` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:20.630357 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639985b5-ca38-4a8b-b586-2568cb1b8dc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd16c1cceec42149e9233281e5b45b6)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:20.632258 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639985b5-ca38-4a8b-b586-2568cb1b8dc2 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:20.677768 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-639985b5-ca38-4a8b-b586-2568cb1b8dc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd16c1cceec42149e9233281e5b45b6'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:20.678457 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-639985b5-ca38-4a8b-b586-2568cb1b8dc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd16c1cceec42149e9233281e5b45b6'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:20.679068 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-639985b5-ca38-4a8b-b586-2568cb1b8dc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd16c1cceec42149e9233281e5b45b6'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:20.691625 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-639985b5-ca38-4a8b-b586-2568cb1b8dc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd16c1cceec42149e9233281e5b45b6'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:20.698929 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-639985b5-ca38-4a8b-b586-2568cb1b8dc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd16c1cceec42149e9233281e5b45b6'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:20.712228 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1421/2853] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:20 2022] DELETE /identity/v3/users/9cd16c1cceec42149e9233281e5b45b6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:21.245055 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22c267-ae56-49dd-ac8a-98e6880dc063 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:21.246556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-fc22c267-ae56-49dd-ac8a-98e6880dc063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:21.260128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22c267-ae56-49dd-ac8a-98e6880dc063 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:21.319197 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db67b2-5024-4d0e-84d5-4d67a0c91c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:21.319830 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db67b2-5024-4d0e-84d5-4d67a0c91c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:21.320113 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db67b2-5024-4d0e-84d5-4d67a0c91c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:21.320392 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db67b2-5024-4d0e-84d5-4d67a0c91c62 admin admin] PATH_INFO: `/v3/projects/0a9b7a093f26496a8f88d046da88a84e` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:21.321556 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db67b2-5024-4d0e-84d5-4d67a0c91c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a9b7a093f26496a8f88d046da88a84e)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:21.323448 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db67b2-5024-4d0e-84d5-4d67a0c91c62 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:21.370572 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-f9db67b2-5024-4d0e-84d5-4d67a0c91c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a9b7a093f26496a8f88d046da88a84e', 'request_id': 'req-f9db67b2-5024-4d0e-84d5-4d67a0c91c62'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:21.378067 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-f9db67b2-5024-4d0e-84d5-4d67a0c91c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a9b7a093f26496a8f88d046da88a84e', 'request_id': 'req-f9db67b2-5024-4d0e-84d5-4d67a0c91c62'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:21.384477 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-f9db67b2-5024-4d0e-84d5-4d67a0c91c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a9b7a093f26496a8f88d046da88a84e', 'request_id': 'req-f9db67b2-5024-4d0e-84d5-4d67a0c91c62'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:21.395233 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-f9db67b2-5024-4d0e-84d5-4d67a0c91c62 admin admin] The token cache is being invalidate because project 0a9b7a093f26496a8f88d046da88a84e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:21.395520 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-f9db67b2-5024-4d0e-84d5-4d67a0c91c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:21.396156 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-f9db67b2-5024-4d0e-84d5-4d67a0c91c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:21.398155 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1433/2854] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:21 2022] DELETE /identity/v3/projects/0a9b7a093f26496a8f88d046da88a84e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:21.402974 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f9eeb-a89b-4177-a940-70f240c8b01e None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:21.403461 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f9eeb-a89b-4177-a940-70f240c8b01e None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:21.403570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f9eeb-a89b-4177-a940-70f240c8b01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:21.424782 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-7e9f9eeb-a89b-4177-a940-70f240c8b01e None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:21.426026 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7e9f9eeb-a89b-4177-a940-70f240c8b01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:21.490079 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1422/2855] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:01:21.498054 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bb9cb-2471-49d3-acda-ea4d40a0a908 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:21.498417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bb9cb-2471-49d3-acda-ea4d40a0a908 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:21.498730 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bb9cb-2471-49d3-acda-ea4d40a0a908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:21.518912 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-fb4bb9cb-2471-49d3-acda-ea4d40a0a908 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:21.520173 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-fb4bb9cb-2471-49d3-acda-ea4d40a0a908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:21.528414 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1434/2856] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:21.533612 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f9eeb-a89b-4177-a940-70f240c8b01e None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:21.543332 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f9eeb-a89b-4177-a940-70f240c8b01e None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:21.548693 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7262257-c365-41d3-b83a-0e887b477f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:21.549282 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7262257-c365-41d3-b83a-0e887b477f32 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:21.549582 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7262257-c365-41d3-b83a-0e887b477f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:21.549855 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7262257-c365-41d3-b83a-0e887b477f32 admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:21.550492 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7262257-c365-41d3-b83a-0e887b477f32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:01:21.550792 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7262257-c365-41d3-b83a-0e887b477f32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:21.552410 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7262257-c365-41d3-b83a-0e887b477f32 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:21.564477 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1423/2857] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 10:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:01:21.568686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bb9cb-2471-49d3-acda-ea4d40a0a908 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:21.578212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bb9cb-2471-49d3-acda-ea4d40a0a908 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:21.583215 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e83bf4-1f24-450f-b51a-2c0fce6b7018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:21.583813 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e83bf4-1f24-450f-b51a-2c0fce6b7018 admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:21.584096 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e83bf4-1f24-450f-b51a-2c0fce6b7018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:21.584376 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e83bf4-1f24-450f-b51a-2c0fce6b7018 admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:21.585009 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e83bf4-1f24-450f-b51a-2c0fce6b7018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:21.586923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e83bf4-1f24-450f-b51a-2c0fce6b7018 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:21.614590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1435/2858] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 10:01:21 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:21.618683 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7262257-c365-41d3-b83a-0e887b477f32 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:21.629666 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7262257-c365-41d3-b83a-0e887b477f32 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:21.634234 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:21.689564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0c4c3-4248-4ca6-a4b7-f4dff6904485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:21.690166 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0c4c3-4248-4ca6-a4b7-f4dff6904485 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:21.690446 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0c4c3-4248-4ca6-a4b7-f4dff6904485 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:21.690721 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0c4c3-4248-4ca6-a4b7-f4dff6904485 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:21.691349 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0c4c3-4248-4ca6-a4b7-f4dff6904485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:21.693239 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0c4c3-4248-4ca6-a4b7-f4dff6904485 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:21.713779 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1424/2859] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 10:01:21 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:21.718290 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e83bf4-1f24-450f-b51a-2c0fce6b7018 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:21.728785 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e83bf4-1f24-450f-b51a-2c0fce6b7018 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:21.733446 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96483f5-63d9-4134-8ccd-322faaaed321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:21.734694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96483f5-63d9-4134-8ccd-322faaaed321 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:21.734969 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96483f5-63d9-4134-8ccd-322faaaed321 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:21.735242 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96483f5-63d9-4134-8ccd-322faaaed321 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:21.735883 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96483f5-63d9-4134-8ccd-322faaaed321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:21.737489 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96483f5-63d9-4134-8ccd-322faaaed321 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:21.747305 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1436/2860] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:21.751744 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0c4c3-4248-4ca6-a4b7-f4dff6904485 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:21.761635 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0c4c3-4248-4ca6-a4b7-f4dff6904485 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:21.766290 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a926d-8539-4b87-9171-8e2366c854fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:21.766880 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a926d-8539-4b87-9171-8e2366c854fe admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:21.767184 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a926d-8539-4b87-9171-8e2366c854fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:21.767442 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a926d-8539-4b87-9171-8e2366c854fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:21.768082 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a926d-8539-4b87-9171-8e2366c854fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:21.769714 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a926d-8539-4b87-9171-8e2366c854fe admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:21.780231 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1425/2861] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:21.784466 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96483f5-63d9-4134-8ccd-322faaaed321 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:21.789638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:21.796649 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96483f5-63d9-4134-8ccd-322faaaed321 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:21.803334 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64198c-00b9-41c1-b611-2c8acaa053da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:21.804150 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64198c-00b9-41c1-b611-2c8acaa053da admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:21.804435 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64198c-00b9-41c1-b611-2c8acaa053da admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:21.804714 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64198c-00b9-41c1-b611-2c8acaa053da admin admin] PATH_INFO: `/v3/projects/7676776b1c7840ecb6615e0e7781c3d6/users/7721adfb7fe541ee9b6600b4d4febc64/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:21.820190 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64198c-00b9-41c1-b611-2c8acaa053da admin admin] RBAC: Authorizing `identity:create_grant(project_id=7676776b1c7840ecb6615e0e7781c3d6, user_id=7721adfb7fe541ee9b6600b4d4febc64, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:21.822906 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64198c-00b9-41c1-b611-2c8acaa053da admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:21.835390 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1437/2862] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:21 2022] PUT /identity/v3/projects/7676776b1c7840ecb6615e0e7781c3d6/users/7721adfb7fe541ee9b6600b4d4febc64/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:21.846845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd9daa-22fa-4885-bbf2-4d18aba120f9 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:21.847158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd9daa-22fa-4885-bbf2-4d18aba120f9 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:21.847432 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd9daa-22fa-4885-bbf2-4d18aba120f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:21.877072 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-79dd9daa-22fa-4885-bbf2-4d18aba120f9 None None] MFA Rules not processed for user `7721adfb7fe541ee9b6600b4d4febc64`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:21.878333 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-79dd9daa-22fa-4885-bbf2-4d18aba120f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:21.946278 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1426/2863] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:21.957247 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64198c-00b9-41c1-b611-2c8acaa053da admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:21.958946 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-9e64198c-00b9-41c1-b611-2c8acaa053da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:22.019019 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64198c-00b9-41c1-b611-2c8acaa053da admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:22.022653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb10ed-a7f9-4117-8e78-5872ff4f87c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:22.023255 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb10ed-a7f9-4117-8e78-5872ff4f87c5 service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:22.023536 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb10ed-a7f9-4117-8e78-5872ff4f87c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:22.023810 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb10ed-a7f9-4117-8e78-5872ff4f87c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:22.032396 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb10ed-a7f9-4117-8e78-5872ff4f87c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:22.034204 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb10ed-a7f9-4117-8e78-5872ff4f87c5 service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:22.043102 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1438/2864] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:23.395038 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98bb1e-3247-4997-83c7-50f083c34e48 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:23.395975 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98bb1e-3247-4997-83c7-50f083c34e48 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:23.396256 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98bb1e-3247-4997-83c7-50f083c34e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:23.415867 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-4e98bb1e-3247-4997-83c7-50f083c34e48 None None] MFA Rules not processed for user `7721adfb7fe541ee9b6600b4d4febc64`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:23.417095 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-4e98bb1e-3247-4997-83c7-50f083c34e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:23.424161 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1427/2865] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:23.886006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb10ed-a7f9-4117-8e78-5872ff4f87c5 service cinder] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:23.887458 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-12eb10ed-a7f9-4117-8e78-5872ff4f87c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:23.967031 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb10ed-a7f9-4117-8e78-5872ff4f87c5 service cinder] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:23.972649 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf84549-bc7c-4f77-a873-b7112cdeda8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983e364f5564ed7854dff06a80f55d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:23.973248 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf84549-bc7c-4f77-a873-b7112cdeda8a service placement] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:23.973576 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf84549-bc7c-4f77-a873-b7112cdeda8a service placement] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:23.973846 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf84549-bc7c-4f77-a873-b7112cdeda8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:23.975587 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-cbf84549-bc7c-4f77-a873-b7112cdeda8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:23.986933 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf84549-bc7c-4f77-a873-b7112cdeda8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:23.988505 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf84549-bc7c-4f77-a873-b7112cdeda8a service placement] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:23.999282 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1439/2866] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:25.879529 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98bb1e-3247-4997-83c7-50f083c34e48 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:25.881062 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-4e98bb1e-3247-4997-83c7-50f083c34e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:25.949316 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98bb1e-3247-4997-83c7-50f083c34e48 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:25.955013 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c8c986-edbc-4723-9ce7-e39bbe7e0053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:25.955681 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8c986-edbc-4723-9ce7-e39bbe7e0053 service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:25.956099 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8c986-edbc-4723-9ce7-e39bbe7e0053 service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:25.956274 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c8c986-edbc-4723-9ce7-e39bbe7e0053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:25.958676 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-23c8c986-edbc-4723-9ce7-e39bbe7e0053 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:25.970370 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8c986-edbc-4723-9ce7-e39bbe7e0053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:25.971806 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c8c986-edbc-4723-9ce7-e39bbe7e0053 service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:25.980240 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1428/2867] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:31.651218 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf84549-bc7c-4f77-a873-b7112cdeda8a service placement] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:31.652649 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-cbf84549-bc7c-4f77-a873-b7112cdeda8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:31.738301 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf84549-bc7c-4f77-a873-b7112cdeda8a service placement] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:31.743727 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5071e-1516-48c7-b83f-4f734d5bc89e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:31.744325 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5071e-1516-48c7-b83f-4f734d5bc89e service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:31.744602 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5071e-1516-48c7-b83f-4f734d5bc89e service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:31.744877 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5071e-1516-48c7-b83f-4f734d5bc89e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:31.746649 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a7d5071e-1516-48c7-b83f-4f734d5bc89e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:31.756783 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:31.759561 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5071e-1516-48c7-b83f-4f734d5bc89e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:31.761849 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5071e-1516-48c7-b83f-4f734d5bc89e service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:31.773188 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1440/2868] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:35.976287 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=91,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:38.418609 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce457c8-e56e-4c62-848c-15d442d77e71 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:38.419194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce457c8-e56e-4c62-848c-15d442d77e71 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:38.419194 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce457c8-e56e-4c62-848c-15d442d77e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:38.439145 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-2ce457c8-e56e-4c62-848c-15d442d77e71 None None] MFA Rules not processed for user `3ae62427d5914e67b5b4d0237ecccd06`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:38.440359 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-2ce457c8-e56e-4c62-848c-15d442d77e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:38.495190 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1429/2869] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 10:01:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:38.541928 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5071e-1516-48c7-b83f-4f734d5bc89e service nova] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:38.543349 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a7d5071e-1516-48c7-b83f-4f734d5bc89e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:38.623947 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5071e-1516-48c7-b83f-4f734d5bc89e service nova] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:38.629572 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf48cd-8cf2-4d77-9453-db5a00452572 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2db35b94c84ec7bba96117d23baf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:38.630172 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf48cd-8cf2-4d77-9453-db5a00452572 service swift] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:38.630451 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf48cd-8cf2-4d77-9453-db5a00452572 service swift] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:38.630723 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf48cd-8cf2-4d77-9453-db5a00452572 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:38.638829 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf48cd-8cf2-4d77-9453-db5a00452572 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:38.640417 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf48cd-8cf2-4d77-9453-db5a00452572 service swift] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:38.648950 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1441/2870] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 10:01:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:01:39.146692 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00752a4d-ab98-425f-9fc3-79f26b2cdbfa None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:39.147006 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00752a4d-ab98-425f-9fc3-79f26b2cdbfa None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:39.147285 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00752a4d-ab98-425f-9fc3-79f26b2cdbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:39.166972 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-00752a4d-ab98-425f-9fc3-79f26b2cdbfa None None] MFA Rules not processed for user `3ae62427d5914e67b5b4d0237ecccd06`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:39.168195 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-00752a4d-ab98-425f-9fc3-79f26b2cdbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:39.175564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1430/2871] 10.222.0.58 () {58 vars in 967 bytes} [Wed Aug 24 10:01:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:01:39.188128 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf48cd-8cf2-4d77-9453-db5a00452572 service swift] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:39.203730 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf48cd-8cf2-4d77-9453-db5a00452572 service swift] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:39.210203 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3de28-af64-4f15-9b12-4d4efec1f3e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2db35b94c84ec7bba96117d23baf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:39.210797 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3de28-af64-4f15-9b12-4d4efec1f3e6 service swift] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:39.211074 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3de28-af64-4f15-9b12-4d4efec1f3e6 service swift] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:39.211349 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3de28-af64-4f15-9b12-4d4efec1f3e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:39.219473 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3de28-af64-4f15-9b12-4d4efec1f3e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:39.221024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3de28-af64-4f15-9b12-4d4efec1f3e6 service swift] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:39.229222 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1442/2872] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 10:01:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:01:39.442191 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc41a4-deb4-4bd4-9a47-2b94d1aacfc6 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:39.442682 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc41a4-deb4-4bd4-9a47-2b94d1aacfc6 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:39.442799 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc41a4-deb4-4bd4-9a47-2b94d1aacfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:39.462166 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-12dc41a4-deb4-4bd4-9a47-2b94d1aacfc6 None None] MFA Rules not processed for user `3ae62427d5914e67b5b4d0237ecccd06`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:39.463339 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-12dc41a4-deb4-4bd4-9a47-2b94d1aacfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:39.470508 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1431/2873] 10.222.0.58 () {58 vars in 1009 bytes} [Wed Aug 24 10:01:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:39.482110 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3de28-af64-4f15-9b12-4d4efec1f3e6 service swift] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:39.493427 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3de28-af64-4f15-9b12-4d4efec1f3e6 service swift] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:39.498478 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79b57d-dd99-4281-b22e-fc13a45cfeb9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2db35b94c84ec7bba96117d23baf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:39.499080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79b57d-dd99-4281-b22e-fc13a45cfeb9 service swift] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:39.499363 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79b57d-dd99-4281-b22e-fc13a45cfeb9 service swift] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:39.499641 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79b57d-dd99-4281-b22e-fc13a45cfeb9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:39.508500 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79b57d-dd99-4281-b22e-fc13a45cfeb9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:39.510107 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79b57d-dd99-4281-b22e-fc13a45cfeb9 service swift] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:39.518262 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1443/2874] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 10:01:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 10:01:39.840042 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9bdac-7c95-4344-9f36-d9672ed0e884 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:39.840335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9bdac-7c95-4344-9f36-d9672ed0e884 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:39.840610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9bdac-7c95-4344-9f36-d9672ed0e884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:39.859906 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-98a9bdac-7c95-4344-9f36-d9672ed0e884 None None] MFA Rules not processed for user `3ae62427d5914e67b5b4d0237ecccd06`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:39.861091 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-98a9bdac-7c95-4344-9f36-d9672ed0e884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:39.868190 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1432/2875] 10.222.0.58 () {58 vars in 967 bytes} [Wed Aug 24 10:01:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:39.880757 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79b57d-dd99-4281-b22e-fc13a45cfeb9 service swift] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:39.892202 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79b57d-dd99-4281-b22e-fc13a45cfeb9 service swift] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:39.897238 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026af54-0b7a-4048-8310-4e206f1c537f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff2db35b94c84ec7bba96117d23baf6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:39.897873 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026af54-0b7a-4048-8310-4e206f1c537f service swift] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:39.898154 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026af54-0b7a-4048-8310-4e206f1c537f service swift] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:39.898431 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026af54-0b7a-4048-8310-4e206f1c537f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:39.906653 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026af54-0b7a-4048-8310-4e206f1c537f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:39.908212 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026af54-0b7a-4048-8310-4e206f1c537f service swift] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:39.916423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1444/2876] 10.222.0.58 () {60 vars in 1384 bytes} [Wed Aug 24 10:01:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 10:01:42.174539 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9bdac-7c95-4344-9f36-d9672ed0e884 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:42.237075 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9bdac-7c95-4344-9f36-d9672ed0e884 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:42.241723 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a12979-c199-428e-91d9-b4e389f69e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:42.242356 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a12979-c199-428e-91d9-b4e389f69e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:42.242637 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a12979-c199-428e-91d9-b4e389f69e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:42.242916 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a12979-c199-428e-91d9-b4e389f69e43 admin admin] PATH_INFO: `/v3/users/7721adfb7fe541ee9b6600b4d4febc64` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:42.244057 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a12979-c199-428e-91d9-b4e389f69e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7721adfb7fe541ee9b6600b4d4febc64)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:42.246001 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a12979-c199-428e-91d9-b4e389f69e43 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:42.293158 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a1a12979-c199-428e-91d9-b4e389f69e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7721adfb7fe541ee9b6600b4d4febc64'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:42.293828 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a1a12979-c199-428e-91d9-b4e389f69e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7721adfb7fe541ee9b6600b4d4febc64'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:42.294441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a1a12979-c199-428e-91d9-b4e389f69e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7721adfb7fe541ee9b6600b4d4febc64'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:42.306350 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a1a12979-c199-428e-91d9-b4e389f69e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7721adfb7fe541ee9b6600b4d4febc64'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:42.314198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-a1a12979-c199-428e-91d9-b4e389f69e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7721adfb7fe541ee9b6600b4d4febc64'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:42.326398 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1433/2877] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 10:01:42 2022] DELETE /identity/v3/users/7721adfb7fe541ee9b6600b4d4febc64 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:42.332115 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92874d83-0c3a-4008-8306-96e0a9552afb None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:42.337059 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92874d83-0c3a-4008-8306-96e0a9552afb None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:42.337352 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92874d83-0c3a-4008-8306-96e0a9552afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:42.357012 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-92874d83-0c3a-4008-8306-96e0a9552afb None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:42.358574 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-92874d83-0c3a-4008-8306-96e0a9552afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:42.418945 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1445/2878] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:42.428690 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a12979-c199-428e-91d9-b4e389f69e43 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:42.430098 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-a1a12979-c199-428e-91d9-b4e389f69e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:42.436823 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:42.491343 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a12979-c199-428e-91d9-b4e389f69e43 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:42.494966 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f741022-d6fb-46d6-a696-4fec7543ff9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:42.495570 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f741022-d6fb-46d6-a696-4fec7543ff9c service neutron] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:42.495851 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f741022-d6fb-46d6-a696-4fec7543ff9c service neutron] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:42.496122 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f741022-d6fb-46d6-a696-4fec7543ff9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:42.506050 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f741022-d6fb-46d6-a696-4fec7543ff9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:42.507465 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f741022-d6fb-46d6-a696-4fec7543ff9c service neutron] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:42.517481 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1434/2879] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:42.689447 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92874d83-0c3a-4008-8306-96e0a9552afb None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:42.690931 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-92874d83-0c3a-4008-8306-96e0a9552afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:42.704373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92874d83-0c3a-4008-8306-96e0a9552afb None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:42.709578 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17d103-928e-4554-9e9f-ae9dd1897c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:42.710418 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17d103-928e-4554-9e9f-ae9dd1897c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:42.710694 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17d103-928e-4554-9e9f-ae9dd1897c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:42.711499 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17d103-928e-4554-9e9f-ae9dd1897c90 admin admin] PATH_INFO: `/v3/projects/7676776b1c7840ecb6615e0e7781c3d6` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:42.712855 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17d103-928e-4554-9e9f-ae9dd1897c90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7676776b1c7840ecb6615e0e7781c3d6)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:42.715191 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17d103-928e-4554-9e9f-ae9dd1897c90 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:42.750779 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:42.765234 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-8e17d103-928e-4554-9e9f-ae9dd1897c90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7676776b1c7840ecb6615e0e7781c3d6', 'request_id': 'req-8e17d103-928e-4554-9e9f-ae9dd1897c90'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:42.773022 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-8e17d103-928e-4554-9e9f-ae9dd1897c90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7676776b1c7840ecb6615e0e7781c3d6', 'request_id': 'req-8e17d103-928e-4554-9e9f-ae9dd1897c90'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:42.779342 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-8e17d103-928e-4554-9e9f-ae9dd1897c90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7676776b1c7840ecb6615e0e7781c3d6', 'request_id': 'req-8e17d103-928e-4554-9e9f-ae9dd1897c90'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:42.790778 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-8e17d103-928e-4554-9e9f-ae9dd1897c90 admin admin] The token cache is being invalidate because project 7676776b1c7840ecb6615e0e7781c3d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:01:42.791068 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-8e17d103-928e-4554-9e9f-ae9dd1897c90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:42.791711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-8e17d103-928e-4554-9e9f-ae9dd1897c90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:01:42.793216 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1446/2880] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 10:01:42 2022] DELETE /identity/v3/projects/7676776b1c7840ecb6615e0e7781c3d6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:42.798180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d2328-97e2-4dfc-ac22-7702f0e48726 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:42.798466 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d2328-97e2-4dfc-ac22-7702f0e48726 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:42.798745 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d2328-97e2-4dfc-ac22-7702f0e48726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:42.817838 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-610d2328-97e2-4dfc-ac22-7702f0e48726 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:42.819039 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-610d2328-97e2-4dfc-ac22-7702f0e48726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:42.877971 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1435/2881] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:01:42.886218 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b23b27-67d6-4999-9f59-008527bcd689 None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:42.886509 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b23b27-67d6-4999-9f59-008527bcd689 None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:42.886786 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b23b27-67d6-4999-9f59-008527bcd689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:42.906923 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-61b23b27-67d6-4999-9f59-008527bcd689 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:42.908194 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-61b23b27-67d6-4999-9f59-008527bcd689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:42.917540 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1447/2882] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:42.921892 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d2328-97e2-4dfc-ac22-7702f0e48726 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:42.931766 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d2328-97e2-4dfc-ac22-7702f0e48726 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:42.936294 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ed5ca-d7ec-4d6e-afb7-cd3c3c73f1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:42.936883 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ed5ca-d7ec-4d6e-afb7-cd3c3c73f1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:42.937995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ed5ca-d7ec-4d6e-afb7-cd3c3c73f1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:42.937995 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ed5ca-d7ec-4d6e-afb7-cd3c3c73f1a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:42.938734 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ed5ca-d7ec-4d6e-afb7-cd3c3c73f1a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82884) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 10:01:42.939037 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ed5ca-d7ec-4d6e-afb7-cd3c3c73f1a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:42.940610 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ed5ca-d7ec-4d6e-afb7-cd3c3c73f1a3 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:42.951963 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1436/2883] 10.222.0.58 () {58 vars in 1153 bytes} [Wed Aug 24 10:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 10:01:42.957093 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b23b27-67d6-4999-9f59-008527bcd689 None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:42.966362 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b23b27-67d6-4999-9f59-008527bcd689 None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:42.971184 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489608f3-19ef-476f-8510-cbae0a7c8cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:42.971776 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489608f3-19ef-476f-8510-cbae0a7c8cad admin admin] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:42.972055 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489608f3-19ef-476f-8510-cbae0a7c8cad admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:42.972329 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489608f3-19ef-476f-8510-cbae0a7c8cad admin admin] PATH_INFO: `/v3/projects` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:42.972952 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489608f3-19ef-476f-8510-cbae0a7c8cad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:42.974867 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489608f3-19ef-476f-8510-cbae0a7c8cad admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:43.001593 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1448/2884] 10.222.0.58 () {60 vars in 1153 bytes} [Wed Aug 24 10:01:42 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:43.005571 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ed5ca-d7ec-4d6e-afb7-cd3c3c73f1a3 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:43.016100 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ed5ca-d7ec-4d6e-afb7-cd3c3c73f1a3 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:43.071264 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d2486-4cfe-46a7-b676-7fd4d088e2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:43.071878 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d2486-4cfe-46a7-b676-7fd4d088e2d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:43.072160 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d2486-4cfe-46a7-b676-7fd4d088e2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:43.072434 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d2486-4cfe-46a7-b676-7fd4d088e2d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:43.073070 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d2486-4cfe-46a7-b676-7fd4d088e2d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:43.075013 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d2486-4cfe-46a7-b676-7fd4d088e2d6 admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:43.101505 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1437/2885] 10.222.0.58 () {60 vars in 1144 bytes} [Wed Aug 24 10:01:43 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 10:01:43.105684 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489608f3-19ef-476f-8510-cbae0a7c8cad admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:43.116579 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489608f3-19ef-476f-8510-cbae0a7c8cad admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:43.121331 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b78d0-ed45-44e2-a239-4782a26b9221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:43.121971 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b78d0-ed45-44e2-a239-4782a26b9221 admin admin] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:43.122254 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b78d0-ed45-44e2-a239-4782a26b9221 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:43.122533 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b78d0-ed45-44e2-a239-4782a26b9221 admin admin] PATH_INFO: `/v3/roles` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:43.123174 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b78d0-ed45-44e2-a239-4782a26b9221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:43.125497 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b78d0-ed45-44e2-a239-4782a26b9221 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:43.135701 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1449/2886] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:43.139664 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d2486-4cfe-46a7-b676-7fd4d088e2d6 admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:43.150583 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d2486-4cfe-46a7-b676-7fd4d088e2d6 admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:43.155409 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4851b5-d5d9-4b39-b9e0-45829e8529ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:43.156050 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4851b5-d5d9-4b39-b9e0-45829e8529ad admin admin] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:43.156502 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4851b5-d5d9-4b39-b9e0-45829e8529ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:43.156780 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4851b5-d5d9-4b39-b9e0-45829e8529ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:43.157427 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4851b5-d5d9-4b39-b9e0-45829e8529ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:43.159045 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4851b5-d5d9-4b39-b9e0-45829e8529ad admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:43.169538 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1438/2887] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 24 10:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 10:01:43.173755 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b78d0-ed45-44e2-a239-4782a26b9221 admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:43.183744 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b78d0-ed45-44e2-a239-4782a26b9221 admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:43.189805 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ddaa8-da54-4ecb-bd33-3fbc1950c5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:43.189983 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ddaa8-da54-4ecb-bd33-3fbc1950c5af admin admin] REQUEST_METHOD: `PUT` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:43.190268 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ddaa8-da54-4ecb-bd33-3fbc1950c5af admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:43.190597 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ddaa8-da54-4ecb-bd33-3fbc1950c5af admin admin] PATH_INFO: `/v3/projects/bd7cc3cbaaeb45e58e413500a18d6eb3/users/e00152e6271a4722a7079a1468d6098f/roles/ec487838eecf4dc4bde1eaa59af3eb26` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:43.207259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ddaa8-da54-4ecb-bd33-3fbc1950c5af admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7cc3cbaaeb45e58e413500a18d6eb3, user_id=e00152e6271a4722a7079a1468d6098f, role_id=ec487838eecf4dc4bde1eaa59af3eb26)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:43.209998 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ddaa8-da54-4ecb-bd33-3fbc1950c5af admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:43.223142 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1450/2888] 10.222.0.58 () {60 vars in 1483 bytes} [Wed Aug 24 10:01:43 2022] PUT /identity/v3/projects/bd7cc3cbaaeb45e58e413500a18d6eb3/users/e00152e6271a4722a7079a1468d6098f/roles/ec487838eecf4dc4bde1eaa59af3eb26 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:01:43.228370 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026f446-ad44-42fc-8992-90f46f3e9697 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:43.228824 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026f446-ad44-42fc-8992-90f46f3e9697 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:43.228969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026f446-ad44-42fc-8992-90f46f3e9697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:43.248475 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-f026f446-ad44-42fc-8992-90f46f3e9697 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:43.250439 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-f026f446-ad44-42fc-8992-90f46f3e9697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:43.258940 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:43.311230 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1439/2889] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:01:43.321418 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ddaa8-da54-4ecb-bd33-3fbc1950c5af admin admin] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:43.323173 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-862ddaa8-da54-4ecb-bd33-3fbc1950c5af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:43.381957 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ddaa8-da54-4ecb-bd33-3fbc1950c5af admin admin] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:43.385712 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a93db-58f2-4ee8-9a84-c3e6c0be5dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:43.386315 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a93db-58f2-4ee8-9a84-c3e6c0be5dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:43.386610 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a93db-58f2-4ee8-9a84-c3e6c0be5dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:43.386877 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a93db-58f2-4ee8-9a84-c3e6c0be5dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:43.396188 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a93db-58f2-4ee8-9a84-c3e6c0be5dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:43.397657 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a93db-58f2-4ee8-9a84-c3e6c0be5dd6 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:43.407373 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1451/2890] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:44.002025 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4d720-428f-4f7f-8548-6b4acb492289 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:44.002310 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4d720-428f-4f7f-8548-6b4acb492289 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:44.002584 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4d720-428f-4f7f-8548-6b4acb492289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:44.030474 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-55d4d720-428f-4f7f-8548-6b4acb492289 None None] MFA Rules not processed for user `e00152e6271a4722a7079a1468d6098f`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:44.032919 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-55d4d720-428f-4f7f-8548-6b4acb492289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:44.099523 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1440/2891] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:44.111507 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a93db-58f2-4ee8-9a84-c3e6c0be5dd6 service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:44.113544 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-aa1a93db-58f2-4ee8-9a84-c3e6c0be5dd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:44.181667 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a93db-58f2-4ee8-9a84-c3e6c0be5dd6 service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:44.185369 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30296fa-c556-4647-8126-f0109a41e28d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '782bdef852d34b9ba3a957962f93994f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:44.186015 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30296fa-c556-4647-8126-f0109a41e28d service cinder] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:44.186299 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30296fa-c556-4647-8126-f0109a41e28d service cinder] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:44.186572 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30296fa-c556-4647-8126-f0109a41e28d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:44.196446 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30296fa-c556-4647-8126-f0109a41e28d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:44.198005 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30296fa-c556-4647-8126-f0109a41e28d service cinder] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:44.203627 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:44.210638 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1452/2892] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:45.561026 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa693e62-61c7-4861-9ebf-e1f09525adc7 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:45.561523 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa693e62-61c7-4861-9ebf-e1f09525adc7 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:45.561629 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa693e62-61c7-4861-9ebf-e1f09525adc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:45.581047 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-aa693e62-61c7-4861-9ebf-e1f09525adc7 None None] MFA Rules not processed for user `e00152e6271a4722a7079a1468d6098f`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:01:45.582549 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-aa693e62-61c7-4861-9ebf-e1f09525adc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:45.589413 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1441/2893] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:01:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:01:45.820028 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30296fa-c556-4647-8126-f0109a41e28d service cinder] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:01:45.821549 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-f30296fa-c556-4647-8126-f0109a41e28d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:45.834077 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30296fa-c556-4647-8126-f0109a41e28d service cinder] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:01:45.837712 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3da0a-920f-4aa0-8cc5-6ae1321a6227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7847dbf8f31146c5ab2136fbdb487783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:01:45.838302 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3da0a-920f-4aa0-8cc5-6ae1321a6227 service neutron] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:01:45.838587 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3da0a-920f-4aa0-8cc5-6ae1321a6227 service neutron] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:01:45.838863 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3da0a-920f-4aa0-8cc5-6ae1321a6227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:01:45.840520 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-ace3da0a-920f-4aa0-8cc5-6ae1321a6227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:01:45.850647 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3da0a-920f-4aa0-8cc5-6ae1321a6227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:01:45.852045 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3da0a-920f-4aa0-8cc5-6ae1321a6227 service neutron] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:01:45.860667 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1453/2894] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:01:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:01:55.575755 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=56 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:01:55.856511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=6 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:21.562969 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b2eb3-cedd-4a0e-857c-a10b19d83e31 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:21.563544 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b2eb3-cedd-4a0e-857c-a10b19d83e31 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:21.563544 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b2eb3-cedd-4a0e-857c-a10b19d83e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:21.583939 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-f71b2eb3-cedd-4a0e-857c-a10b19d83e31 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:21.585154 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-f71b2eb3-cedd-4a0e-857c-a10b19d83e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:21.593539 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1442/2895] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Aug 24 10:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:21.615713 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3da0a-920f-4aa0-8cc5-6ae1321a6227 service neutron] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:21.617224 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-ace3da0a-920f-4aa0-8cc5-6ae1321a6227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:21.690196 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3da0a-920f-4aa0-8cc5-6ae1321a6227 service neutron] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:21.696214 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ae0d7-d0a7-4e53-b7f9-c9433beaab09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:21.696812 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ae0d7-d0a7-4e53-b7f9-c9433beaab09 service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:21.697091 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ae0d7-d0a7-4e53-b7f9-c9433beaab09 service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:21.697364 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ae0d7-d0a7-4e53-b7f9-c9433beaab09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:21.705478 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ae0d7-d0a7-4e53-b7f9-c9433beaab09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:21.708013 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ae0d7-d0a7-4e53-b7f9-c9433beaab09 service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:21.717425 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1454/2896] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 10:02:24.625861 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a253b5-5d4c-49ea-b22d-d1c8ae09d55b None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:24.626505 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a253b5-5d4c-49ea-b22d-d1c8ae09d55b None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:24.626505 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a253b5-5d4c-49ea-b22d-d1c8ae09d55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:24.647631 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-71a253b5-5d4c-49ea-b22d-d1c8ae09d55b None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:24.648845 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-71a253b5-5d4c-49ea-b22d-d1c8ae09d55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:24.657070 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1443/2897] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Aug 24 10:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:24.677080 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ae0d7-d0a7-4e53-b7f9-c9433beaab09 service nova] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:24.678527 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-363ae0d7-d0a7-4e53-b7f9-c9433beaab09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:24.693951 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ae0d7-d0a7-4e53-b7f9-c9433beaab09 service nova] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:24.699969 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c221e51-d517-4898-bd10-efde79be8ac6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:24.700593 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c221e51-d517-4898-bd10-efde79be8ac6 service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:24.700873 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c221e51-d517-4898-bd10-efde79be8ac6 service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:24.701149 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c221e51-d517-4898-bd10-efde79be8ac6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:24.710158 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c221e51-d517-4898-bd10-efde79be8ac6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:24.711717 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c221e51-d517-4898-bd10-efde79be8ac6 service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:24.721032 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1455/2898] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:27.876932 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec787e4-cc16-4e9c-a317-5f4c8dba4b54 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:27.877613 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec787e4-cc16-4e9c-a317-5f4c8dba4b54 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:27.877613 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec787e4-cc16-4e9c-a317-5f4c8dba4b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:27.896223 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-eec787e4-cc16-4e9c-a317-5f4c8dba4b54 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:27.897404 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-eec787e4-cc16-4e9c-a317-5f4c8dba4b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:27.905713 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1444/2899] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Aug 24 10:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:27.927073 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c221e51-d517-4898-bd10-efde79be8ac6 service nova] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:27.938474 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c221e51-d517-4898-bd10-efde79be8ac6 service nova] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:27.943983 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bf2fe-508e-4dba-87b5-b987cc66ccc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:27.944593 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bf2fe-508e-4dba-87b5-b987cc66ccc5 service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:27.944870 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bf2fe-508e-4dba-87b5-b987cc66ccc5 service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:27.945143 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bf2fe-508e-4dba-87b5-b987cc66ccc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:27.953647 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268bf2fe-508e-4dba-87b5-b987cc66ccc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:27.955211 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268bf2fe-508e-4dba-87b5-b987cc66ccc5 service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:27.965217 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1456/2900] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:30.995185 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdd584-2c0a-4612-af60-9832b8192131 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:30.995712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdd584-2c0a-4612-af60-9832b8192131 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:30.995712 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdd584-2c0a-4612-af60-9832b8192131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:31.015046 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-13cdd584-2c0a-4612-af60-9832b8192131 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:31.016252 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-13cdd584-2c0a-4612-af60-9832b8192131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:31.024178 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1445/2901] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Aug 24 10:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:31.043711 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bf2fe-508e-4dba-87b5-b987cc66ccc5 service nova] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:31.055636 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bf2fe-508e-4dba-87b5-b987cc66ccc5 service nova] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:31.061006 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2338476-4e40-44a3-a2e8-46066ef90634 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:31.061633 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2338476-4e40-44a3-a2e8-46066ef90634 service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:31.061914 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2338476-4e40-44a3-a2e8-46066ef90634 service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:31.062187 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2338476-4e40-44a3-a2e8-46066ef90634 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:31.070768 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2338476-4e40-44a3-a2e8-46066ef90634 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:31.072325 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2338476-4e40-44a3-a2e8-46066ef90634 service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:31.082658 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1457/2902] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:34.127492 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fea7e-a4cc-4220-bf55-66ef21e05b4e None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:34.128576 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fea7e-a4cc-4220-bf55-66ef21e05b4e None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:34.128687 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fea7e-a4cc-4220-bf55-66ef21e05b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:34.147878 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-985fea7e-a4cc-4220-bf55-66ef21e05b4e None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:34.149077 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-985fea7e-a4cc-4220-bf55-66ef21e05b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:34.157176 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1446/2903] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Aug 24 10:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:34.182700 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2338476-4e40-44a3-a2e8-46066ef90634 service nova] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:34.194652 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2338476-4e40-44a3-a2e8-46066ef90634 service nova] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:34.200096 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd045a4-fbab-40e8-9747-92ddd9524b97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:34.200687 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd045a4-fbab-40e8-9747-92ddd9524b97 service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:34.200963 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd045a4-fbab-40e8-9747-92ddd9524b97 service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:34.201235 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd045a4-fbab-40e8-9747-92ddd9524b97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:34.209927 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd045a4-fbab-40e8-9747-92ddd9524b97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:34.211479 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd045a4-fbab-40e8-9747-92ddd9524b97 service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:34.220794 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1458/2904] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:37.279598 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352cf13-c6b9-4894-a383-42abd09430f8 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:37.280113 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352cf13-c6b9-4894-a383-42abd09430f8 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:37.280113 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352cf13-c6b9-4894-a383-42abd09430f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:37.299018 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-7352cf13-c6b9-4894-a383-42abd09430f8 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:37.300820 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-7352cf13-c6b9-4894-a383-42abd09430f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:37.308629 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1447/2905] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Aug 24 10:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:02:37.330813 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd045a4-fbab-40e8-9747-92ddd9524b97 service nova] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:37.342553 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd045a4-fbab-40e8-9747-92ddd9524b97 service nova] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:37.348098 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c89e88-6b4b-44d7-a683-755b0db4cb66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:37.348692 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c89e88-6b4b-44d7-a683-755b0db4cb66 service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:37.348974 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c89e88-6b4b-44d7-a683-755b0db4cb66 service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:37.349251 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c89e88-6b4b-44d7-a683-755b0db4cb66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:37.357489 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c89e88-6b4b-44d7-a683-755b0db4cb66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:37.359058 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c89e88-6b4b-44d7-a683-755b0db4cb66 service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:37.369112 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1459/2906] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:47.294393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352cf13-c6b9-4894-a383-42abd09430f8 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:02:47.295335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=18 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:47.309159 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352cf13-c6b9-4894-a383-42abd09430f8 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:02:47.314664 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25196c9-8e4c-4887-922f-d2d492af1431 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:02:47.315408 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25196c9-8e4c-4887-922f-d2d492af1431 service nova] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:47.315688 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25196c9-8e4c-4887-922f-d2d492af1431 service nova] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:47.315963 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25196c9-8e4c-4887-922f-d2d492af1431 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:47.318024 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-e25196c9-8e4c-4887-922f-d2d492af1431 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:47.331338 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25196c9-8e4c-4887-922f-d2d492af1431 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:02:47.333006 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25196c9-8e4c-4887-922f-d2d492af1431 service nova] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:02:47.343638 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1448/2907] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:02:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:02:47.364879 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=64 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:02:52.381693 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5771f71-ba59-422d-bc97-6c09dcf1666a None None] REQUEST_METHOD: `POST` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:02:52.382303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5771f71-ba59-422d-bc97-6c09dcf1666a None None] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:02:52.382303 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5771f71-ba59-422d-bc97-6c09dcf1666a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:02:52.400989 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.auth.core [None req-a5771f71-ba59-422d-bc97-6c09dcf1666a None None] MFA Rules not processed for user `e00152e6271a4722a7079a1468d6098f`. Rule list: `[]` (Enabled: `True`). {{(pid=82885) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:02:52.402221 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.fernet_utils [None req-a5771f71-ba59-422d-bc97-6c09dcf1666a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82885) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:02:52.409089 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1460/2908] 10.222.0.58 () {58 vars in 958 bytes} [Wed Aug 24 10:02:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 10:02:57.339065 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=6 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:03:02.396250 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=3 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:03:05.270399 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e927720-ae6e-430e-b617-d9311ee455b8 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:05.270964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e927720-ae6e-430e-b617-d9311ee455b8 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:05.270964 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e927720-ae6e-430e-b617-d9311ee455b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:05.310198 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-4e927720-ae6e-430e-b617-d9311ee455b8 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:03:05.311399 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-4e927720-ae6e-430e-b617-d9311ee455b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:05.367842 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1449/2909] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Aug 24 10:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:03:05.388284 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5771f71-ba59-422d-bc97-6c09dcf1666a None None] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:03:05.425775 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5771f71-ba59-422d-bc97-6c09dcf1666a None None] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:03:05.431479 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f9907-db6e-4f10-a3ab-b37e53b870f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:03:05.432113 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f9907-db6e-4f10-a3ab-b37e53b870f3 service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:05.432387 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f9907-db6e-4f10-a3ab-b37e53b870f3 service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:05.432658 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f9907-db6e-4f10-a3ab-b37e53b870f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:05.441596 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f9907-db6e-4f10-a3ab-b37e53b870f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:03:05.443156 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f9907-db6e-4f10-a3ab-b37e53b870f3 service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:03:05.452448 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1461/2910] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:03:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:03:08.512138 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7644a-84e2-43ea-8b9c-3816292c5bbd None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:08.512676 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7644a-84e2-43ea-8b9c-3816292c5bbd None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:08.512676 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7644a-84e2-43ea-8b9c-3816292c5bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:08.531844 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-cdf7644a-84e2-43ea-8b9c-3816292c5bbd None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:03:08.533742 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-cdf7644a-84e2-43ea-8b9c-3816292c5bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:08.541590 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1450/2911] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Aug 24 10:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:03:08.564511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f9907-db6e-4f10-a3ab-b37e53b870f3 service nova] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:03:08.584970 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f9907-db6e-4f10-a3ab-b37e53b870f3 service nova] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:03:08.590349 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063259b3-9419-4069-b7d9-abf9f6eefbf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:03:08.590937 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063259b3-9419-4069-b7d9-abf9f6eefbf5 service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:08.591210 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063259b3-9419-4069-b7d9-abf9f6eefbf5 service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:08.591482 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063259b3-9419-4069-b7d9-abf9f6eefbf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:08.600192 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063259b3-9419-4069-b7d9-abf9f6eefbf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:03:08.601779 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063259b3-9419-4069-b7d9-abf9f6eefbf5 service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:03:08.611165 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1462/2912] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:03:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:03:11.603696 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba256262-6e8b-4d64-aa4d-a05693505bba None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:11.604180 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba256262-6e8b-4d64-aa4d-a05693505bba None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:11.604301 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba256262-6e8b-4d64-aa4d-a05693505bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:11.623982 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-ba256262-6e8b-4d64-aa4d-a05693505bba None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:03:11.625201 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ba256262-6e8b-4d64-aa4d-a05693505bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:11.633181 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1451/2913] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Aug 24 10:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:03:11.654735 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063259b3-9419-4069-b7d9-abf9f6eefbf5 service nova] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:03:11.666958 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063259b3-9419-4069-b7d9-abf9f6eefbf5 service nova] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:03:11.672511 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf1847-fb3c-41eb-a486-b12b80417232 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:03:11.673160 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf1847-fb3c-41eb-a486-b12b80417232 service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:11.673443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf1847-fb3c-41eb-a486-b12b80417232 service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:11.673810 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf1847-fb3c-41eb-a486-b12b80417232 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:11.682000 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf1847-fb3c-41eb-a486-b12b80417232 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:03:11.683547 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf1847-fb3c-41eb-a486-b12b80417232 service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:03:11.692848 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1463/2914] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:03:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:03:14.785842 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc566b-5a79-497e-a72b-daa767ef1c5f None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:14.786358 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc566b-5a79-497e-a72b-daa767ef1c5f None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:14.786460 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc566b-5a79-497e-a72b-daa767ef1c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:14.805530 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-befc566b-5a79-497e-a72b-daa767ef1c5f None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:03:14.806742 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-befc566b-5a79-497e-a72b-daa767ef1c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:14.814653 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1452/2915] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Aug 24 10:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:03:14.840259 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf1847-fb3c-41eb-a486-b12b80417232 service nova] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:03:14.852265 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf1847-fb3c-41eb-a486-b12b80417232 service nova] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:03:14.857801 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa549bf-aadf-48b7-8889-6e1143ecc68c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:03:14.858423 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa549bf-aadf-48b7-8889-6e1143ecc68c service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:14.858703 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa549bf-aadf-48b7-8889-6e1143ecc68c service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:14.858980 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa549bf-aadf-48b7-8889-6e1143ecc68c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:14.867131 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa549bf-aadf-48b7-8889-6e1143ecc68c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:03:14.868686 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa549bf-aadf-48b7-8889-6e1143ecc68c service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:03:14.879096 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1464/2916] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:03:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:03:17.919021 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec510854-b217-4126-8ab8-38ad7243af74 None None] REQUEST_METHOD: `POST` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:17.919564 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec510854-b217-4126-8ab8-38ad7243af74 None None] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:17.919667 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec510854-b217-4126-8ab8-38ad7243af74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:17.939241 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.auth.core [None req-ec510854-b217-4126-8ab8-38ad7243af74 None None] MFA Rules not processed for user `4757bd29ffb0448ca0dc35345a8b1469`. Rule list: `[]` (Enabled: `True`). {{(pid=82884) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 10:03:17.940441 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-ec510854-b217-4126-8ab8-38ad7243af74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:03:17.948328 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1453/2917] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Aug 24 10:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 10:03:17.969948 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa549bf-aadf-48b7-8889-6e1143ecc68c service nova] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:03:17.981378 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa549bf-aadf-48b7-8889-6e1143ecc68c service nova] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:03:17.987024 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aed1d8-bc84-4147-be40-38bd5735cbf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18be8c54c9644c5e9812eea09e60c11c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:03:17.987645 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aed1d8-bc84-4147-be40-38bd5735cbf8 service nova] REQUEST_METHOD: `GET` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:17.987925 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aed1d8-bc84-4147-be40-38bd5735cbf8 service nova] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:17.988203 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aed1d8-bc84-4147-be40-38bd5735cbf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:17.996273 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aed1d8-bc84-4147-be40-38bd5735cbf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:03:17.997864 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aed1d8-bc84-4147-be40-38bd5735cbf8 service nova] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:03:18.007979 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1465/2918] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:03:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:03:27.933658 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=43 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:03:28.003699 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=44 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:03:47.981407 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec510854-b217-4126-8ab8-38ad7243af74 None None] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:03:47.992653 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec510854-b217-4126-8ab8-38ad7243af74 None None] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:03:47.997393 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d27066-6438-4dcd-94b7-f9065a21417f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:03:47.997968 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d27066-6438-4dcd-94b7-f9065a21417f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:47.998249 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d27066-6438-4dcd-94b7-f9065a21417f admin admin] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:47.998523 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d27066-6438-4dcd-94b7-f9065a21417f admin admin] PATH_INFO: `/v3/users/e00152e6271a4722a7079a1468d6098f` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:47.999726 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d27066-6438-4dcd-94b7-f9065a21417f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e00152e6271a4722a7079a1468d6098f)` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:03:48.001656 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d27066-6438-4dcd-94b7-f9065a21417f admin admin] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:03:48.048681 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-70d27066-6438-4dcd-94b7-f9065a21417f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e00152e6271a4722a7079a1468d6098f'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:03:48.049335 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-70d27066-6438-4dcd-94b7-f9065a21417f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e00152e6271a4722a7079a1468d6098f'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:03:48.049983 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-70d27066-6438-4dcd-94b7-f9065a21417f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e00152e6271a4722a7079a1468d6098f'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:03:48.061669 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-70d27066-6438-4dcd-94b7-f9065a21417f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e00152e6271a4722a7079a1468d6098f'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:03:48.070367 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.notifications [None req-70d27066-6438-4dcd-94b7-f9065a21417f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e00152e6271a4722a7079a1468d6098f'} {{(pid=82884) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:03:48.083629 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1454/2919] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 24 10:03:47 2022] DELETE /identity/v3/users/e00152e6271a4722a7079a1468d6098f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:03:48.255632 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aed1d8-bc84-4147-be40-38bd5735cbf8 service nova] Authenticating user token {{(pid=82885) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:03:48.267580 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aed1d8-bc84-4147-be40-38bd5735cbf8 service nova] Validating token access rules against request {{(pid=82885) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:03:48.325543 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b43801-9ef4-40c1-a012-e164e75597e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4757bd29ffb0448ca0dc35345a8b1469', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28c010260e5042edbe919c3cfc65493b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82885) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:03:48.326166 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b43801-9ef4-40c1-a012-e164e75597e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:03:48.326443 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b43801-9ef4-40c1-a012-e164e75597e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:03:48.326718 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b43801-9ef4-40c1-a012-e164e75597e6 admin admin] PATH_INFO: `/v3/projects/bd7cc3cbaaeb45e58e413500a18d6eb3` {{(pid=82885) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:03:48.328405 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b43801-9ef4-40c1-a012-e164e75597e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd7cc3cbaaeb45e58e413500a18d6eb3)` {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:03:48.330597 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b43801-9ef4-40c1-a012-e164e75597e6 admin admin] RBAC: Authorization granted {{(pid=82885) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:03:48.376480 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-12b43801-9ef4-40c1-a012-e164e75597e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd7cc3cbaaeb45e58e413500a18d6eb3', 'request_id': 'req-12b43801-9ef4-40c1-a012-e164e75597e6'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:03:48.383388 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-12b43801-9ef4-40c1-a012-e164e75597e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd7cc3cbaaeb45e58e413500a18d6eb3', 'request_id': 'req-12b43801-9ef4-40c1-a012-e164e75597e6'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:03:48.389811 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-12b43801-9ef4-40c1-a012-e164e75597e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd7cc3cbaaeb45e58e413500a18d6eb3', 'request_id': 'req-12b43801-9ef4-40c1-a012-e164e75597e6'} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:03:48.400539 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-12b43801-9ef4-40c1-a012-e164e75597e6 admin admin] The token cache is being invalidate because project bd7cc3cbaaeb45e58e413500a18d6eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82885) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 10:03:48.400827 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-12b43801-9ef4-40c1-a012-e164e75597e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:03:48.401455 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG keystone.notifications [None req-12b43801-9ef4-40c1-a012-e164e75597e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82885) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 10:03:48.403154 dv-cinder-854271-2-smb devstack@keystone.service[82885]: [pid: 82885|app: 0|req: 1466/2920] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 24 10:03:48 2022] DELETE /identity/v3/projects/bd7cc3cbaaeb45e58e413500a18d6eb3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 10:03:58.080064 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:03:58.397590 dv-cinder-854271-2-smb devstack@keystone.service[82885]: DEBUG dbcounter [-] [82885] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82885) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:06.343811 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d27066-6438-4dcd-94b7-f9065a21417f admin admin] Authenticating user token {{(pid=82884) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 10:04:06.345247 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-70d27066-6438-4dcd-94b7-f9065a21417f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:06.446537 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d27066-6438-4dcd-94b7-f9065a21417f admin admin] Validating token access rules against request {{(pid=82884) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 10:04:06.505779 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13942c0a-6ffc-4611-911e-b164ab60c02e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6983e364f5564ed7854dff06a80f55d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c95aafd70e547d29c7647e6027faf2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82884) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 10:04:06.506314 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13942c0a-6ffc-4611-911e-b164ab60c02e service placement] REQUEST_METHOD: `GET` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 10:04:06.506595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13942c0a-6ffc-4611-911e-b164ab60c02e service placement] SCRIPT_NAME: `/identity` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 10:04:06.506872 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13942c0a-6ffc-4611-911e-b164ab60c02e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82884) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 10:04:06.508595 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.fernet_utils [None req-13942c0a-6ffc-4611-911e-b164ab60c02e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82884) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 10:04:06.520470 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13942c0a-6ffc-4611-911e-b164ab60c02e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 10:04:06.522071 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13942c0a-6ffc-4611-911e-b164ab60c02e service placement] RBAC: Authorization granted {{(pid=82884) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 10:04:06.532551 dv-cinder-854271-2-smb devstack@keystone.service[82884]: [pid: 82884|app: 0|req: 1455/2921] 10.222.0.58 () {60 vars in 1365 bytes} [Wed Aug 24 10:04:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 10:04:16.527742 dv-cinder-854271-2-smb devstack@keystone.service[82884]: DEBUG dbcounter [-] [82884] Writing DB stats keystone:SELECT=71 {{(pid=82884) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}